2024-09-16T16:32:14.988 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T16:32:15.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T16:32:15.105 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907388 branch: wip-matanb-crimson-testing-59543 description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rados_api_tests} email: null first_in_suite: false job_id: '7907388' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-59543 ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug ms: 1 debug osd: 20 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd objectstore: seastore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 6678 sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIdNLTd28hEG/QwsOlKRvZH2mgwiULSIyynk9wzNPRw0uXQ+a05FKd002+17mMsTwFMMFH4b+9HAJ2jAnGDXzHI= smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPUzF0urtdmfMqsYl23nxr57qToSKDh6A9uwQ9QSp3wt5Z3FkpLk7ipknohPTYNMX7m6h/3ikcQGoBrGlsP9kCQ= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh --crimson - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_16:23:48 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T16:32:15.105 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-16T16:32:15.106 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-16T16:32:15.106 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T16:32:15.108 INFO:teuthology.task.internal:Checking packages... 2024-09-16T16:32:15.129 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '81fedcb3b484c843d22ffbc8d179cb567b7083b5' 2024-09-16T16:32:15.129 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T16:32:15.129 INFO:teuthology.packaging:ref: None 2024-09-16T16:32:15.129 INFO:teuthology.packaging:tag: None 2024-09-16T16:32:15.129 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-59543 2024-09-16T16:32:15.129 INFO:teuthology.packaging:sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:32:15.129 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-59543 2024-09-16T16:32:15.268 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4879.g81fedcb3 2024-09-16T16:32:15.270 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T16:32:15.276 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T16:32:15.276 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T16:32:15.318 INFO:teuthology.task.internal:Saving configuration 2024-09-16T16:32:15.330 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T16:32:15.336 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T16:32:15.362 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907388', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 16:24:57.696461', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIdNLTd28hEG/QwsOlKRvZH2mgwiULSIyynk9wzNPRw0uXQ+a05FKd002+17mMsTwFMMFH4b+9HAJ2jAnGDXzHI='} 2024-09-16T16:32:15.386 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907388', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 16:24:57.697842', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPUzF0urtdmfMqsYl23nxr57qToSKDh6A9uwQ9QSp3wt5Z3FkpLk7ipknohPTYNMX7m6h/3ikcQGoBrGlsP9kCQ='} 2024-09-16T16:32:15.386 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T16:32:15.392 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-16T16:32:15.392 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-16T16:32:15.392 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T16:32:15.520 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f018e553be0>, signals=[15]) 2024-09-16T16:32:15.521 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T16:32:15.526 INFO:teuthology.task.internal:Opening connections... 2024-09-16T16:32:15.526 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2024-09-16T16:32:15.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:32:15.604 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T16:32:15.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:32:15.680 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T16:32:15.686 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2024-09-16T16:32:15.704 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2024-09-16T16:32:15.704 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-09-16T16:32:15.761 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2024-09-16T16:32:15.761 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2024-09-16T16:32:15.761 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2024-09-16T16:32:15.761 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2024-09-16T16:32:15.761 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2024-09-16T16:32:15.761 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2024-09-16T16:32:15.761 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T16:32:15.761 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2024-09-16T16:32:15.761 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2024-09-16T16:32:15.761 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T16:32:15.762 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2024-09-16T16:32:15.762 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T16:32:15.762 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T16:32:15.762 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T16:32:15.762 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-09-16T16:32:15.782 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-09-16T16:32:15.801 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-09-16T16:32:15.801 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-09-16T16:32:15.859 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-09-16T16:32:15.859 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2024-09-16T16:32:15.859 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-09-16T16:32:15.859 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-09-16T16:32:15.859 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2024-09-16T16:32:15.859 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2024-09-16T16:32:15.859 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T16:32:15.859 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-09-16T16:32:15.859 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2024-09-16T16:32:15.859 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T16:32:15.860 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-09-16T16:32:15.860 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T16:32:15.860 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T16:32:15.860 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T16:32:15.860 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-09-16T16:32:15.882 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T16:32:15.890 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T16:32:15.903 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T16:32:15.903 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2024-09-16T16:32:15.905 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2024-09-16T16:32:15.922 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T16:32:15.928 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T16:32:15.928 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2024-09-16T16:32:15.961 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2024-09-16T16:32:16.274 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T16:32:16.333 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T16:32:16.347 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-16T16:32:16.347 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-16T16:32:16.347 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T16:32:16.348 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T16:32:16.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:32:16.365 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-16T16:32:16.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:32:16.366 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-09-16T16:32:16.422 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-503.el9.x86_64 2024-09-16T16:32:16.422 INFO:teuthology.task.kernel:Running kernel on smithi089: 5.14.0-503.el9.x86_64 2024-09-16T16:32:16.422 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum install -y kernel 2024-09-16T16:32:16.424 INFO:teuthology.orchestra.run.smithi177.stdout:5.14.0-503.el9.x86_64 2024-09-16T16:32:16.424 INFO:teuthology.task.kernel:Running kernel on smithi177: 5.14.0-503.el9.x86_64 2024-09-16T16:32:16.424 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum install -y kernel 2024-09-16T16:32:18.605 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-16T16:32:19.484 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 6.3 MB/s | 8.2 MB 00:01 2024-09-16T16:32:22.535 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-16T16:32:24.147 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-16T16:32:28.402 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-16T16:32:29.786 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 104 kB/s | 19 kB 00:00 2024-09-16T16:32:29.805 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-16T16:32:30.841 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-16T16:32:31.289 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-16T16:32:32.744 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-16T16:32:36.238 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-16T16:32:38.203 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T16:32:38.203 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T16:32:38.266 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-16T16:32:38.296 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:32:38.305 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:32:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-09-16T16:32:38.305 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:32:38.305 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:32:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T16:32:38.305 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-16T16:32:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T16:32:38.305 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T16:32:38.306 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T16:32:38.306 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:32:38.306 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:32:38.306 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:32:38.306 INFO:teuthology.orchestra.run.smithi089.stdout:Install 4 Packages 2024-09-16T16:32:38.306 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:32:38.306 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 79 M 2024-09-16T16:32:38.307 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 126 M 2024-09-16T16:32:38.307 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:32:38.514 INFO:teuthology.orchestra.run.smithi089.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 255 kB/s | 23 kB 00:00 2024-09-16T16:32:40.239 INFO:teuthology.orchestra.run.smithi177.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T16:32:40.239 INFO:teuthology.orchestra.run.smithi177.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T16:32:40.318 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:32:40.328 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:32:40.328 INFO:teuthology.orchestra.run.smithi177.stdout: Package Architecture Version Repository Size 2024-09-16T16:32:40.328 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:32:40.328 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:32:40.328 INFO:teuthology.orchestra.run.smithi177.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T16:32:40.328 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-09-16T16:32:40.328 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T16:32:40.328 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T16:32:40.329 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T16:32:40.329 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:32:40.329 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:32:40.329 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:32:40.329 INFO:teuthology.orchestra.run.smithi177.stdout:Install 4 Packages 2024-09-16T16:32:40.329 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:32:40.330 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 79 M 2024-09-16T16:32:40.330 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 126 M 2024-09-16T16:32:40.330 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:32:40.742 INFO:teuthology.orchestra.run.smithi177.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 168 kB/s | 23 kB 00:00 2024-09-16T16:32:41.243 INFO:teuthology.orchestra.run.smithi177.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-16T16:32:41.498 INFO:teuthology.orchestra.run.smithi089.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.1 MB/s | 16 MB 00:03 2024-09-16T16:32:41.584 INFO:teuthology.orchestra.run.smithi177.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 34 MB/s | 29 MB 00:00 2024-09-16T16:32:42.118 INFO:teuthology.orchestra.run.smithi177.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 23 MB/s | 35 MB 00:01 2024-09-16T16:32:42.118 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:32:42.118 INFO:teuthology.orchestra.run.smithi177.stdout:Total 44 MB/s | 79 MB 00:01 2024-09-16T16:32:42.804 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:32:43.152 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:32:43.153 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:32:43.372 INFO:teuthology.orchestra.run.smithi089.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 5.9 MB/s | 29 MB 00:04 2024-09-16T16:32:43.706 INFO:teuthology.orchestra.run.smithi089.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.5 MB/s | 35 MB 00:05 2024-09-16T16:32:43.706 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:32:43.707 INFO:teuthology.orchestra.run.smithi089.stdout:Total 15 MB/s | 79 MB 00:05 2024-09-16T16:32:44.110 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:32:44.110 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:32:44.387 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:32:44.732 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:32:44.732 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:32:45.709 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:32:45.709 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:32:46.557 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:32:47.287 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:32:47.361 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:32:48.148 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:32:48.775 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:32:48.865 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:32:50.134 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:32:50.263 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:32:51.657 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:32:51.794 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:32:55.079 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:32:55.198 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:32:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:32:56.728 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:00.030 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:01.554 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:38.318 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:38.369 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:38.775 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:38.776 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:33:38.776 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:33:38.776 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:33:39.652 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:39.652 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:33:39.652 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:33:39.652 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:39.652 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T16:33:39.652 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T16:33:39.652 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T16:33:39.652 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:33:39.653 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:33:39.953 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:39.993 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:40.017 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:33:40.112 INFO:teuthology.orchestra.run.smithi177.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:40.113 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:33:40.113 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T16:33:40.113 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T16:33:40.113 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T16:33:40.113 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-16T16:33:40.113 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi177.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T16:33:40.113 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:33:40.173 INFO:teuthology.orchestra.run.smithi177.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:40.173 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:33:40.173 DEBUG:teuthology.orchestra.run.smithi177:> sudo rpm -qi grub2-tools 2024-09-16T16:33:40.213 INFO:teuthology.orchestra.run.smithi177.stdout:Name : grub2-tools 2024-09-16T16:33:40.213 INFO:teuthology.orchestra.run.smithi177.stdout:Epoch : 1 2024-09-16T16:33:40.213 INFO:teuthology.orchestra.run.smithi177.stdout:Version : 2.06 2024-09-16T16:33:40.213 INFO:teuthology.orchestra.run.smithi177.stdout:Release : 82.el9 2024-09-16T16:33:40.213 INFO:teuthology.orchestra.run.smithi177.stdout:Architecture: x86_64 2024-09-16T16:33:40.213 INFO:teuthology.orchestra.run.smithi177.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T16:33:40.213 INFO:teuthology.orchestra.run.smithi177.stdout:Group : Unspecified 2024-09-16T16:33:40.213 INFO:teuthology.orchestra.run.smithi177.stdout:Size : 8274670 2024-09-16T16:33:40.213 INFO:teuthology.orchestra.run.smithi177.stdout:License : GPLv3+ 2024-09-16T16:33:40.213 INFO:teuthology.orchestra.run.smithi177.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T16:33:40.213 INFO:teuthology.orchestra.run.smithi177.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T16:33:40.214 INFO:teuthology.orchestra.run.smithi177.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T16:33:40.214 INFO:teuthology.orchestra.run.smithi177.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T16:33:40.214 INFO:teuthology.orchestra.run.smithi177.stdout:Packager : builder@centos.org 2024-09-16T16:33:40.214 INFO:teuthology.orchestra.run.smithi177.stdout:Vendor : CentOS 2024-09-16T16:33:40.214 INFO:teuthology.orchestra.run.smithi177.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T16:33:40.214 INFO:teuthology.orchestra.run.smithi177.stdout:Summary : Support tools for GRUB. 2024-09-16T16:33:40.214 INFO:teuthology.orchestra.run.smithi177.stdout:Description : 2024-09-16T16:33:40.214 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:33:40.214 INFO:teuthology.orchestra.run.smithi177.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T16:33:40.214 INFO:teuthology.orchestra.run.smithi177.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T16:33:40.214 INFO:teuthology.orchestra.run.smithi177.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T16:33:40.214 INFO:teuthology.orchestra.run.smithi177.stdout:hardware devices. 2024-09-16T16:33:40.214 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:33:40.214 INFO:teuthology.orchestra.run.smithi177.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T16:33:40.215 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T16:33:40.215 INFO:teuthology.task.kernel:Updating grub on smithi177 to boot 5.14.0-505.el9.x86_64 2024-09-16T16:33:40.216 DEBUG:teuthology.orchestra.run.smithi177:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T16:33:40.408 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:40.408 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:33:40.408 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:33:40.408 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:33:40.833 INFO:teuthology.orchestra.run.smithi177.stderr:Generating grub configuration file ... 2024-09-16T16:33:41.249 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:41.249 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:33:41.249 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:33:41.249 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:41.249 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T16:33:41.249 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T16:33:41.249 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T16:33:41.249 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:33:41.249 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:33:41.604 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:33:41.684 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:41.685 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:33:41.685 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T16:33:41.685 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T16:33:41.685 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T16:33:41.685 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T16:33:41.685 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T16:33:41.685 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:33:41.744 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:41.744 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:33:41.744 DEBUG:teuthology.orchestra.run.smithi089:> sudo rpm -qi grub2-tools 2024-09-16T16:33:41.776 INFO:teuthology.orchestra.run.smithi089.stdout:Name : grub2-tools 2024-09-16T16:33:41.776 INFO:teuthology.orchestra.run.smithi089.stdout:Epoch : 1 2024-09-16T16:33:41.776 INFO:teuthology.orchestra.run.smithi089.stdout:Version : 2.06 2024-09-16T16:33:41.776 INFO:teuthology.orchestra.run.smithi089.stdout:Release : 82.el9 2024-09-16T16:33:41.777 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: x86_64 2024-09-16T16:33:41.777 INFO:teuthology.orchestra.run.smithi089.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T16:33:41.777 INFO:teuthology.orchestra.run.smithi089.stdout:Group : Unspecified 2024-09-16T16:33:41.777 INFO:teuthology.orchestra.run.smithi089.stdout:Size : 8274670 2024-09-16T16:33:41.777 INFO:teuthology.orchestra.run.smithi089.stdout:License : GPLv3+ 2024-09-16T16:33:41.777 INFO:teuthology.orchestra.run.smithi089.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T16:33:41.777 INFO:teuthology.orchestra.run.smithi089.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T16:33:41.777 INFO:teuthology.orchestra.run.smithi089.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T16:33:41.777 INFO:teuthology.orchestra.run.smithi089.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T16:33:41.777 INFO:teuthology.orchestra.run.smithi089.stdout:Packager : builder@centos.org 2024-09-16T16:33:41.777 INFO:teuthology.orchestra.run.smithi089.stdout:Vendor : CentOS 2024-09-16T16:33:41.777 INFO:teuthology.orchestra.run.smithi089.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T16:33:41.778 INFO:teuthology.orchestra.run.smithi089.stdout:Summary : Support tools for GRUB. 2024-09-16T16:33:41.778 INFO:teuthology.orchestra.run.smithi089.stdout:Description : 2024-09-16T16:33:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:33:41.778 INFO:teuthology.orchestra.run.smithi089.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T16:33:41.778 INFO:teuthology.orchestra.run.smithi089.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T16:33:41.778 INFO:teuthology.orchestra.run.smithi089.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T16:33:41.778 INFO:teuthology.orchestra.run.smithi089.stdout:hardware devices. 2024-09-16T16:33:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:33:41.778 INFO:teuthology.orchestra.run.smithi089.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T16:33:41.779 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T16:33:41.779 INFO:teuthology.task.kernel:Updating grub on smithi089 to boot 5.14.0-505.el9.x86_64 2024-09-16T16:33:41.780 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T16:33:42.149 INFO:teuthology.orchestra.run.smithi177.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T16:33:42.188 INFO:teuthology.orchestra.run.smithi177.stderr:done 2024-09-16T16:33:42.191 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-09-16T16:33:42.207 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.pHB7SzwLA6 2024-09-16T16:33:42.207 DEBUG:teuthology.orchestra.run.smithi177:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pHB7SzwLA6 2024-09-16T16:33:42.273 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.pHB7SzwLA6 2024-09-16T16:33:42.403 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2024-09-16T16:33:42.410 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.pHB7SzwLA6 is 6KB 2024-09-16T16:33:42.459 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.pHB7SzwLA6 2024-09-16T16:33:42.474 DEBUG:teuthology.orchestra.run.smithi177:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T16:33:42.537 INFO:teuthology.orchestra.run.smithi177.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T16:33:42.537 INFO:teuthology.orchestra.run.smithi177.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T16:33:42.537 INFO:teuthology.orchestra.run.smithi177.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T16:33:42.537 INFO:teuthology.orchestra.run.smithi177.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T16:33:42.539 DEBUG:teuthology.orchestra.run.smithi177:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T16:33:42.689 DEBUG:teuthology.orchestra.run.smithi177:> sudo shutdown -r now 2024-09-16T16:33:43.729 INFO:teuthology.orchestra.run.smithi089.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T16:33:43.770 INFO:teuthology.orchestra.run.smithi089.stderr:done 2024-09-16T16:33:43.772 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-09-16T16:33:43.787 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.PYo248XuLQ 2024-09-16T16:33:43.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.PYo248XuLQ 2024-09-16T16:33:43.854 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.PYo248XuLQ 2024-09-16T16:33:44.005 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.PYo248XuLQ is 6KB 2024-09-16T16:33:44.053 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.PYo248XuLQ 2024-09-16T16:33:44.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T16:33:44.131 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T16:33:44.131 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T16:33:44.131 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T16:33:44.131 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T16:33:44.132 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T16:33:44.287 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2024-09-16T16:34:12.719 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-16T16:34:12.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-16T16:34:12.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:34:14.292 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T16:34:14.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-16T16:34:14.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:34:48.766 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-16T16:34:57.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-16T16:34:57.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:35:12.738 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T16:35:16.157 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-16T16:35:21.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-16T16:35:21.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:35:22.132 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-09-16T16:35:22.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-16T16:35:22.544 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-16T16:35:22.544 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-09-16T16:35:22.562 INFO:teuthology.orchestra.run.smithi177.stdout:5.14.0-505.el9.x86_64 2024-09-16T16:35:22.562 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T16:35:22.562 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T16:35:22.562 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T16:35:23.563 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-16T16:35:23.563 DEBUG:teuthology.orchestra.run.smithi177:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T16:35:23.653 INFO:teuthology.orchestra.run.smithi177.stdout:ttyS1 2024-09-16T16:35:23.681 DEBUG:teuthology.parallel:result is None 2024-09-16T16:35:28.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-16T16:35:28.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:35:28.708 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-16T16:35:29.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-16T16:35:29.124 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T16:35:29.124 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-16T16:35:29.139 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-505.el9.x86_64 2024-09-16T16:35:29.139 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T16:35:29.139 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T16:35:29.139 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T16:35:30.141 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T16:35:30.141 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T16:35:30.226 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2024-09-16T16:35:30.250 DEBUG:teuthology.parallel:result is None 2024-09-16T16:35:30.250 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T16:35:30.257 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T16:35:30.257 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T16:35:30.260 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T16:35:30.302 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T16:35:30.308 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T16:35:30.362 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T16:35:30.362 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T16:35:30.365 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T16:35:30.432 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T16:35:30.438 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T16:35:30.439 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T16:35:30.441 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T16:35:30.475 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:35:30.485 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:35:30.521 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:35:30.551 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:35:30.553 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T16:35:30.560 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T16:35:30.560 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T16:35:30.563 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T16:35:30.633 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T16:35:30.668 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T16:35:30.668 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T16:35:30.670 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T16:35:30.714 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:35:30.763 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:35:30.799 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:35:30.880 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:35:30.917 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:35:30.917 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T16:35:30.979 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:35:31.019 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:35:31.248 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:35:31.296 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:35:31.332 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T16:35:31.332 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T16:35:31.397 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2024-09-16T16:35:31.399 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2024-09-16T16:35:31.440 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T16:35:31.489 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T16:35:31.847 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T16:35:31.855 INFO:teuthology.task.internal:Starting timer... 2024-09-16T16:35:31.855 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T16:35:31.928 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T16:35:31.938 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-16T16:35:31.938 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2024-09-16T16:35:31.994 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2024-09-16T16:35:31.996 DEBUG:teuthology.orchestra.run.smithi177:> sudo service auditd rotate 2024-09-16T16:35:32.070 INFO:teuthology.orchestra.run.smithi177.stdout:Rotating logs: 2024-09-16T16:35:32.072 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T16:35:32.072 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2024-09-16T16:35:32.095 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2024-09-16T16:35:32.095 DEBUG:teuthology.orchestra.run.smithi177:> /usr/sbin/getenforce 2024-09-16T16:35:32.141 INFO:teuthology.orchestra.run.smithi177.stdout:Permissive 2024-09-16T16:35:32.141 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi089.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi177.front.sepia.ceph.com': 'permissive'} 2024-09-16T16:35:32.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T16:35:32.167 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:35:32.167 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T16:35:32.206 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:35:32.207 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T16:35:32.207 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2024-09-16T16:35:32.245 DEBUG:teuthology.orchestra.run.smithi177:> sudo /usr/sbin/setenforce permissive 2024-09-16T16:35:32.277 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T16:35:32.290 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T16:35:32.302 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T16:35:32.303 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi089.front.sepia.ceph.com,smithi177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T16:39:56.488 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi177.front.sepia.ceph.com')] 2024-09-16T16:39:56.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-16T16:39:56.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:39:56.575 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-16T16:39:56.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-16T16:39:56.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-16T16:39:56.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:39:56.744 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-09-16T16:39:56.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-16T16:39:56.826 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T16:39:56.841 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T16:39:56.841 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T16:39:56.841 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T16:39:56.844 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T16:39:56.844 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T16:39:56.873 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T16:39:56.887 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T16:39:56.897 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T16:39:56.912 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2024-09-16T16:39:56.912 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T16:39:56.923 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2024-09-16T16:39:56.937 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T16:39:56.937 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: ntpd: command not found 2024-09-16T16:39:56.949 INFO:teuthology.orchestra.run.smithi177.stdout:506 Cannot talk to daemon 2024-09-16T16:39:56.952 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T16:39:56.963 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T16:39:56.977 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T16:39:57.004 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-09-16T16:39:57.007 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T16:39:57.007 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-09-16T16:39:57.007 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:39:57.007 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:39:57.008 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:39:57.008 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:39:57.040 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2024-09-16T16:39:57.043 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T16:39:57.043 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-09-16T16:39:57.043 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:39:57.043 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:39:57.044 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:39:57.044 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:39:57.045 INFO:teuthology.run_tasks:Running task install... 2024-09-16T16:39:57.052 DEBUG:teuthology.task.install:project ceph 2024-09-16T16:39:57.053 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}} 2024-09-16T16:39:57.053 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'} 2024-09-16T16:39:57.053 INFO:teuthology.task.install:Using flavor: crimson 2024-09-16T16:39:57.061 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T16:39:57.061 INFO:teuthology.task.install:extra packages: [] 2024-09-16T16:39:57.062 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T16:39:57.062 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:39:57.065 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T16:39:57.065 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:39:57.207 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T16:39:57.208 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T16:39:57.215 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T16:39:57.216 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T16:39:57.458 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T16:39:57.458 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T16:39:57.459 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T16:39:57.461 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T16:39:57.461 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:39:57.461 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T16:39:57.487 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T16:39:57.487 DEBUG:teuthology.orchestra.run.smithi177:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T16:39:57.488 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T16:39:57.488 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T16:39:57.554 DEBUG:teuthology.orchestra.run.smithi177:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T16:39:57.555 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T16:39:57.629 DEBUG:teuthology.orchestra.run.smithi177:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T16:39:57.630 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T16:39:57.693 INFO:teuthology.orchestra.run.smithi177.stdout:check_obsoletes = 1 2024-09-16T16:39:57.695 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum clean all 2024-09-16T16:39:57.695 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2024-09-16T16:39:57.696 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2024-09-16T16:39:57.924 INFO:teuthology.orchestra.run.smithi089.stdout:45 files removed 2024-09-16T16:39:57.951 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw 2024-09-16T16:39:57.978 INFO:teuthology.orchestra.run.smithi177.stdout:45 files removed 2024-09-16T16:39:58.005 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-radosgw 2024-09-16T16:39:58.503 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 333 kB/s | 88 kB 00:00 2024-09-16T16:39:58.568 INFO:teuthology.orchestra.run.smithi177.stdout:ceph packages for x86_64 317 kB/s | 88 kB 00:00 2024-09-16T16:39:58.795 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-16T16:39:58.860 INFO:teuthology.orchestra.run.smithi177.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-16T16:39:59.079 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 8.4 kB/s | 2.1 kB 00:00 2024-09-16T16:39:59.195 INFO:teuthology.orchestra.run.smithi177.stdout:ceph source packages 7.0 kB/s | 2.1 kB 00:00 2024-09-16T16:39:59.844 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-16T16:40:00.913 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-09-16T16:40:01.713 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-16T16:40:05.880 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 20 MB 00:03 2024-09-16T16:40:06.430 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - CRB 7.2 MB/s | 6.5 MB 00:00 2024-09-16T16:40:07.914 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-16T16:40:09.535 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-16T16:40:10.706 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 6.5 MB 00:00 2024-09-16T16:40:12.590 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-16T16:40:13.845 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-16T16:40:14.932 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-16T16:40:17.284 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:40:17.296 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:40:17.296 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-09-16T16:40:17.297 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:40:17.297 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:40:17.297 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T16:40:17.297 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrading: 2024-09-16T16:40:17.297 INFO:teuthology.orchestra.run.smithi177.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:40:17.297 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T16:40:17.297 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-09-16T16:40:17.297 INFO:teuthology.orchestra.run.smithi177.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T16:40:17.297 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T16:40:17.297 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T16:40:17.297 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T16:40:17.297 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T16:40:17.298 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T16:40:17.298 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T16:40:17.298 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T16:40:17.298 INFO:teuthology.orchestra.run.smithi177.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T16:40:17.298 INFO:teuthology.orchestra.run.smithi177.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T16:40:17.298 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T16:40:17.298 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T16:40:17.298 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T16:40:17.298 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T16:40:17.298 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T16:40:17.298 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T16:40:17.298 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T16:40:17.298 INFO:teuthology.orchestra.run.smithi177.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T16:40:17.299 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T16:40:17.299 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T16:40:17.299 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T16:40:17.299 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T16:40:17.299 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T16:40:17.299 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T16:40:17.299 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T16:40:17.299 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T16:40:17.299 INFO:teuthology.orchestra.run.smithi177.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T16:40:17.299 INFO:teuthology.orchestra.run.smithi177.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T16:40:17.299 INFO:teuthology.orchestra.run.smithi177.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T16:40:17.299 INFO:teuthology.orchestra.run.smithi177.stdout:Installing weak dependencies: 2024-09-16T16:40:17.299 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T16:40:17.300 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:40:17.300 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:40:17.300 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:40:17.300 INFO:teuthology.orchestra.run.smithi177.stdout:Install 31 Packages 2024-09-16T16:40:17.300 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrade 2 Packages 2024-09-16T16:40:17.300 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:40:17.301 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 60 M 2024-09-16T16:40:17.301 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:40:19.259 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-16T16:40:20.341 INFO:teuthology.orchestra.run.smithi177.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 2.1 MB/s | 6.1 MB 00:02 2024-09-16T16:40:20.441 INFO:teuthology.orchestra.run.smithi177.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 251 kB/s | 25 kB 00:00 2024-09-16T16:40:20.750 INFO:teuthology.orchestra.run.smithi177.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 2.6 MB/s | 809 kB 00:00 2024-09-16T16:40:20.967 INFO:teuthology.orchestra.run.smithi177.stdout:(4/33): libradosstriper1-19.3.0-4879.g81fedcb3. 2.5 MB/s | 558 kB 00:00 2024-09-16T16:40:21.634 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:40:21.651 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:40:21.651 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-16T16:40:21.651 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:40:21.652 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:40:21.652 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T16:40:21.652 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2024-09-16T16:40:21.652 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:40:21.652 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T16:40:21.652 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-16T16:40:21.652 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T16:40:21.652 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T16:40:21.653 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T16:40:21.653 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T16:40:21.653 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T16:40:21.653 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T16:40:21.653 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T16:40:21.653 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T16:40:21.653 INFO:teuthology.orchestra.run.smithi089.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T16:40:21.653 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T16:40:21.653 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T16:40:21.653 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T16:40:21.653 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T16:40:21.653 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T16:40:21.653 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T16:40:21.654 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T16:40:21.654 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T16:40:21.654 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T16:40:21.654 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T16:40:21.654 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T16:40:21.654 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T16:40:21.654 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T16:40:21.654 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T16:40:21.654 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T16:40:21.654 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T16:40:21.654 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T16:40:21.654 INFO:teuthology.orchestra.run.smithi089.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T16:40:21.654 INFO:teuthology.orchestra.run.smithi089.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T16:40:21.655 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T16:40:21.655 INFO:teuthology.orchestra.run.smithi089.stdout:Installing weak dependencies: 2024-09-16T16:40:21.655 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T16:40:21.655 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:40:21.655 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:40:21.655 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:40:21.655 INFO:teuthology.orchestra.run.smithi089.stdout:Install 31 Packages 2024-09-16T16:40:21.655 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 2 Packages 2024-09-16T16:40:21.655 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:40:21.656 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 60 M 2024-09-16T16:40:21.656 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:40:22.883 INFO:teuthology.orchestra.run.smithi177.stdout:(5/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_6 2.8 MB/s | 5.4 MB 00:01 2024-09-16T16:40:22.977 INFO:teuthology.orchestra.run.smithi177.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 481 kB/s | 45 kB 00:00 2024-09-16T16:40:23.078 INFO:teuthology.orchestra.run.smithi177.stdout:(7/33): python3-ceph-common-19.3.0-4879.g81fedc 1.4 MB/s | 143 kB 00:00 2024-09-16T16:40:23.186 INFO:teuthology.orchestra.run.smithi177.stdout:(8/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 1.4 MB/s | 160 kB 00:00 2024-09-16T16:40:23.403 INFO:teuthology.orchestra.run.smithi177.stdout:(9/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 1.8 MB/s | 10 MB 00:05 2024-09-16T16:40:23.428 INFO:teuthology.orchestra.run.smithi177.stdout:(10/33): python3-rados-19.3.0-4879.g81fedcb3.el 1.3 MB/s | 315 kB 00:00 2024-09-16T16:40:23.662 INFO:teuthology.orchestra.run.smithi177.stdout:(11/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 1.1 MB/s | 302 kB 00:00 2024-09-16T16:40:23.796 INFO:teuthology.orchestra.run.smithi177.stdout:(12/33): boost-program-options-1.75.0-8.el9.x86 801 kB/s | 107 kB 00:00 2024-09-16T16:40:23.879 INFO:teuthology.orchestra.run.smithi177.stdout:(13/33): libnbd-1.20.2-2.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2024-09-16T16:40:24.005 INFO:teuthology.orchestra.run.smithi177.stdout:(14/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-16T16:40:24.030 INFO:teuthology.orchestra.run.smithi177.stdout:(15/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 165 kB/s | 99 kB 00:00 2024-09-16T16:40:24.055 INFO:teuthology.orchestra.run.smithi177.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-16T16:40:24.214 INFO:teuthology.orchestra.run.smithi177.stdout:(17/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-09-16T16:40:24.281 INFO:teuthology.orchestra.run.smithi177.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 634 kB/s | 42 kB 00:00 2024-09-16T16:40:24.302 INFO:teuthology.orchestra.run.smithi089.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 2.4 MB/s | 6.1 MB 00:02 2024-09-16T16:40:24.364 INFO:teuthology.orchestra.run.smithi177.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 1.9 MB/s | 662 kB 00:00 2024-09-16T16:40:24.390 INFO:teuthology.orchestra.run.smithi177.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-16T16:40:24.393 INFO:teuthology.orchestra.run.smithi089.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 274 kB/s | 25 kB 00:00 2024-09-16T16:40:24.423 INFO:teuthology.orchestra.run.smithi177.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 611 kB/s | 36 kB 00:00 2024-09-16T16:40:24.449 INFO:teuthology.orchestra.run.smithi177.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-16T16:40:24.524 INFO:teuthology.orchestra.run.smithi177.stdout:(23/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.0 MB/s | 308 kB 00:00 2024-09-16T16:40:24.549 INFO:teuthology.orchestra.run.smithi177.stdout:(24/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-16T16:40:24.574 INFO:teuthology.orchestra.run.smithi177.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-16T16:40:24.600 INFO:teuthology.orchestra.run.smithi177.stdout:(26/33): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-16T16:40:24.661 INFO:teuthology.orchestra.run.smithi089.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 3.0 MB/s | 809 kB 00:00 2024-09-16T16:40:24.684 INFO:teuthology.orchestra.run.smithi177.stdout:(27/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-16T16:40:24.717 INFO:teuthology.orchestra.run.smithi177.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-16T16:40:24.817 INFO:teuthology.orchestra.run.smithi177.stdout:(29/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-16T16:40:24.869 INFO:teuthology.orchestra.run.smithi089.stdout:(4/33): libradosstriper1-19.3.0-4879.g81fedcb3. 2.6 MB/s | 558 kB 00:00 2024-09-16T16:40:24.884 INFO:teuthology.orchestra.run.smithi177.stdout:(30/33): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-16T16:40:25.445 INFO:teuthology.orchestra.run.smithi089.stdout:(5/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 2.8 MB/s | 10 MB 00:03 2024-09-16T16:40:25.570 INFO:teuthology.orchestra.run.smithi089.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 361 kB/s | 45 kB 00:00 2024-09-16T16:40:25.670 INFO:teuthology.orchestra.run.smithi089.stdout:(7/33): python3-ceph-common-19.3.0-4879.g81fedc 1.4 MB/s | 143 kB 00:00 2024-09-16T16:40:25.779 INFO:teuthology.orchestra.run.smithi089.stdout:(8/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 1.4 MB/s | 160 kB 00:00 2024-09-16T16:40:25.946 INFO:teuthology.orchestra.run.smithi089.stdout:(9/33): python3-rados-19.3.0-4879.g81fedcb3.el9 1.8 MB/s | 315 kB 00:00 2024-09-16T16:40:26.121 INFO:teuthology.orchestra.run.smithi089.stdout:(10/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 1.7 MB/s | 302 kB 00:00 2024-09-16T16:40:26.221 INFO:teuthology.orchestra.run.smithi089.stdout:(11/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 996 kB/s | 99 kB 00:00 2024-09-16T16:40:26.572 INFO:teuthology.orchestra.run.smithi089.stdout:(12/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_ 3.2 MB/s | 5.4 MB 00:01 2024-09-16T16:40:26.981 INFO:teuthology.orchestra.run.smithi089.stdout:(13/33): boost-program-options-1.75.0-8.el9.x86 141 kB/s | 107 kB 00:00 2024-09-16T16:40:27.209 INFO:teuthology.orchestra.run.smithi177.stdout:(31/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 1.4 MB/s | 3.5 MB 00:02 2024-09-16T16:40:27.398 INFO:teuthology.orchestra.run.smithi089.stdout:(14/33): libnbd-1.20.2-2.el9.x86_64.rpm 207 kB/s | 171 kB 00:00 2024-09-16T16:40:27.723 INFO:teuthology.orchestra.run.smithi089.stdout:(15/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 216 kB/s | 160 kB 00:00 2024-09-16T16:40:27.965 INFO:teuthology.orchestra.run.smithi089.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 80 kB/s | 45 kB 00:00 2024-09-16T16:40:28.715 INFO:teuthology.orchestra.run.smithi089.stdout:(17/33): librdkafka-1.6.1-102.el9.x86_64.rpm 668 kB/s | 662 kB 00:00 2024-09-16T16:40:28.857 INFO:teuthology.orchestra.run.smithi089.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 331 kB/s | 292 kB 00:00 2024-09-16T16:40:28.893 INFO:teuthology.orchestra.run.smithi177.stdout:(32/33): ceph-common-19.3.0-4879.g81fedcb3.el9. 1.7 MB/s | 20 MB 00:11 2024-09-16T16:40:29.234 INFO:teuthology.orchestra.run.smithi177.stdout:(33/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 893 kB/s | 3.8 MB 00:04 2024-09-16T16:40:29.240 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:40:29.240 INFO:teuthology.orchestra.run.smithi177.stdout:Total 5.1 MB/s | 60 MB 00:11 2024-09-16T16:40:29.356 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:40:29.394 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:40:29.394 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:40:29.399 INFO:teuthology.orchestra.run.smithi089.stdout:(19/33): ceph-common-19.3.0-4879.g81fedcb3.el9. 2.6 MB/s | 20 MB 00:07 2024-09-16T16:40:29.433 INFO:teuthology.orchestra.run.smithi089.stdout:(20/33): python3-prettytable-0.7.2-27.el9.noarc 59 kB/s | 42 kB 00:00 2024-09-16T16:40:29.842 INFO:teuthology.orchestra.run.smithi089.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 224 kB/s | 221 kB 00:00 2024-09-16T16:40:29.950 INFO:teuthology.orchestra.run.smithi089.stdout:(22/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-16T16:40:29.992 INFO:teuthology.orchestra.run.smithi089.stdout:(23/33): qatlib-service-24.02.0-1.el9.x86_64.rp 61 kB/s | 36 kB 00:00 2024-09-16T16:40:30.017 INFO:teuthology.orchestra.run.smithi089.stdout:(24/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 81 kB/s | 47 kB 00:00 2024-09-16T16:40:30.061 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:40:30.061 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:40:30.084 INFO:teuthology.orchestra.run.smithi089.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 286 kB/s | 26 kB 00:00 2024-09-16T16:40:30.177 INFO:teuthology.orchestra.run.smithi089.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 320 kB/s | 49 kB 00:00 2024-09-16T16:40:30.210 INFO:teuthology.orchestra.run.smithi089.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 544 kB/s | 67 kB 00:00 2024-09-16T16:40:30.260 INFO:teuthology.orchestra.run.smithi089.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 3.8 MB/s | 191 kB 00:00 2024-09-16T16:40:30.302 INFO:teuthology.orchestra.run.smithi089.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-16T16:40:30.411 INFO:teuthology.orchestra.run.smithi089.stdout:(30/33): libarrow-9.0.0-11.el9.x86_64.rpm 9.6 MB/s | 4.4 MB 00:00 2024-09-16T16:40:30.453 INFO:teuthology.orchestra.run.smithi089.stdout:(31/33): thrift-0.15.0-2.el9.x86_64.rpm 8.2 MB/s | 1.6 MB 00:00 2024-09-16T16:40:31.520 INFO:teuthology.orchestra.run.smithi089.stdout:(32/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 2.8 MB/s | 3.5 MB 00:01 2024-09-16T16:40:31.540 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:40:32.065 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T16:40:32.128 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:40:32.229 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:40:32.335 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:40:32.363 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:40:32.435 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:40:32.480 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T16:40:32.510 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T16:40:32.529 INFO:teuthology.orchestra.run.smithi089.stdout:(33/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 1.8 MB/s | 3.8 MB 00:02 2024-09-16T16:40:32.535 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T16:40:32.535 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:40:32.536 INFO:teuthology.orchestra.run.smithi089.stdout:Total 5.6 MB/s | 60 MB 00:10 2024-09-16T16:40:32.557 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:40:32.589 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:40:32.649 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:40:32.687 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:40:32.687 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:40:32.772 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:40:32.808 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:40:32.842 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T16:40:32.887 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T16:40:32.924 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:40:33.021 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T16:40:33.045 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:40:33.135 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:40:33.178 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T16:40:33.288 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T16:40:33.321 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T16:40:33.349 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:40:33.350 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:40:33.370 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T16:40:33.410 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T16:40:33.439 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T16:40:33.475 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T16:40:33.845 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T16:40:33.894 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:40:33.985 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:40:34.019 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T16:40:34.051 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T16:40:34.635 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T16:40:34.663 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:40:34.735 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:40:34.814 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T16:40:34.857 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T16:40:34.881 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:40:35.447 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T16:40:35.506 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:40:35.598 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:40:35.687 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:40:35.716 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:40:35.779 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:40:35.822 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T16:40:35.863 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T16:40:35.897 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T16:40:35.927 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:40:35.951 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:40:36.154 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:40:36.195 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:40:36.229 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T16:40:36.272 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T16:40:36.303 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:40:36.381 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T16:40:36.407 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:40:36.495 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:40:36.548 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T16:40:36.655 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T16:40:36.693 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T16:40:36.741 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T16:40:36.773 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T16:40:36.802 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T16:40:36.839 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T16:40:37.192 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T16:40:37.265 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:40:37.347 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:40:37.378 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T16:40:37.422 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T16:40:37.582 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:40:37.621 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:40:38.000 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T16:40:38.026 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:40:38.090 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:40:38.168 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T16:40:38.213 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T16:40:38.532 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:40:38.566 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:40:38.658 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:40:38.658 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T16:40:38.658 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T16:40:38.658 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:40:38.700 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:40:40.728 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:40:40.768 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:40:41.492 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:40:41.545 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:40:41.639 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:40:41.639 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T16:40:41.639 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T16:40:41.639 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:40:41.672 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:40:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:40:48.929 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /sys 2024-09-16T16:40:48.929 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /proc 2024-09-16T16:40:48.929 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /mnt 2024-09-16T16:40:48.929 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /var/tmp 2024-09-16T16:40:48.929 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /home 2024-09-16T16:40:48.929 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /root 2024-09-16T16:40:48.929 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /tmp 2024-09-16T16:40:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:40:50.025 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:40:50.050 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:40:50.051 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:40:50.051 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T16:40:50.051 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:40:50.051 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:40:50.051 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:40:50.053 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:40:50.135 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:40:50.136 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:40:51.468 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:40:51.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T16:40:51.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:40:51.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:40:51.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:40:51.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T16:40:51.468 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T16:40:51.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T16:40:51.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T16:40:51.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T16:40:51.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T16:40:51.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T16:40:51.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:40:51.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T16:40:51.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T16:40:51.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T16:40:51.469 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T16:40:51.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T16:40:51.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T16:40:51.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T16:40:51.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T16:40:51.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T16:40:51.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T16:40:51.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T16:40:51.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T16:40:51.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T16:40:51.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T16:40:51.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T16:40:51.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T16:40:51.470 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T16:40:51.471 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T16:40:51.471 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T16:40:51.471 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:40:51.471 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T16:40:51.471 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T16:40:51.686 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:40:51.686 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2024-09-16T16:40:51.686 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2024-09-16T16:40:51.686 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2024-09-16T16:40:51.686 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2024-09-16T16:40:51.686 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2024-09-16T16:40:51.686 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /root 2024-09-16T16:40:51.686 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2024-09-16T16:40:51.686 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:40:52.442 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:40:52.442 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:40:52.443 INFO:teuthology.orchestra.run.smithi177.stdout:Upgraded: 2024-09-16T16:40:52.443 INFO:teuthology.orchestra.run.smithi177.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:52.443 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:52.443 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:40:52.443 INFO:teuthology.orchestra.run.smithi177.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T16:40:52.443 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:52.443 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:52.443 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:52.443 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:52.443 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T16:40:52.443 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T16:40:52.444 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T16:40:52.444 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:52.444 INFO:teuthology.orchestra.run.smithi177.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T16:40:52.444 INFO:teuthology.orchestra.run.smithi177.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T16:40:52.444 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T16:40:52.444 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T16:40:52.444 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:52.444 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T16:40:52.444 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:52.444 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T16:40:52.444 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T16:40:52.444 INFO:teuthology.orchestra.run.smithi177.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T16:40:52.444 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:52.445 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:52.445 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:52.445 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T16:40:52.445 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:52.445 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:52.445 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:52.445 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T16:40:52.445 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T16:40:52.445 INFO:teuthology.orchestra.run.smithi177.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T16:40:52.445 INFO:teuthology.orchestra.run.smithi177.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T16:40:52.445 INFO:teuthology.orchestra.run.smithi177.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T16:40:52.445 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:40:52.445 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:40:52.779 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-test 2024-09-16T16:40:52.817 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:40:52.841 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:40:52.841 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:40:52.841 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T16:40:52.842 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:40:52.842 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:40:52.842 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:40:52.843 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:40:52.927 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:40:52.928 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:40:53.347 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:00:39 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:40:53.480 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:40:53.481 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:40:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-09-16T16:40:53.481 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:40:53.481 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:40:53.481 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T16:40:53.481 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-09-16T16:40:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T16:40:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T16:40:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T16:40:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T16:40:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T16:40:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T16:40:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T16:40:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T16:40:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:40:53.482 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:40:53.482 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:40:53.482 INFO:teuthology.orchestra.run.smithi177.stdout:Install 9 Packages 2024-09-16T16:40:53.482 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:40:53.483 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 87 M 2024-09-16T16:40:53.483 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 797 M 2024-09-16T16:40:53.483 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:40:54.164 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:40:54.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T16:40:54.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:40:54.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:40:54.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:40:54.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T16:40:54.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T16:40:54.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T16:40:54.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T16:40:54.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T16:40:54.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T16:40:54.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T16:40:54.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:40:54.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T16:40:54.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T16:40:54.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T16:40:54.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T16:40:54.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T16:40:54.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T16:40:54.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T16:40:54.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T16:40:54.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T16:40:54.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T16:40:54.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T16:40:54.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T16:40:54.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T16:40:54.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T16:40:54.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T16:40:54.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T16:40:54.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T16:40:54.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T16:40:54.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T16:40:54.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:40:54.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T16:40:54.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T16:40:54.491 INFO:teuthology.orchestra.run.smithi177.stdout:(1/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 274 kB/s | 175 kB 00:00 2024-09-16T16:40:54.516 INFO:teuthology.orchestra.run.smithi177.stdout:(2/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 142 kB/s | 94 kB 00:00 2024-09-16T16:40:54.649 INFO:teuthology.orchestra.run.smithi177.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 183 kB 00:00 2024-09-16T16:40:54.683 INFO:teuthology.orchestra.run.smithi177.stdout:(4/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 2.6 MB/s | 513 kB 00:00 2024-09-16T16:40:54.737 INFO:teuthology.orchestra.run.smithi177.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-16T16:40:54.775 INFO:teuthology.orchestra.run.smithi177.stdout:(6/9): protobuf-3.14.0-13.el9.x86_64.rpm 8.0 MB/s | 1.0 MB 00:00 2024-09-16T16:40:54.801 INFO:teuthology.orchestra.run.smithi177.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 950 kB/s | 64 kB 00:00 2024-09-16T16:40:54.842 INFO:teuthology.orchestra.run.smithi177.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.8 MB/s | 122 kB 00:00 2024-09-16T16:40:55.078 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:40:55.078 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:40:55.078 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2024-09-16T16:40:55.078 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:55.078 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:55.078 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:40:55.078 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T16:40:55.079 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:55.079 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:55.079 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:55.079 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:55.079 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T16:40:55.079 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T16:40:55.079 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T16:40:55.079 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:55.079 INFO:teuthology.orchestra.run.smithi089.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T16:40:55.079 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T16:40:55.079 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T16:40:55.079 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T16:40:55.079 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:55.080 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T16:40:55.080 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:55.080 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T16:40:55.080 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T16:40:55.080 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T16:40:55.080 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:55.080 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:55.080 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:55.080 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T16:40:55.080 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:55.080 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:55.080 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:40:55.080 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T16:40:55.081 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T16:40:55.081 INFO:teuthology.orchestra.run.smithi089.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T16:40:55.081 INFO:teuthology.orchestra.run.smithi089.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T16:40:55.081 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T16:40:55.081 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:40:55.081 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:40:55.438 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-test 2024-09-16T16:40:56.008 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:37 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:40:56.142 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:40:56.143 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:40:56.143 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-16T16:40:56.143 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:40:56.143 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:40:56.143 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T16:40:56.143 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-16T16:40:56.143 INFO:teuthology.orchestra.run.smithi089.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T16:40:56.143 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T16:40:56.143 INFO:teuthology.orchestra.run.smithi089.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T16:40:56.143 INFO:teuthology.orchestra.run.smithi089.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T16:40:56.144 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T16:40:56.144 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T16:40:56.144 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T16:40:56.144 INFO:teuthology.orchestra.run.smithi089.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T16:40:56.144 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:40:56.144 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:40:56.144 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:40:56.144 INFO:teuthology.orchestra.run.smithi089.stdout:Install 9 Packages 2024-09-16T16:40:56.144 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:40:56.145 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 87 M 2024-09-16T16:40:56.145 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 797 M 2024-09-16T16:40:56.145 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:40:57.001 INFO:teuthology.orchestra.run.smithi089.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 839 kB/s | 94 kB 00:00 2024-09-16T16:40:57.593 INFO:teuthology.orchestra.run.smithi089.stdout:(2/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 248 kB/s | 175 kB 00:00 2024-09-16T16:40:57.868 INFO:teuthology.orchestra.run.smithi089.stdout:(3/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 602 kB/s | 513 kB 00:00 2024-09-16T16:40:58.394 INFO:teuthology.orchestra.run.smithi089.stdout:(4/9): libubsan-11.5.0-2.el9.x86_64.rpm 228 kB/s | 183 kB 00:00 2024-09-16T16:40:58.794 INFO:teuthology.orchestra.run.smithi089.stdout:(5/9): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-16T16:40:59.253 INFO:teuthology.orchestra.run.smithi089.stdout:(6/9): socat-1.7.4.1-6.el9.x86_64.rpm 354 kB/s | 304 kB 00:00 2024-09-16T16:40:59.303 INFO:teuthology.orchestra.run.smithi089.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.4 MB/s | 122 kB 00:00 2024-09-16T16:40:59.478 INFO:teuthology.orchestra.run.smithi089.stdout:(8/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 93 kB/s | 64 kB 00:00 2024-09-16T16:43:44.050 INFO:teuthology.orchestra.run.smithi177.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 509 kB/s | 85 MB 02:50 2024-09-16T16:43:44.051 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:44.052 INFO:teuthology.orchestra.run.smithi177.stdout:Total 523 kB/s | 87 MB 02:50 2024-09-16T16:43:44.120 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:43:44.142 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:43:44.142 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:43:44.761 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:43:44.761 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:43:45.661 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:43:45.727 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T16:43:45.776 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T16:43:45.829 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T16:43:45.880 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T16:43:45.911 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:43:45.936 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:43:46.010 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:43:46.054 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T16:43:46.091 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:43:47.765 INFO:teuthology.orchestra.run.smithi089.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 507 kB/s | 85 MB 02:50 2024-09-16T16:43:47.768 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:47.768 INFO:teuthology.orchestra.run.smithi089.stdout:Total 520 kB/s | 87 MB 02:51 2024-09-16T16:43:47.837 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:43:47.859 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:43:47.859 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:43:48.518 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:43:48.518 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:43:49.451 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:43:49.523 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T16:43:49.576 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T16:43:49.620 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T16:43:49.655 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T16:43:49.686 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:43:49.719 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:43:49.794 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:43:49.845 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T16:43:49.880 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:43:57.290 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:43:57.372 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:44:01.034 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:44:01.115 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:44:03.595 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:44:03.595 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T16:44:03.595 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T16:44:03.595 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T16:44:03.596 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T16:44:03.596 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:44:03.596 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T16:44:03.596 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T16:44:03.596 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T16:44:04.029 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T16:44:04.029 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:44:04.029 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:44:04.029 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:04.029 INFO:teuthology.orchestra.run.smithi177.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T16:44:04.029 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:04.029 INFO:teuthology.orchestra.run.smithi177.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T16:44:04.029 INFO:teuthology.orchestra.run.smithi177.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T16:44:04.029 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T16:44:04.030 INFO:teuthology.orchestra.run.smithi177.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T16:44:04.030 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T16:44:04.030 INFO:teuthology.orchestra.run.smithi177.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T16:44:04.030 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:44:04.030 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:44:04.426 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph 2024-09-16T16:44:04.996 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:03:50 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:44:05.138 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:44:05.141 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:44:05.141 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-09-16T16:44:05.141 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:44:05.141 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:44:05.141 INFO:teuthology.orchestra.run.smithi177.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T16:44:05.142 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-09-16T16:44:05.142 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T16:44:05.142 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T16:44:05.142 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T16:44:05.142 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T16:44:05.142 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T16:44:05.142 INFO:teuthology.orchestra.run.smithi177.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T16:44:05.142 INFO:teuthology.orchestra.run.smithi177.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T16:44:05.142 INFO:teuthology.orchestra.run.smithi177.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T16:44:05.142 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T16:44:05.142 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T16:44:05.143 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T16:44:05.143 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T16:44:05.143 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T16:44:05.143 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T16:44:05.143 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T16:44:05.143 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections 2024-09-16T16:44:05.143 INFO:teuthology.orchestra.run.smithi177.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T16:44:05.143 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T16:44:05.143 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T16:44:05.143 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T16:44:05.143 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T16:44:05.143 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T16:44:05.143 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T16:44:05.144 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T16:44:05.144 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T16:44:05.144 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T16:44:05.144 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T16:44:05.144 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T16:44:05.144 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T16:44:05.144 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T16:44:05.144 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T16:44:05.144 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T16:44:05.144 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T16:44:05.144 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T16:44:05.144 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T16:44:05.144 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T16:44:05.144 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T16:44:05.145 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:44:05.145 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:44:05.145 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:44:05.145 INFO:teuthology.orchestra.run.smithi177.stdout:Install 37 Packages 2024-09-16T16:44:05.145 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:44:05.145 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 84 M 2024-09-16T16:44:05.146 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 897 M 2024-09-16T16:44:05.146 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:44:05.957 INFO:teuthology.orchestra.run.smithi177.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 19 kB/s | 6.5 kB 00:00 2024-09-16T16:44:06.857 INFO:teuthology.orchestra.run.smithi177.stdout:(2/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 1.3 MB/s | 1.6 MB 00:01 2024-09-16T16:44:07.066 INFO:teuthology.orchestra.run.smithi177.stdout:(3/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 1.5 MB/s | 2.2 MB 00:01 2024-09-16T16:44:07.250 INFO:teuthology.orchestra.run.smithi177.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 1.6 MB/s | 291 kB 00:00 2024-09-16T16:44:07.460 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:44:07.460 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T16:44:07.460 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T16:44:07.460 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T16:44:07.461 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T16:44:07.461 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:44:07.461 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T16:44:07.461 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T16:44:07.461 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T16:44:07.800 INFO:teuthology.orchestra.run.smithi177.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 460 kB/s | 253 kB 00:00 2024-09-16T16:44:07.822 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T16:44:07.822 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:44:07.822 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:44:07.822 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:07.822 INFO:teuthology.orchestra.run.smithi089.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T16:44:07.822 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:07.822 INFO:teuthology.orchestra.run.smithi089.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T16:44:07.822 INFO:teuthology.orchestra.run.smithi089.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T16:44:07.822 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T16:44:07.822 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T16:44:07.823 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T16:44:07.823 INFO:teuthology.orchestra.run.smithi089.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T16:44:07.823 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:44:07.823 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:44:08.155 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph 2024-09-16T16:44:08.367 INFO:teuthology.orchestra.run.smithi177.stdout:(6/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86_ 2.1 MB/s | 5.1 MB 00:02 2024-09-16T16:44:08.409 INFO:teuthology.orchestra.run.smithi177.stdout:(7/37): python3-cryptography-36.0.1-4.el9.x86_6 2.0 MB/s | 1.2 MB 00:00 2024-09-16T16:44:08.534 INFO:teuthology.orchestra.run.smithi177.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-16T16:44:08.651 INFO:teuthology.orchestra.run.smithi177.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.0 MB/s | 125 kB 00:00 2024-09-16T16:44:08.720 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:49 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:44:08.768 INFO:teuthology.orchestra.run.smithi177.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.8 MB/s | 215 kB 00:00 2024-09-16T16:44:08.835 INFO:teuthology.orchestra.run.smithi177.stdout:(11/37): python3-ply-3.11-14.el9.noarch.rpm 228 kB/s | 106 kB 00:00 2024-09-16T16:44:08.867 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:44:08.869 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:44:08.869 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-16T16:44:08.869 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:44:08.869 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:44:08.870 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T16:44:08.870 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-16T16:44:08.870 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T16:44:08.870 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T16:44:08.870 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T16:44:08.870 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T16:44:08.870 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T16:44:08.870 INFO:teuthology.orchestra.run.smithi089.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T16:44:08.870 INFO:teuthology.orchestra.run.smithi089.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T16:44:08.870 INFO:teuthology.orchestra.run.smithi089.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T16:44:08.870 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T16:44:08.870 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T16:44:08.870 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T16:44:08.871 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T16:44:08.871 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T16:44:08.871 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T16:44:08.871 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T16:44:08.871 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections 2024-09-16T16:44:08.871 INFO:teuthology.orchestra.run.smithi089.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T16:44:08.871 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T16:44:08.871 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T16:44:08.871 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T16:44:08.871 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T16:44:08.871 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T16:44:08.871 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T16:44:08.871 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T16:44:08.871 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T16:44:08.872 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T16:44:08.872 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T16:44:08.872 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T16:44:08.872 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T16:44:08.872 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T16:44:08.872 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T16:44:08.872 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T16:44:08.872 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T16:44:08.872 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T16:44:08.872 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T16:44:08.872 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T16:44:08.872 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T16:44:08.872 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:44:08.873 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:44:08.873 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:44:08.873 INFO:teuthology.orchestra.run.smithi089.stdout:Install 37 Packages 2024-09-16T16:44:08.873 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:44:08.873 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 84 M 2024-09-16T16:44:08.873 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 897 M 2024-09-16T16:44:08.874 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:44:08.904 INFO:teuthology.orchestra.run.smithi177.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-16T16:44:09.027 INFO:teuthology.orchestra.run.smithi177.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 283 kB/s | 35 kB 00:00 2024-09-16T16:44:09.052 INFO:teuthology.orchestra.run.smithi177.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 792 kB/s | 172 kB 00:00 2024-09-16T16:44:09.136 INFO:teuthology.orchestra.run.smithi177.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 711 kB/s | 77 kB 00:00 2024-09-16T16:44:09.161 INFO:teuthology.orchestra.run.smithi177.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 470 kB/s | 51 kB 00:00 2024-09-16T16:44:09.253 INFO:teuthology.orchestra.run.smithi177.stdout:(17/37): lua-devel-5.4.4-4.el9.x86_64.rpm 244 kB/s | 22 kB 00:00 2024-09-16T16:44:09.279 INFO:teuthology.orchestra.run.smithi177.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 293 kB/s | 42 kB 00:00 2024-09-16T16:44:09.337 INFO:teuthology.orchestra.run.smithi177.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 746 kB/s | 43 kB 00:00 2024-09-16T16:44:09.363 INFO:teuthology.orchestra.run.smithi177.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-16T16:44:09.388 INFO:teuthology.orchestra.run.smithi177.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-16T16:44:09.413 INFO:teuthology.orchestra.run.smithi177.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-16T16:44:09.438 INFO:teuthology.orchestra.run.smithi177.stdout:(23/37): python3-cherrypy-18.6.1-2.el9.noarch.r 4.7 MB/s | 358 kB 00:00 2024-09-16T16:44:09.464 INFO:teuthology.orchestra.run.smithi177.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-09-16T16:44:09.489 INFO:teuthology.orchestra.run.smithi177.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-16T16:44:09.514 INFO:teuthology.orchestra.run.smithi177.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-16T16:44:09.540 INFO:teuthology.orchestra.run.smithi177.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 390 kB/s | 20 kB 00:00 2024-09-16T16:44:09.565 INFO:teuthology.orchestra.run.smithi177.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-16T16:44:09.590 INFO:teuthology.orchestra.run.smithi177.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-16T16:44:09.615 INFO:teuthology.orchestra.run.smithi177.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 661 kB/s | 16 kB 00:00 2024-09-16T16:44:09.641 INFO:teuthology.orchestra.run.smithi177.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-16T16:44:09.666 INFO:teuthology.orchestra.run.smithi177.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-16T16:44:09.691 INFO:teuthology.orchestra.run.smithi177.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 710 kB/s | 36 kB 00:00 2024-09-16T16:44:09.717 INFO:teuthology.orchestra.run.smithi177.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-16T16:44:09.742 INFO:teuthology.orchestra.run.smithi177.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 801 kB/s | 20 kB 00:00 2024-09-16T16:44:09.767 INFO:teuthology.orchestra.run.smithi177.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-16T16:44:10.135 INFO:teuthology.orchestra.run.smithi089.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 17 kB/s | 6.5 kB 00:00 2024-09-16T16:44:10.935 INFO:teuthology.orchestra.run.smithi089.stdout:(2/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 1.3 MB/s | 1.6 MB 00:01 2024-09-16T16:44:12.752 INFO:teuthology.orchestra.run.smithi089.stdout:(3/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86_ 2.0 MB/s | 5.1 MB 00:02 2024-09-16T16:44:12.902 INFO:teuthology.orchestra.run.smithi089.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 1.9 MB/s | 291 kB 00:00 2024-09-16T16:44:13.036 INFO:teuthology.orchestra.run.smithi089.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-09-16T16:44:13.170 INFO:teuthology.orchestra.run.smithi089.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 9.2 MB/s | 1.2 MB 00:00 2024-09-16T16:44:13.212 INFO:teuthology.orchestra.run.smithi089.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-16T16:44:13.254 INFO:teuthology.orchestra.run.smithi089.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-16T16:44:13.296 INFO:teuthology.orchestra.run.smithi089.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-09-16T16:44:13.338 INFO:teuthology.orchestra.run.smithi089.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 5.1 MB/s | 215 kB 00:00 2024-09-16T16:44:13.480 INFO:teuthology.orchestra.run.smithi089.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-09-16T16:44:13.530 INFO:teuthology.orchestra.run.smithi089.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-16T16:44:13.572 INFO:teuthology.orchestra.run.smithi089.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 834 kB/s | 35 kB 00:00 2024-09-16T16:44:13.614 INFO:teuthology.orchestra.run.smithi089.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2024-09-16T16:44:13.656 INFO:teuthology.orchestra.run.smithi089.stdout:(15/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-16T16:44:13.698 INFO:teuthology.orchestra.run.smithi089.stdout:(16/37): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-16T16:44:14.231 INFO:teuthology.orchestra.run.smithi089.stdout:(17/37): lua-devel-5.4.4-4.el9.x86_64.rpm 42 kB/s | 22 kB 00:00 2024-09-16T16:44:14.282 INFO:teuthology.orchestra.run.smithi089.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-16T16:44:14.305 INFO:teuthology.orchestra.run.smithi089.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.8 MB/s | 43 kB 00:00 2024-09-16T16:44:14.331 INFO:teuthology.orchestra.run.smithi089.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.7 MB/s | 172 kB 00:00 2024-09-16T16:44:14.373 INFO:teuthology.orchestra.run.smithi089.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 8.4 MB/s | 358 kB 00:00 2024-09-16T16:44:14.398 INFO:teuthology.orchestra.run.smithi089.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 431 kB/s | 11 kB 00:00 2024-09-16T16:44:14.423 INFO:teuthology.orchestra.run.smithi089.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 708 kB/s | 18 kB 00:00 2024-09-16T16:44:14.449 INFO:teuthology.orchestra.run.smithi089.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 922 kB/s | 23 kB 00:00 2024-09-16T16:44:14.499 INFO:teuthology.orchestra.run.smithi089.stdout:(25/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86 474 kB/s | 2.2 MB 00:04 2024-09-16T16:44:14.524 INFO:teuthology.orchestra.run.smithi089.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 259 kB/s | 19 kB 00:00 2024-09-16T16:44:14.558 INFO:teuthology.orchestra.run.smithi089.stdout:(27/37): python3-logutils-0.3.5-21.el9.noarch.r 1.8 MB/s | 46 kB 00:00 2024-09-16T16:44:14.592 INFO:teuthology.orchestra.run.smithi089.stdout:(28/37): python3-more-itertools-8.12.0-2.el9.no 2.4 MB/s | 79 kB 00:00 2024-09-16T16:44:14.617 INFO:teuthology.orchestra.run.smithi089.stdout:(29/37): python3-jaraco-text-3.2.0-6.el9.noarch 167 kB/s | 20 kB 00:00 2024-09-16T16:44:14.643 INFO:teuthology.orchestra.run.smithi089.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 661 kB/s | 16 kB 00:00 2024-09-16T16:44:14.668 INFO:teuthology.orchestra.run.smithi089.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-16T16:44:14.693 INFO:teuthology.orchestra.run.smithi089.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-16T16:44:14.719 INFO:teuthology.orchestra.run.smithi089.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-09-16T16:44:14.744 INFO:teuthology.orchestra.run.smithi089.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-16T16:44:14.769 INFO:teuthology.orchestra.run.smithi089.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 806 kB/s | 20 kB 00:00 2024-09-16T16:44:14.794 INFO:teuthology.orchestra.run.smithi089.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-16T16:44:38.497 INFO:teuthology.orchestra.run.smithi177.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 2.2 MB/s | 70 MB 00:31 2024-09-16T16:44:38.502 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:38.502 INFO:teuthology.orchestra.run.smithi177.stdout:Total 2.5 MB/s | 84 MB 00:33 2024-09-16T16:44:38.646 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:44:38.687 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:44:38.687 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:44:39.494 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:44:39.495 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:44:41.138 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:44:41.208 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T16:44:41.240 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T16:44:41.276 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T16:44:41.356 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T16:44:41.401 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T16:44:41.433 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T16:44:41.525 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T16:44:41.620 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T16:44:41.660 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T16:44:41.696 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T16:44:41.726 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T16:44:41.760 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T16:44:41.802 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T16:44:41.843 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T16:44:41.877 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T16:44:41.912 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T16:44:41.960 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T16:44:41.992 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T16:44:42.065 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T16:44:42.204 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T16:44:42.284 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T16:44:42.337 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T16:44:42.383 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T16:44:42.441 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T16:44:42.496 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T16:44:42.690 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T16:44:42.737 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T16:44:42.815 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T16:44:42.904 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T16:44:42.951 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T16:44:43.089 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T16:44:43.282 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T16:44:43.314 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:44:43.339 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:44:43.339 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:43.339 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T16:44:43.339 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:44:43.340 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:44:43.340 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:44:46.499 INFO:teuthology.orchestra.run.smithi089.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 2.0 MB/s | 70 MB 00:35 2024-09-16T16:44:46.503 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:46.503 INFO:teuthology.orchestra.run.smithi089.stdout:Total 2.2 MB/s | 84 MB 00:37 2024-09-16T16:44:46.639 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:44:46.680 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:44:46.680 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:44:47.471 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:44:47.471 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:44:49.120 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:44:49.185 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T16:44:49.218 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T16:44:49.255 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T16:44:49.333 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T16:44:49.378 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T16:44:49.411 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T16:44:49.504 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T16:44:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T16:44:49.681 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T16:44:49.716 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T16:44:49.754 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T16:44:49.789 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T16:44:49.822 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T16:44:49.863 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T16:44:49.897 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T16:44:49.932 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T16:44:49.981 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T16:44:50.015 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T16:44:50.088 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T16:44:50.226 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T16:44:50.306 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T16:44:50.360 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T16:44:50.407 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T16:44:50.473 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T16:44:50.528 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T16:44:50.722 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T16:44:50.770 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T16:44:50.856 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T16:44:50.944 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T16:44:50.997 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T16:44:51.130 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T16:44:51.323 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T16:44:51.347 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:44:51.372 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:44:51.372 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:51.372 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T16:44:51.372 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:44:51.372 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:44:51.372 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:44:53.838 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:44:53.865 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:44:53.865 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:53.865 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T16:44:53.865 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:44:53.865 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:44:53.865 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:44:54.406 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:44:54.429 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:44:54.429 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:54.429 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T16:44:54.429 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:44:54.429 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:44:54.429 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:44:54.657 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:44:54.680 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:44:54.680 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:54.680 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T16:44:54.680 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:44:54.680 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:44:54.680 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:44:54.744 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:45:01.298 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:45:01.298 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T16:45:01.298 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T16:45:01.298 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T16:45:01.298 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T16:45:01.298 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T16:45:01.298 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T16:45:01.298 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T16:45:01.298 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T16:45:01.298 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T16:45:01.299 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T16:45:01.299 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T16:45:01.299 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T16:45:01.299 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T16:45:01.299 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T16:45:01.299 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T16:45:01.299 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T16:45:01.299 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T16:45:01.299 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T16:45:01.299 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T16:45:01.299 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T16:45:01.299 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T16:45:01.299 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T16:45:01.299 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T16:45:01.300 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T16:45:01.300 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T16:45:01.301 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T16:45:01.301 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T16:45:01.301 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T16:45:01.301 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T16:45:01.301 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T16:45:01.301 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T16:45:01.301 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T16:45:01.301 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T16:45:01.301 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T16:45:01.301 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T16:45:01.302 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T16:45:01.982 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:45:02.010 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:45:02.010 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:02.010 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T16:45:02.011 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:45:02.011 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:45:02.011 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:02.226 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T16:45:02.226 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:02.226 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:45:02.226 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:02.226 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:02.226 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:02.226 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:02.226 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:02.226 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:02.226 INFO:teuthology.orchestra.run.smithi177.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T16:45:02.227 INFO:teuthology.orchestra.run.smithi177.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T16:45:02.227 INFO:teuthology.orchestra.run.smithi177.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T16:45:02.227 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T16:45:02.227 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T16:45:02.227 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T16:45:02.227 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T16:45:02.227 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T16:45:02.227 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T16:45:02.227 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T16:45:02.227 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T16:45:02.227 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T16:45:02.227 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T16:45:02.227 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T16:45:02.227 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T16:45:02.227 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T16:45:02.228 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T16:45:02.228 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T16:45:02.228 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T16:45:02.228 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T16:45:02.228 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T16:45:02.228 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T16:45:02.228 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T16:45:02.228 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T16:45:02.228 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T16:45:02.228 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T16:45:02.228 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T16:45:02.228 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T16:45:02.228 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T16:45:02.228 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T16:45:02.229 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T16:45:02.229 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:02.229 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:02.566 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:45:02.589 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:45:02.589 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:02.589 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T16:45:02.589 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:45:02.589 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:45:02.590 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:02.633 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-base 2024-09-16T16:45:02.833 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:45:02.856 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:45:02.856 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:02.856 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T16:45:02.857 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:45:02.857 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:45:02.857 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:02.921 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:45:03.193 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:04:49 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:03.283 INFO:teuthology.orchestra.run.smithi177.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:03.324 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:03.325 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-09-16T16:45:03.326 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:03.394 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install cephadm 2024-09-16T16:45:03.953 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:04:49 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:04.086 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:04.086 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:04.087 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-09-16T16:45:04.087 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:04.087 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:45:04.087 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T16:45:04.087 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:04.087 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:45:04.087 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:04.087 INFO:teuthology.orchestra.run.smithi177.stdout:Install 1 Package 2024-09-16T16:45:04.087 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:04.088 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 785 k 2024-09-16T16:45:04.088 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 791 k 2024-09-16T16:45:04.088 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:45:04.414 INFO:teuthology.orchestra.run.smithi177.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 2.3 MB/s | 785 kB 00:00 2024-09-16T16:45:04.415 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:04.415 INFO:teuthology.orchestra.run.smithi177.stdout:Total 2.3 MB/s | 785 kB 00:00 2024-09-16T16:45:04.415 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:45:04.420 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:45:04.421 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:45:04.427 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:45:04.427 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:45:04.519 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:45:05.013 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:05.094 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:05.750 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:05.751 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:05.751 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:45:05.751 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:05.751 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:05.751 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:05.993 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T16:45:06.565 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:04:52 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:06.699 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:06.700 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:06.700 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repo Size 2024-09-16T16:45:06.700 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:06.700 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:45:06.700 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T16:45:06.700 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:06.700 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:45:06.700 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:06.700 INFO:teuthology.orchestra.run.smithi177.stdout:Install 1 Package 2024-09-16T16:45:06.700 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:06.700 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 158 k 2024-09-16T16:45:06.700 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 644 k 2024-09-16T16:45:06.700 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:45:06.906 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 770 kB/s | 158 kB 00:00 2024-09-16T16:45:06.906 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:06.907 INFO:teuthology.orchestra.run.smithi177.stdout:Total 763 kB/s | 158 kB 00:00 2024-09-16T16:45:06.907 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:45:06.916 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:45:06.916 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:45:06.974 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:45:06.974 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:45:07.124 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:45:07.207 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:45:07.232 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:45:07.232 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:07.232 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T16:45:07.232 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:08.182 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:45:08.182 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:08.183 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:45:08.183 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:08.183 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:08.183 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:08.451 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-mgr 2024-09-16T16:45:09.026 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:04:55 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:09.119 INFO:teuthology.orchestra.run.smithi177.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:09.160 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:09.161 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-09-16T16:45:09.161 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:09.238 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T16:45:09.800 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:04:55 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:09.910 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:45:09.910 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T16:45:09.910 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T16:45:09.911 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T16:45:09.911 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T16:45:09.911 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T16:45:09.911 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T16:45:09.911 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T16:45:09.911 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T16:45:09.911 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T16:45:09.911 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T16:45:09.911 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T16:45:09.911 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T16:45:09.911 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T16:45:09.911 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T16:45:09.911 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T16:45:09.911 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T16:45:09.912 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T16:45:09.912 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T16:45:09.912 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T16:45:09.912 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T16:45:09.912 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T16:45:09.912 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T16:45:09.912 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T16:45:09.912 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T16:45:09.912 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T16:45:09.913 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T16:45:09.914 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T16:45:09.914 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T16:45:09.914 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T16:45:09.914 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T16:45:09.914 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T16:45:09.914 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T16:45:09.914 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T16:45:09.914 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T16:45:09.914 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T16:45:09.914 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T16:45:09.933 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:09.935 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:09.935 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-09-16T16:45:09.935 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:09.935 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:45:09.935 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T16:45:09.935 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-09-16T16:45:09.935 INFO:teuthology.orchestra.run.smithi177.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T16:45:09.935 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T16:45:09.935 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T16:45:09.936 INFO:teuthology.orchestra.run.smithi177.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T16:45:09.936 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T16:45:09.936 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T16:45:09.936 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T16:45:09.936 INFO:teuthology.orchestra.run.smithi177.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T16:45:09.936 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T16:45:09.936 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T16:45:09.936 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:09.936 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:45:09.936 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:09.936 INFO:teuthology.orchestra.run.smithi177.stdout:Install 11 Packages 2024-09-16T16:45:09.937 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:09.937 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 18 M 2024-09-16T16:45:09.937 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 155 M 2024-09-16T16:45:09.937 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:45:10.193 INFO:teuthology.orchestra.run.smithi177.stdout:(1/11): ceph-prometheus-alerts-19.3.0-4879.g81f 106 kB/s | 16 kB 00:00 2024-09-16T16:45:10.218 INFO:teuthology.orchestra.run.smithi177.stdout:(2/11): ceph-grafana-dashboards-19.3.0-4879.g81 189 kB/s | 34 kB 00:00 2024-09-16T16:45:10.427 INFO:teuthology.orchestra.run.smithi177.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-09-16T16:45:10.502 INFO:teuthology.orchestra.run.smithi177.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 7.1 MB/s | 548 kB 00:00 2024-09-16T16:45:10.527 INFO:teuthology.orchestra.run.smithi177.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 787 kB/s | 19 kB 00:00 2024-09-16T16:45:10.636 INFO:teuthology.orchestra.run.smithi177.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 19 MB/s | 2.0 MB 00:00 2024-09-16T16:45:10.661 INFO:teuthology.orchestra.run.smithi177.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-16T16:45:10.695 INFO:teuthology.orchestra.run.smithi177.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 915 kB/s | 31 kB 00:00 2024-09-16T16:45:10.737 INFO:teuthology.orchestra.run.smithi177.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-16T16:45:10.879 INFO:teuthology.orchestra.run.smithi177.stdout:(10/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 17 MB/s | 14 MB 00:00 2024-09-16T16:45:10.915 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T16:45:10.915 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:10.915 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:45:10.915 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:10.915 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:10.915 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:10.915 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:10.915 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:10.915 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:10.915 INFO:teuthology.orchestra.run.smithi089.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T16:45:10.916 INFO:teuthology.orchestra.run.smithi089.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T16:45:10.916 INFO:teuthology.orchestra.run.smithi089.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T16:45:10.916 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T16:45:10.916 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T16:45:10.916 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T16:45:10.916 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T16:45:10.916 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T16:45:10.916 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T16:45:10.916 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T16:45:10.916 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T16:45:10.916 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T16:45:10.916 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T16:45:10.916 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T16:45:10.917 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T16:45:10.917 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T16:45:10.917 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T16:45:10.917 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T16:45:10.917 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T16:45:10.917 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T16:45:10.917 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T16:45:10.917 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T16:45:10.917 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T16:45:10.917 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T16:45:10.917 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T16:45:10.917 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T16:45:10.917 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T16:45:10.917 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T16:45:10.917 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T16:45:10.918 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T16:45:10.918 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T16:45:10.918 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:10.918 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:45:11.037 INFO:teuthology.orchestra.run.smithi177.stdout:(11/11): protobuf-compiler-3.14.0-13.el9.x86_64 1.0 MB/s | 863 kB 00:00 2024-09-16T16:45:11.040 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:11.040 INFO:teuthology.orchestra.run.smithi177.stdout:Total 17 MB/s | 18 MB 00:01 2024-09-16T16:45:11.070 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:45:11.088 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:45:11.088 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:45:11.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-base 2024-09-16T16:45:11.370 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:45:11.370 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:45:11.770 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:04:52 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:45:11.859 INFO:teuthology.orchestra.run.smithi089.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:11.901 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:45:11.902 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-16T16:45:11.902 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:45:11.917 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:45:11.986 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install cephadm 2024-09-16T16:45:12.010 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T16:45:12.041 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T16:45:12.132 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T16:45:12.256 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T16:45:12.309 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T16:45:12.392 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T16:45:12.445 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T16:45:12.474 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:45:12.506 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T16:45:12.562 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:04:53 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:45:12.706 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:45:12.707 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:12.707 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-16T16:45:12.707 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:12.707 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:45:12.707 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T16:45:12.708 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:12.708 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:45:12.708 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:12.708 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-16T16:45:12.708 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:12.708 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 785 k 2024-09-16T16:45:12.708 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 791 k 2024-09-16T16:45:12.708 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:45:13.267 INFO:teuthology.orchestra.run.smithi089.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 1.4 MB/s | 785 kB 00:00 2024-09-16T16:45:13.268 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:13.268 INFO:teuthology.orchestra.run.smithi089.stdout:Total 1.4 MB/s | 785 kB 00:00 2024-09-16T16:45:13.268 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:45:13.274 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:45:13.274 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:45:13.280 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:45:13.280 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:45:13.353 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:45:13.872 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:13.972 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:14.331 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:14.588 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:14.588 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:14.588 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:45:14.588 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:14.588 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:14.588 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:45:14.820 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T16:45:15.402 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:04:56 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:45:15.541 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:45:15.542 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:15.542 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-09-16T16:45:15.542 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:15.542 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:45:15.542 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T16:45:15.542 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:15.542 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:45:15.542 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:15.542 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-16T16:45:15.542 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:15.542 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 158 k 2024-09-16T16:45:15.543 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 644 k 2024-09-16T16:45:15.543 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:45:15.661 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T16:45:15.719 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:45:16.034 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 322 kB/s | 158 kB 00:00 2024-09-16T16:45:16.034 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:16.035 INFO:teuthology.orchestra.run.smithi089.stdout:Total 321 kB/s | 158 kB 00:00 2024-09-16T16:45:16.035 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:45:16.044 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:45:16.044 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:45:16.102 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:45:16.102 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:45:16.250 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:45:16.310 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:45:16.335 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:45:16.335 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:16.335 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T16:45:16.335 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:17.288 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:45:17.288 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:17.288 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:45:17.288 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:17.288 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:17.288 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:45:17.527 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr 2024-09-16T16:45:17.735 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:45:17.735 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T16:45:17.736 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T16:45:17.736 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T16:45:17.736 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T16:45:17.736 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T16:45:17.736 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T16:45:17.736 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T16:45:17.736 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:45:17.736 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T16:45:17.736 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T16:45:18.098 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T16:45:18.098 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:18.098 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:45:18.098 INFO:teuthology.orchestra.run.smithi177.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T16:45:18.098 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:18.098 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:18.098 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:18.098 INFO:teuthology.orchestra.run.smithi177.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T16:45:18.098 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T16:45:18.098 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T16:45:18.099 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T16:45:18.099 INFO:teuthology.orchestra.run.smithi177.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T16:45:18.099 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T16:45:18.099 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T16:45:18.099 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:18.099 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:18.102 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:04:59 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:45:18.194 INFO:teuthology.orchestra.run.smithi089.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:18.236 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:45:18.237 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-16T16:45:18.237 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:45:18.327 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T16:45:18.387 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T16:45:18.886 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:04:59 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:45:18.954 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:04 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:19.018 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:45:19.020 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:19.020 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-16T16:45:19.020 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:19.020 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:45:19.020 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T16:45:19.020 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-16T16:45:19.020 INFO:teuthology.orchestra.run.smithi089.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T16:45:19.020 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T16:45:19.020 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T16:45:19.020 INFO:teuthology.orchestra.run.smithi089.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T16:45:19.020 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T16:45:19.020 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T16:45:19.021 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T16:45:19.021 INFO:teuthology.orchestra.run.smithi089.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T16:45:19.021 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T16:45:19.021 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T16:45:19.021 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:19.021 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:45:19.021 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:19.021 INFO:teuthology.orchestra.run.smithi089.stdout:Install 11 Packages 2024-09-16T16:45:19.021 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:19.022 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 18 M 2024-09-16T16:45:19.022 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 155 M 2024-09-16T16:45:19.022 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:45:19.087 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:19.088 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================= 2024-09-16T16:45:19.089 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-09-16T16:45:19.089 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================= 2024-09-16T16:45:19.089 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:45:19.089 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T16:45:19.089 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-09-16T16:45:19.089 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T16:45:19.089 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T16:45:19.089 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T16:45:19.089 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T16:45:19.089 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T16:45:19.089 INFO:teuthology.orchestra.run.smithi177.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T16:45:19.089 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T16:45:19.089 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T16:45:19.089 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T16:45:19.090 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T16:45:19.090 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T16:45:19.090 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:19.090 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:45:19.090 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================= 2024-09-16T16:45:19.090 INFO:teuthology.orchestra.run.smithi177.stdout:Install 12 Packages 2024-09-16T16:45:19.090 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:19.091 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 38 M 2024-09-16T16:45:19.091 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 212 M 2024-09-16T16:45:19.091 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:45:19.606 INFO:teuthology.orchestra.run.smithi089.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4879.g81 114 kB/s | 34 kB 00:00 2024-09-16T16:45:19.609 INFO:teuthology.orchestra.run.smithi177.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 887 kB/s | 191 kB 00:00 2024-09-16T16:45:19.631 INFO:teuthology.orchestra.run.smithi089.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4879.g81f 51 kB/s | 16 kB 00:00 2024-09-16T16:45:19.660 INFO:teuthology.orchestra.run.smithi177.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-16T16:45:19.765 INFO:teuthology.orchestra.run.smithi089.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.7 MB/s | 269 kB 00:00 2024-09-16T16:45:19.823 INFO:teuthology.orchestra.run.smithi089.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-16T16:45:19.849 INFO:teuthology.orchestra.run.smithi089.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 773 kB/s | 19 kB 00:00 2024-09-16T16:45:19.882 INFO:teuthology.orchestra.run.smithi089.stdout:(6/11): protobuf-compiler-3.14.0-13.el9.x86_64. 3.4 MB/s | 863 kB 00:00 2024-09-16T16:45:19.941 INFO:teuthology.orchestra.run.smithi089.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.4 MB/s | 144 kB 00:00 2024-09-16T16:45:19.966 INFO:teuthology.orchestra.run.smithi089.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-16T16:45:20.008 INFO:teuthology.orchestra.run.smithi089.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-16T16:45:20.059 INFO:teuthology.orchestra.run.smithi089.stdout:(10/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 9.7 MB/s | 2.0 MB 00:00 2024-09-16T16:45:20.152 INFO:teuthology.orchestra.run.smithi177.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 60 kB/s | 33 kB 00:00 2024-09-16T16:45:20.627 INFO:teuthology.orchestra.run.smithi177.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 38 kB/s | 18 kB 00:00 2024-09-16T16:45:20.719 INFO:teuthology.orchestra.run.smithi177.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.8 MB/s | 3.0 MB 00:01 2024-09-16T16:45:21.220 INFO:teuthology.orchestra.run.smithi177.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 65 kB/s | 38 kB 00:00 2024-09-16T16:45:21.361 INFO:teuthology.orchestra.run.smithi177.stdout:(7/12): ceph-mgr-diskprediction-local-19.3.0-48 3.8 MB/s | 7.4 MB 00:01 2024-09-16T16:45:21.384 INFO:teuthology.orchestra.run.smithi089.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 6.8 MB/s | 14 MB 00:02 2024-09-16T16:45:21.388 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:21.388 INFO:teuthology.orchestra.run.smithi089.stdout:Total 7.7 MB/s | 18 MB 00:02 2024-09-16T16:45:21.419 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:45:21.438 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:45:21.438 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:45:21.698 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:45:21.698 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:45:22.120 INFO:teuthology.orchestra.run.smithi177.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 272 kB/s | 245 kB 00:00 2024-09-16T16:45:22.247 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:45:22.323 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T16:45:22.354 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T16:45:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T16:45:22.495 INFO:teuthology.orchestra.run.smithi177.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 2.8 MB/s | 4.9 MB 00:01 2024-09-16T16:45:22.571 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T16:45:22.616 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T16:45:22.700 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T16:45:22.744 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T16:45:22.772 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:45:22.805 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T16:45:22.887 INFO:teuthology.orchestra.run.smithi177.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 327 kB/s | 250 kB 00:00 2024-09-16T16:45:22.962 INFO:teuthology.orchestra.run.smithi177.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.2 MB/s | 5.1 MB 00:01 2024-09-16T16:45:23.937 INFO:teuthology.orchestra.run.smithi177.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-16T16:45:23.939 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:23.939 INFO:teuthology.orchestra.run.smithi177.stdout:Total 7.9 MB/s | 38 MB 00:04 2024-09-16T16:45:24.295 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:45:24.321 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:45:24.321 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:45:24.762 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:45:24.762 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:45:25.532 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:45:25.606 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T16:45:25.644 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:45:25.744 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:45:25.778 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T16:45:25.961 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T16:45:25.979 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T16:45:25.985 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T16:45:26.052 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:45:26.070 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T16:45:26.729 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T16:45:26.840 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T16:45:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:45:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T16:45:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T16:45:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T16:45:28.005 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T16:45:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T16:45:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T16:45:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T16:45:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:45:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T16:45:28.006 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T16:45:28.065 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:45:28.337 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T16:45:28.337 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:28.338 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:45:28.338 INFO:teuthology.orchestra.run.smithi089.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T16:45:28.338 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:28.338 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:28.338 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:28.338 INFO:teuthology.orchestra.run.smithi089.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T16:45:28.338 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T16:45:28.338 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T16:45:28.338 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T16:45:28.338 INFO:teuthology.orchestra.run.smithi089.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T16:45:28.338 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T16:45:28.338 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T16:45:28.338 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:28.339 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:45:28.629 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T16:45:29.093 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T16:45:29.117 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:45:29.190 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:10 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:45:29.323 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:45:29.324 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-09-16T16:45:29.324 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-16T16:45:29.324 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-09-16T16:45:29.324 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:45:29.324 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T16:45:29.325 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-16T16:45:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T16:45:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T16:45:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T16:45:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T16:45:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T16:45:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T16:45:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T16:45:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T16:45:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T16:45:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T16:45:29.325 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T16:45:29.326 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:29.326 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:45:29.326 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-09-16T16:45:29.326 INFO:teuthology.orchestra.run.smithi089.stdout:Install 12 Packages 2024-09-16T16:45:29.326 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:29.326 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 38 M 2024-09-16T16:45:29.326 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 212 M 2024-09-16T16:45:29.326 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:45:29.785 INFO:teuthology.orchestra.run.smithi089.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-16T16:45:29.811 INFO:teuthology.orchestra.run.smithi089.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.9 MB/s | 801 kB 00:00 2024-09-16T16:45:30.069 INFO:teuthology.orchestra.run.smithi089.stdout:(3/12): ceph-mgr-diskprediction-local-19.3.0-48 16 MB/s | 7.4 MB 00:00 2024-09-16T16:45:30.111 INFO:teuthology.orchestra.run.smithi089.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 100 kB/s | 33 kB 00:00 2024-09-16T16:45:30.312 INFO:teuthology.orchestra.run.smithi089.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 192 kB/s | 38 kB 00:00 2024-09-16T16:45:30.370 INFO:teuthology.orchestra.run.smithi089.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 61 kB/s | 18 kB 00:00 2024-09-16T16:45:30.846 INFO:teuthology.orchestra.run.smithi089.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 515 kB/s | 245 kB 00:00 2024-09-16T16:45:31.138 INFO:teuthology.orchestra.run.smithi089.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.3 MB/s | 3.0 MB 00:01 2024-09-16T16:45:31.255 INFO:teuthology.orchestra.run.smithi089.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-09-16T16:45:31.785 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:45:31.785 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T16:45:31.785 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:45:31.785 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:45:31.785 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T16:45:31.785 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T16:45:31.785 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T16:45:31.785 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T16:45:31.785 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T16:45:31.785 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T16:45:31.785 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:45:31.785 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T16:45:32.138 INFO:teuthology.orchestra.run.smithi089.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.7 MB/s | 4.9 MB 00:01 2024-09-16T16:45:32.204 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T16:45:32.204 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:32.205 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:45:32.205 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:32.205 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T16:45:32.205 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T16:45:32.205 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T16:45:32.205 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T16:45:32.205 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T16:45:32.205 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T16:45:32.205 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T16:45:32.205 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T16:45:32.205 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T16:45:32.205 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T16:45:32.206 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T16:45:32.206 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:32.206 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:32.645 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-mgr-rook 2024-09-16T16:45:33.097 INFO:teuthology.orchestra.run.smithi089.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.3 MB/s | 5.1 MB 00:02 2024-09-16T16:45:33.226 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:19 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:33.360 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:33.362 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:33.362 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-09-16T16:45:33.362 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:33.362 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:45:33.362 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T16:45:33.362 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-09-16T16:45:33.362 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T16:45:33.362 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T16:45:33.362 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T16:45:33.362 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T16:45:33.362 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T16:45:33.362 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T16:45:33.362 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T16:45:33.363 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T16:45:33.363 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T16:45:33.363 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T16:45:33.363 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T16:45:33.363 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T16:45:33.363 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:33.363 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:45:33.363 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:33.363 INFO:teuthology.orchestra.run.smithi177.stdout:Install 13 Packages 2024-09-16T16:45:33.363 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:33.364 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 2.2 M 2024-09-16T16:45:33.364 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 26 M 2024-09-16T16:45:33.364 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:45:33.805 INFO:teuthology.orchestra.run.smithi089.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.4 MB/s | 16 MB 00:02 2024-09-16T16:45:33.806 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:33.807 INFO:teuthology.orchestra.run.smithi089.stdout:Total 8.5 MB/s | 38 MB 00:04 2024-09-16T16:45:34.001 INFO:teuthology.orchestra.run.smithi177.stdout:(1/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 291 kB/s | 49 kB 00:00 2024-09-16T16:45:34.165 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:45:34.191 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:45:34.191 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:45:34.351 INFO:teuthology.orchestra.run.smithi177.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 37 kB/s | 19 kB 00:00 2024-09-16T16:45:34.393 INFO:teuthology.orchestra.run.smithi177.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 46 kB/s | 26 kB 00:00 2024-09-16T16:45:34.622 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:45:34.622 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:45:34.752 INFO:teuthology.orchestra.run.smithi177.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 296 kB/s | 222 kB 00:00 2024-09-16T16:45:35.052 INFO:teuthology.orchestra.run.smithi177.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 227 kB/s | 159 kB 00:00 2024-09-16T16:45:35.102 INFO:teuthology.orchestra.run.smithi177.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 650 kB/s | 32 kB 00:00 2024-09-16T16:45:35.128 INFO:teuthology.orchestra.run.smithi177.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 565 kB/s | 14 kB 00:00 2024-09-16T16:45:35.170 INFO:teuthology.orchestra.run.smithi177.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 5.2 MB/s | 220 kB 00:00 2024-09-16T16:45:35.195 INFO:teuthology.orchestra.run.smithi177.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 348 kB/s | 279 kB 00:00 2024-09-16T16:45:35.245 INFO:teuthology.orchestra.run.smithi177.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-16T16:45:35.279 INFO:teuthology.orchestra.run.smithi177.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 9.4 MB/s | 1.0 MB 00:00 2024-09-16T16:45:35.304 INFO:teuthology.orchestra.run.smithi177.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-09-16T16:45:35.371 INFO:teuthology.orchestra.run.smithi177.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 87 kB/s | 54 kB 00:00 2024-09-16T16:45:35.375 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:35.375 INFO:teuthology.orchestra.run.smithi177.stdout:Total 1.1 MB/s | 2.2 MB 00:02 2024-09-16T16:45:35.394 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:45:35.446 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:45:35.458 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T16:45:35.462 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:45:35.462 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:45:35.495 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:45:35.551 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:45:35.551 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:45:35.595 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:45:35.638 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T16:45:35.822 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T16:45:35.854 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T16:45:35.930 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T16:45:36.060 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:45:36.227 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T16:45:36.280 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T16:45:36.336 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T16:45:36.373 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T16:45:36.414 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T16:45:36.542 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T16:45:36.601 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T16:45:36.643 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T16:45:36.699 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T16:45:36.718 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T16:45:37.410 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T16:45:37.454 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T16:45:37.488 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T16:45:37.536 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T16:45:37.558 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:45:37.953 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:45:38.375 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:45:38.375 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T16:45:38.375 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T16:45:38.375 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T16:45:38.375 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T16:45:38.375 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T16:45:38.376 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T16:45:38.376 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T16:45:38.376 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T16:45:38.376 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T16:45:38.376 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T16:45:38.376 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T16:45:38.376 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T16:45:38.702 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T16:45:38.703 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:38.703 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:45:38.703 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:38.703 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T16:45:38.703 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T16:45:38.703 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T16:45:38.703 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T16:45:38.703 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T16:45:38.703 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T16:45:38.703 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T16:45:38.703 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T16:45:38.703 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T16:45:38.703 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T16:45:38.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T16:45:38.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T16:45:38.704 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:38.704 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:38.984 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T16:45:39.003 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T16:45:39.015 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:45:39.576 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:25 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:39.709 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:39.710 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:39.710 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-09-16T16:45:39.710 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:39.710 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:45:39.710 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T16:45:39.710 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-09-16T16:45:39.710 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T16:45:39.710 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T16:45:39.710 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T16:45:39.710 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T16:45:39.711 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T16:45:39.711 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:39.711 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:45:39.711 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:39.711 INFO:teuthology.orchestra.run.smithi177.stdout:Install 6 Packages 2024-09-16T16:45:39.711 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:39.711 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 7.0 M 2024-09-16T16:45:39.711 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 33 M 2024-09-16T16:45:39.712 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:45:40.105 INFO:teuthology.orchestra.run.smithi177.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 775 kB/s | 154 kB 00:00 2024-09-16T16:45:40.139 INFO:teuthology.orchestra.run.smithi177.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-09-16T16:45:40.197 INFO:teuthology.orchestra.run.smithi177.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 990 kB/s | 58 kB 00:00 2024-09-16T16:45:40.231 INFO:teuthology.orchestra.run.smithi177.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.3 MB/s | 548 kB 00:00 2024-09-16T16:45:40.256 INFO:teuthology.orchestra.run.smithi177.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.2 MB/s | 74 kB 00:00 2024-09-16T16:45:41.465 INFO:teuthology.orchestra.run.smithi177.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.8 MB/s | 6.0 MB 00:01 2024-09-16T16:45:41.467 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:41.467 INFO:teuthology.orchestra.run.smithi177.stdout:Total 4.0 MB/s | 7.0 MB 00:01 2024-09-16T16:45:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:45:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T16:45:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:45:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:45:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T16:45:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T16:45:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T16:45:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T16:45:41.539 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T16:45:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T16:45:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:45:41.540 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T16:45:41.540 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:45:41.551 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:45:41.551 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:45:41.652 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:45:41.652 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:45:41.972 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:45:42.011 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T16:45:42.012 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:42.012 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:45:42.012 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:42.012 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T16:45:42.012 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T16:45:42.012 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T16:45:42.012 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T16:45:42.012 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T16:45:42.012 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T16:45:42.012 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T16:45:42.012 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T16:45:42.012 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T16:45:42.012 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T16:45:42.013 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T16:45:42.013 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:42.013 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:45:42.148 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T16:45:42.208 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T16:45:42.471 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-rook 2024-09-16T16:45:42.720 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T16:45:42.810 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T16:45:42.878 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T16:45:42.904 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:45:43.050 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:24 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:45:43.184 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:45:43.185 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:43.185 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-16T16:45:43.185 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:43.185 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:45:43.185 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T16:45:43.185 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-16T16:45:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T16:45:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T16:45:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T16:45:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T16:45:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T16:45:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T16:45:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T16:45:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T16:45:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T16:45:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T16:45:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T16:45:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T16:45:43.186 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:43.187 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:45:43.187 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:43.187 INFO:teuthology.orchestra.run.smithi089.stdout:Install 13 Packages 2024-09-16T16:45:43.187 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:43.187 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 2.2 M 2024-09-16T16:45:43.187 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 26 M 2024-09-16T16:45:43.188 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:45:43.541 INFO:teuthology.orchestra.run.smithi089.stdout:(1/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 330 kB/s | 49 kB 00:00 2024-09-16T16:45:43.675 INFO:teuthology.orchestra.run.smithi089.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 91 kB/s | 26 kB 00:00 2024-09-16T16:45:43.692 INFO:teuthology.orchestra.run.smithi089.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 64 kB/s | 19 kB 00:00 2024-09-16T16:45:43.808 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:45:43.808 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T16:45:43.808 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T16:45:43.808 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T16:45:43.809 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T16:45:43.809 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T16:45:44.051 INFO:teuthology.orchestra.run.smithi089.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 423 kB/s | 159 kB 00:00 2024-09-16T16:45:44.083 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T16:45:44.083 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:44.083 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:45:44.083 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:44.084 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T16:45:44.084 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T16:45:44.084 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T16:45:44.084 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T16:45:44.084 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T16:45:44.084 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:44.084 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:44.159 INFO:teuthology.orchestra.run.smithi089.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 597 kB/s | 279 kB 00:00 2024-09-16T16:45:44.185 INFO:teuthology.orchestra.run.smithi089.stdout:(6/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 345 kB/s | 222 kB 00:00 2024-09-16T16:45:44.210 INFO:teuthology.orchestra.run.smithi089.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 337 kB/s | 54 kB 00:00 2024-09-16T16:45:44.252 INFO:teuthology.orchestra.run.smithi089.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 349 kB/s | 32 kB 00:00 2024-09-16T16:45:44.269 INFO:teuthology.orchestra.run.smithi089.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 242 kB/s | 14 kB 00:00 2024-09-16T16:45:44.303 INFO:teuthology.orchestra.run.smithi089.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-16T16:45:44.328 INFO:teuthology.orchestra.run.smithi089.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.8 MB/s | 220 kB 00:00 2024-09-16T16:45:44.347 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-fuse 2024-09-16T16:45:44.353 INFO:teuthology.orchestra.run.smithi089.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-16T16:45:44.403 INFO:teuthology.orchestra.run.smithi089.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-16T16:45:44.406 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:44.407 INFO:teuthology.orchestra.run.smithi089.stdout:Total 1.8 MB/s | 2.2 MB 00:01 2024-09-16T16:45:44.475 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:45:44.491 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:45:44.492 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:45:44.583 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:45:44.583 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:45:44.914 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:30 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:45.047 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:45.048 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:45.048 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-09-16T16:45:45.048 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:45.048 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:45:45.048 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T16:45:45.048 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-09-16T16:45:45.048 INFO:teuthology.orchestra.run.smithi177.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T16:45:45.048 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:45.048 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:45:45.048 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:45.048 INFO:teuthology.orchestra.run.smithi177.stdout:Install 2 Packages 2024-09-16T16:45:45.048 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:45.049 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 964 k 2024-09-16T16:45:45.049 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 4.1 M 2024-09-16T16:45:45.049 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:45:45.107 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:45:45.208 INFO:teuthology.orchestra.run.smithi177.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 600 kB/s | 80 kB 00:00 2024-09-16T16:45:45.278 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T16:45:45.346 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T16:45:45.391 INFO:teuthology.orchestra.run.smithi177.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 2.7 MB/s | 884 kB 00:00 2024-09-16T16:45:45.392 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:45.392 INFO:teuthology.orchestra.run.smithi177.stdout:Total 2.7 MB/s | 964 kB 00:00 2024-09-16T16:45:45.404 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:45:45.410 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T16:45:45.427 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:45:45.427 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:45:45.448 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T16:45:45.489 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T16:45:45.507 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:45:45.507 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:45:45.592 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T16:45:45.690 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:45:45.701 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T16:45:45.750 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T16:45:45.835 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T16:45:45.907 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:45:46.460 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T16:45:46.522 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T16:45:46.581 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T16:45:46.591 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:45:46.591 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T16:45:46.630 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T16:45:46.660 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:45:46.885 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T16:45:46.885 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:46.885 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:45:46.885 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T16:45:46.885 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:46.885 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:47.174 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-volume 2024-09-16T16:45:47.479 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:45:47.479 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T16:45:47.479 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T16:45:47.479 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T16:45:47.479 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T16:45:47.480 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T16:45:47.480 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T16:45:47.480 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T16:45:47.480 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T16:45:47.480 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T16:45:47.480 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T16:45:47.480 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T16:45:47.480 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T16:45:47.755 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:33 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:47.818 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T16:45:47.818 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:47.819 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:45:47.819 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:47.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T16:45:47.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T16:45:47.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T16:45:47.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T16:45:47.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T16:45:47.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T16:45:47.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T16:45:47.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T16:45:47.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T16:45:47.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T16:45:47.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T16:45:47.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T16:45:47.819 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:47.820 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:45:47.890 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:47.891 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:47.891 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-09-16T16:45:47.891 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:47.891 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:45:47.891 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T16:45:47.891 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:47.891 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:45:47.891 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:47.891 INFO:teuthology.orchestra.run.smithi177.stdout:Install 1 Package 2024-09-16T16:45:47.892 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:47.892 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 285 k 2024-09-16T16:45:47.892 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 1.3 M 2024-09-16T16:45:47.892 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:45:48.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T16:45:48.129 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-16T16:45:48.130 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:48.130 INFO:teuthology.orchestra.run.smithi177.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-16T16:45:48.130 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:45:48.139 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:45:48.139 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:45:48.168 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:45:48.168 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:45:48.400 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:45:48.481 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:48.498 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:48.498 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:48.498 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T16:45:48.498 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:48.676 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:29 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:45:48.810 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:45:48.810 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:48.810 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-16T16:45:48.810 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:48.810 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:45:48.810 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T16:45:48.810 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-16T16:45:48.811 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T16:45:48.811 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T16:45:48.811 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T16:45:48.811 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T16:45:48.811 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T16:45:48.811 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:48.811 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:45:48.811 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:48.811 INFO:teuthology.orchestra.run.smithi089.stdout:Install 6 Packages 2024-09-16T16:45:48.811 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:48.812 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 7.0 M 2024-09-16T16:45:48.812 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 33 M 2024-09-16T16:45:48.812 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:45:49.458 INFO:teuthology.orchestra.run.smithi089.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-16T16:45:49.483 INFO:teuthology.orchestra.run.smithi089.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 755 kB/s | 154 kB 00:00 2024-09-16T16:45:49.542 INFO:teuthology.orchestra.run.smithi089.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 991 kB/s | 58 kB 00:00 2024-09-16T16:45:49.550 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:49.551 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:45:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:49.551 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:49.575 INFO:teuthology.orchestra.run.smithi089.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-16T16:45:49.609 INFO:teuthology.orchestra.run.smithi089.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 3.6 MB/s | 548 kB 00:00 2024-09-16T16:45:49.701 INFO:teuthology.orchestra.run.smithi089.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-16T16:45:49.703 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:49.703 INFO:teuthology.orchestra.run.smithi089.stdout:Total 7.9 MB/s | 7.0 MB 00:00 2024-09-16T16:45:49.773 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:45:49.784 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:45:49.784 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:45:49.864 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install librados-devel 2024-09-16T16:45:49.884 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:45:49.884 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:45:50.185 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:45:50.353 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T16:45:50.411 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T16:45:50.445 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:36 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:50.586 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:50.587 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:50.587 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repo Size 2024-09-16T16:45:50.587 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:50.587 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:45:50.587 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T16:45:50.587 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:50.587 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:45:50.587 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:50.587 INFO:teuthology.orchestra.run.smithi177.stdout:Install 1 Package 2024-09-16T16:45:50.587 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:50.588 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 125 k 2024-09-16T16:45:50.588 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 445 k 2024-09-16T16:45:50.588 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:45:50.777 INFO:teuthology.orchestra.run.smithi177.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 660 kB/s | 125 kB 00:00 2024-09-16T16:45:50.778 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:50.778 INFO:teuthology.orchestra.run.smithi177.stdout:Total 654 kB/s | 125 kB 00:00 2024-09-16T16:45:50.778 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:45:50.784 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:45:50.784 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:45:50.847 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:45:50.847 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:45:50.941 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T16:45:51.015 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:45:51.039 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T16:45:51.107 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T16:45:51.116 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:51.132 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:45:51.553 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:51.825 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:51.825 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:51.825 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:45:51.825 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:51.825 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:51.825 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:51.912 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:45:51.912 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T16:45:51.912 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T16:45:51.912 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T16:45:51.912 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T16:45:51.913 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T16:45:52.045 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install libcephfs2 2024-09-16T16:45:52.190 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T16:45:52.191 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:52.191 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:45:52.191 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:52.191 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T16:45:52.191 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T16:45:52.191 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T16:45:52.191 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T16:45:52.191 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T16:45:52.191 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:52.191 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:45:52.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-fuse 2024-09-16T16:45:52.626 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:38 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:52.721 INFO:teuthology.orchestra.run.smithi177.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:52.766 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:52.767 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-09-16T16:45:52.767 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:52.844 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install libcephfs-devel 2024-09-16T16:45:53.040 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:34 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:45:53.173 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:45:53.174 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:53.174 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-16T16:45:53.174 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:53.174 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:45:53.174 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T16:45:53.174 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-16T16:45:53.174 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T16:45:53.174 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:53.174 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:45:53.175 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:53.175 INFO:teuthology.orchestra.run.smithi089.stdout:Install 2 Packages 2024-09-16T16:45:53.175 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:53.175 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 964 k 2024-09-16T16:45:53.175 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 4.1 M 2024-09-16T16:45:53.175 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:45:53.411 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:39 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:53.512 INFO:teuthology.orchestra.run.smithi089.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 384 kB/s | 80 kB 00:00 2024-09-16T16:45:53.544 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:53.544 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:53.544 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repo Size 2024-09-16T16:45:53.544 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:53.545 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:45:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T16:45:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:53.545 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:45:53.545 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:45:53.545 INFO:teuthology.orchestra.run.smithi177.stdout:Install 1 Package 2024-09-16T16:45:53.545 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:53.545 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 32 k 2024-09-16T16:45:53.546 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 142 k 2024-09-16T16:45:53.546 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:45:53.579 INFO:teuthology.orchestra.run.smithi089.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 3.1 MB/s | 884 kB 00:00 2024-09-16T16:45:53.580 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:53.580 INFO:teuthology.orchestra.run.smithi089.stdout:Total 2.3 MB/s | 964 kB 00:00 2024-09-16T16:45:53.591 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:45:53.615 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:45:53.615 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:45:53.689 INFO:teuthology.orchestra.run.smithi177.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 222 kB/s | 32 kB 00:00 2024-09-16T16:45:53.689 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:53.690 INFO:teuthology.orchestra.run.smithi177.stdout:Total 219 kB/s | 32 kB 00:00 2024-09-16T16:45:53.690 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:45:53.693 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:45:53.694 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:45:53.696 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:45:53.696 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:45:53.724 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:45:53.724 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:45:53.811 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:45:53.886 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:45:53.919 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:54.032 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T16:45:54.103 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:45:54.326 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:54.565 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:54.565 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:54.565 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:45:54.565 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:54.565 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:45:54.565 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:54.772 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install librados2 2024-09-16T16:45:54.841 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:45:54.841 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T16:45:55.125 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T16:45:55.125 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:55.125 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:45:55.125 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T16:45:55.125 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:55.125 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:45:55.339 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:41 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:55.419 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-volume 2024-09-16T16:45:55.430 INFO:teuthology.orchestra.run.smithi177.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:55.473 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:55.474 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-09-16T16:45:55.474 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:55.559 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install librbd1 2024-09-16T16:45:55.996 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:36 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:45:56.122 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:42 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:56.135 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:45:56.135 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:56.136 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-16T16:45:56.136 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:56.136 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:45:56.136 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T16:45:56.136 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:56.136 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:45:56.136 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:56.136 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-16T16:45:56.136 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:56.137 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 285 k 2024-09-16T16:45:56.137 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 1.3 M 2024-09-16T16:45:56.137 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:45:56.213 INFO:teuthology.orchestra.run.smithi177.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:56.256 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:56.257 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-09-16T16:45:56.257 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:56.334 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install python3-rados 2024-09-16T16:45:56.369 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-16T16:45:56.370 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:56.371 INFO:teuthology.orchestra.run.smithi089.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-16T16:45:56.371 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:45:56.379 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:45:56.379 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:45:56.411 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:45:56.412 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:45:56.631 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:45:56.714 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:56.729 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:56.729 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:56.729 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T16:45:56.729 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:56.898 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:42 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:56.988 INFO:teuthology.orchestra.run.smithi177.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:57.031 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:57.032 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-09-16T16:45:57.032 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:57.108 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install python3-rgw 2024-09-16T16:45:57.675 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:43 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:57.767 INFO:teuthology.orchestra.run.smithi177.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:57.811 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:57.812 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-09-16T16:45:57.812 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:57.833 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:57.834 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:57.834 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:45:57.834 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:57.834 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:57.834 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:45:57.886 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install python3-cephfs 2024-09-16T16:45:58.140 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados-devel 2024-09-16T16:45:58.453 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:44 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:58.544 INFO:teuthology.orchestra.run.smithi177.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:58.588 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:58.589 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-09-16T16:45:58.589 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:58.669 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install python3-rbd 2024-09-16T16:45:58.721 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:39 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:45:58.859 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:45:58.860 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:58.860 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-09-16T16:45:58.860 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:58.860 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:45:58.860 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T16:45:58.860 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:58.860 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:45:58.860 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:45:58.860 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-16T16:45:58.860 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:45:58.861 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 125 k 2024-09-16T16:45:58.861 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 445 k 2024-09-16T16:45:58.861 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:45:59.186 INFO:teuthology.orchestra.run.smithi089.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 384 kB/s | 125 kB 00:00 2024-09-16T16:45:59.186 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:59.187 INFO:teuthology.orchestra.run.smithi089.stdout:Total 382 kB/s | 125 kB 00:00 2024-09-16T16:45:59.187 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:45:59.192 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:45:59.192 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:45:59.234 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:45 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:45:59.256 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:45:59.256 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:45:59.325 INFO:teuthology.orchestra.run.smithi177.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:59.383 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:45:59.384 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-09-16T16:45:59.385 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:45:59.413 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:45:59.460 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install rbd-fuse 2024-09-16T16:45:59.508 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:59.975 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:00.036 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:46 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:46:00.170 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:46:00.171 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:46:00.171 INFO:teuthology.orchestra.run.smithi177.stdout: Package Architecture Version Repository Size 2024-09-16T16:46:00.171 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:46:00.171 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:46:00.171 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T16:46:00.171 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:00.171 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:46:00.171 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:46:00.171 INFO:teuthology.orchestra.run.smithi177.stdout:Install 1 Package 2024-09-16T16:46:00.172 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:00.172 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 91 k 2024-09-16T16:46:00.172 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 321 k 2024-09-16T16:46:00.172 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:46:00.248 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:00.248 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:00.248 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:46:00.249 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:00.249 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:00.249 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:46:00.366 INFO:teuthology.orchestra.run.smithi177.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 467 kB/s | 91 kB 00:00 2024-09-16T16:46:00.367 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:00.367 INFO:teuthology.orchestra.run.smithi177.stdout:Total 464 kB/s | 91 kB 00:00 2024-09-16T16:46:00.367 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:46:00.376 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:46:00.376 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:46:00.440 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:46:00.440 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:46:00.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install libcephfs2 2024-09-16T16:46:00.591 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:46:00.688 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:01.097 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:42 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:46:01.103 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:01.189 INFO:teuthology.orchestra.run.smithi089.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:01.235 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:46:01.236 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-16T16:46:01.237 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:46:01.321 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install libcephfs-devel 2024-09-16T16:46:01.382 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:01.382 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:01.382 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:46:01.382 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:01.382 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:01.383 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:46:01.666 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install rbd-mirror 2024-09-16T16:46:01.886 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:42 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:46:02.018 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:46:02.019 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:46:02.019 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-09-16T16:46:02.019 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:46:02.019 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:46:02.020 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T16:46:02.020 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:02.020 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:46:02.020 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:46:02.020 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-16T16:46:02.020 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:02.020 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 32 k 2024-09-16T16:46:02.020 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 142 k 2024-09-16T16:46:02.020 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:46:02.167 INFO:teuthology.orchestra.run.smithi089.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 216 kB/s | 32 kB 00:00 2024-09-16T16:46:02.168 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:02.168 INFO:teuthology.orchestra.run.smithi089.stdout:Total 214 kB/s | 32 kB 00:00 2024-09-16T16:46:02.168 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:46:02.171 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:46:02.172 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:46:02.187 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:46:02.187 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:46:02.237 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:48 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:46:02.274 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:46:02.374 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:46:02.375 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:46:02.375 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repo Size 2024-09-16T16:46:02.375 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:46:02.375 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:46:02.375 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:46:02.376 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:02.376 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:46:02.376 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:46:02.376 INFO:teuthology.orchestra.run.smithi177.stdout:Install 1 Package 2024-09-16T16:46:02.376 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:02.376 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 3.5 M 2024-09-16T16:46:02.376 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 30 M 2024-09-16T16:46:02.376 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:46:02.389 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:02.703 INFO:teuthology.orchestra.run.smithi177.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 11 MB/s | 3.5 MB 00:00 2024-09-16T16:46:02.703 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:02.704 INFO:teuthology.orchestra.run.smithi177.stdout:Total 11 MB/s | 3.5 MB 00:00 2024-09-16T16:46:02.704 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:46:02.715 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:46:02.715 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:46:02.745 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:02.798 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:46:02.799 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:46:02.988 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:02.988 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:02.988 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:46:02.988 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:02.989 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:02.989 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:46:03.197 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados2 2024-09-16T16:46:03.387 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:46:03.453 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:03.479 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:03.479 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:46:03.479 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T16:46:03.479 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:46:03.479 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:46:03.479 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:03.756 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:44 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:46:03.844 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:03.887 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:46:03.888 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-16T16:46:03.888 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:46:03.977 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librbd1 2024-09-16T16:46:04.542 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:45 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:46:04.632 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:04.675 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:46:04.676 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-16T16:46:04.677 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:46:04.763 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rados 2024-09-16T16:46:04.847 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:04.848 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:04.848 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:46:04.848 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:04.848 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:04.848 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:46:05.132 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install rbd-nbd 2024-09-16T16:46:05.326 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:46 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:46:05.416 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:05.477 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:46:05.478 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-16T16:46:05.478 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:46:05.545 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rgw 2024-09-16T16:46:05.715 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:05:51 ago on Mon 16 Sep 2024 04:40:14 PM UTC. 2024-09-16T16:46:05.852 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-16T16:46:05.853 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:46:05.853 INFO:teuthology.orchestra.run.smithi177.stdout: Package Architecture Version Repository Size 2024-09-16T16:46:05.853 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:46:05.853 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-16T16:46:05.853 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T16:46:05.853 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:05.853 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-16T16:46:05.853 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-09-16T16:46:05.853 INFO:teuthology.orchestra.run.smithi177.stdout:Install 1 Package 2024-09-16T16:46:05.853 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:05.854 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 177 k 2024-09-16T16:46:05.854 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 685 k 2024-09-16T16:46:05.854 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-16T16:46:06.065 INFO:teuthology.orchestra.run.smithi177.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 837 kB/s | 177 kB 00:00 2024-09-16T16:46:06.065 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:06.066 INFO:teuthology.orchestra.run.smithi177.stdout:Total 831 kB/s | 177 kB 00:00 2024-09-16T16:46:06.066 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-16T16:46:06.076 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-16T16:46:06.076 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-16T16:46:06.110 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:47 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:46:06.146 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-16T16:46:06.147 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-16T16:46:06.199 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:06.242 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:46:06.243 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-16T16:46:06.243 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:46:06.315 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-16T16:46:06.354 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-cephfs 2024-09-16T16:46:06.413 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:06.854 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:06.918 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:47 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:46:07.008 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:07.052 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:46:07.053 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-16T16:46:07.053 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:46:07.135 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rbd 2024-09-16T16:46:07.140 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:07.140 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:07.140 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-16T16:46:07.140 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:07.141 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:07.141 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-16T16:46:07.414 DEBUG:teuthology.parallel:result is None 2024-09-16T16:46:07.719 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:48 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:46:07.808 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:07.852 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:46:07.853 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-16T16:46:07.853 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:46:07.942 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-fuse 2024-09-16T16:46:08.501 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:49 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:46:08.633 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:46:08.634 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:46:08.634 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-09-16T16:46:08.634 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:46:08.634 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:46:08.634 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T16:46:08.634 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:08.634 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:46:08.634 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:46:08.634 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-16T16:46:08.634 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:08.635 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 91 k 2024-09-16T16:46:08.635 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 321 k 2024-09-16T16:46:08.635 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:46:08.838 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 447 kB/s | 91 kB 00:00 2024-09-16T16:46:08.838 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:08.839 INFO:teuthology.orchestra.run.smithi089.stdout:Total 444 kB/s | 91 kB 00:00 2024-09-16T16:46:08.839 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:46:08.847 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:46:08.847 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:46:08.910 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:46:08.911 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:46:09.061 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:46:09.160 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:09.575 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:09.855 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:09.855 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:09.855 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:46:09.855 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:09.855 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:09.855 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:46:10.156 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-mirror 2024-09-16T16:46:10.730 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:51 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:46:10.865 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:46:10.865 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:46:10.866 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-09-16T16:46:10.866 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:46:10.866 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:46:10.866 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:46:10.866 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:10.866 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:46:10.866 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:46:10.866 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-16T16:46:10.866 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:10.866 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 3.5 M 2024-09-16T16:46:10.866 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 30 M 2024-09-16T16:46:10.866 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:46:11.643 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 4.5 MB/s | 3.5 MB 00:00 2024-09-16T16:46:11.644 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:11.644 INFO:teuthology.orchestra.run.smithi089.stdout:Total 4.5 MB/s | 3.5 MB 00:00 2024-09-16T16:46:11.644 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:46:11.656 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:46:11.656 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:46:11.741 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:46:11.741 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:46:12.336 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:46:12.402 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:12.427 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:12.428 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:46:12.428 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T16:46:12.428 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:46:12.428 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:46:12.428 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:13.754 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:46:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:13.754 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:13.754 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:46:14.023 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-nbd 2024-09-16T16:46:14.601 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:05:55 ago on Mon 16 Sep 2024 04:40:19 PM UTC. 2024-09-16T16:46:14.738 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-16T16:46:14.739 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:46:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-09-16T16:46:14.739 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:46:14.739 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-16T16:46:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T16:46:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:14.739 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-16T16:46:14.739 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-16T16:46:14.739 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-16T16:46:14.739 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:14.739 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 177 k 2024-09-16T16:46:14.740 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 685 k 2024-09-16T16:46:14.740 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-16T16:46:14.958 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 809 kB/s | 177 kB 00:00 2024-09-16T16:46:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:Total 804 kB/s | 177 kB 00:00 2024-09-16T16:46:14.959 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-16T16:46:14.969 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-16T16:46:14.969 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-16T16:46:15.039 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-16T16:46:15.040 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-16T16:46:15.214 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-16T16:46:15.323 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:15.795 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:16.073 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:16.073 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:16.074 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-16T16:46:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:16.074 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:16.074 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-16T16:46:16.345 DEBUG:teuthology.parallel:result is None 2024-09-16T16:46:16.345 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:46:16.491 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T16:46:16.512 INFO:teuthology.orchestra.run.smithi089.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T16:46:16.513 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T16:46:16.513 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T16:46:16.515 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:46:16.653 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T16:46:16.679 INFO:teuthology.orchestra.run.smithi177.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T16:46:16.680 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T16:46:16.680 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T16:46:16.681 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T16:46:16.682 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:46:16.682 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T16:46:16.709 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T16:46:16.709 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T16:46:16.751 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T16:46:16.751 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:46:16.751 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T16:46:16.777 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T16:46:16.842 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T16:46:16.843 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T16:46:16.872 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T16:46:16.941 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T16:46:16.941 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:46:16.941 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T16:46:16.966 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T16:46:17.030 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T16:46:17.030 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T16:46:17.059 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T16:46:17.126 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T16:46:17.126 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:46:17.126 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T16:46:17.156 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T16:46:17.221 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T16:46:17.222 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T16:46:17.246 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T16:46:17.313 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T16:46:17.394 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T16:46:17.394 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2024-09-16T16:46:17.397 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /var/log/ceph 2024-09-16T16:46:17.421 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T16:46:17.421 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T16:46:17.462 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T16:46:17.489 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T16:46:17.489 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T16:46:17.528 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T16:46:17.562 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T16:46:17.562 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T16:46:17.562 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907388', 'branch': 'wip-matanb-crimson-testing-59543', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rados_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7907388', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6678, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIdNLTd28hEG/QwsOlKRvZH2mgwiULSIyynk9wzNPRw0uXQ+a05FKd002+17mMsTwFMMFH4b+9HAJ2jAnGDXzHI=', 'smithi177.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPUzF0urtdmfMqsYl23nxr57qToSKDh6A9uwQ9QSp3wt5Z3FkpLk7ipknohPTYNMX7m6h/3ikcQGoBrGlsP9kCQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh --crimson', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-16_16:23:48', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T16:46:17.562 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T16:46:17.593 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T16:46:17.610 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T16:46:17.648 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T16:46:17.677 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:46:17.677 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T16:46:17.725 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T16:46:17.726 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2024-09-16T16:46:17.781 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T16:46:17.781 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:17.781 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-16T16:46:17.781 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:17.781 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:17.781 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-16 16:46:12.678699971 +0000 2024-09-16T16:46:17.781 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-16 16:39:34.436367509 +0000 2024-09-16T16:46:17.782 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-16 16:39:34.436367509 +0000 2024-09-16T16:46:17.782 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-16 16:39:34.436367509 +0000 2024-09-16T16:46:17.782 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T16:46:17.844 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-16T16:46:17.844 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-16T16:46:17.844 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000236563 s, 2.2 MB/s 2024-09-16T16:46:17.845 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T16:46:17.904 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2024-09-16T16:46:17.959 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T16:46:17.959 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:17.959 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-16T16:46:17.959 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:17.959 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:17.960 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-16 16:46:12.679699948 +0000 2024-09-16T16:46:17.960 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-16 16:39:34.777359691 +0000 2024-09-16T16:46:17.960 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-16 16:39:34.777359691 +0000 2024-09-16T16:46:17.960 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-16 16:39:34.777359691 +0000 2024-09-16T16:46:17.960 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T16:46:18.021 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-16T16:46:18.022 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-16T16:46:18.022 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000188595 s, 2.7 MB/s 2024-09-16T16:46:18.023 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T16:46:18.079 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2024-09-16T16:46:18.136 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T16:46:18.136 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:18.136 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-16T16:46:18.136 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:18.136 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:18.136 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-16 16:46:12.679699948 +0000 2024-09-16T16:46:18.136 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-16 16:39:35.128351644 +0000 2024-09-16T16:46:18.136 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-16 16:39:35.128351644 +0000 2024-09-16T16:46:18.137 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-16 16:39:35.128351644 +0000 2024-09-16T16:46:18.137 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T16:46:18.199 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-16T16:46:18.200 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-16T16:46:18.200 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.00024491 s, 2.1 MB/s 2024-09-16T16:46:18.201 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T16:46:18.257 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2024-09-16T16:46:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T16:46:18.312 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:18.313 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T16:46:18.313 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:18.313 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:18.313 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-16 16:46:12.680699924 +0000 2024-09-16T16:46:18.313 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-16 16:39:35.468343849 +0000 2024-09-16T16:46:18.313 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-16 16:39:35.468343849 +0000 2024-09-16T16:46:18.313 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-16 16:39:35.468343849 +0000 2024-09-16T16:46:18.313 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T16:46:18.375 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-16T16:46:18.375 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-16T16:46:18.376 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000186257 s, 2.7 MB/s 2024-09-16T16:46:18.377 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T16:46:18.433 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:18.433 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T16:46:18.433 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T16:46:18.450 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T16:46:18.450 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 2024-09-16T16:46:18.505 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T16:46:18.506 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:18.506 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-16T16:46:18.506 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:18.506 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:18.506 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-16 16:46:03.718259233 +0000 2024-09-16T16:46:18.506 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-16 16:39:33.321202883 +0000 2024-09-16T16:46:18.506 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-16 16:39:33.321202883 +0000 2024-09-16T16:46:18.506 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-09-16 16:39:33.321202883 +0000 2024-09-16T16:46:18.506 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T16:46:18.569 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-16T16:46:18.569 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-16T16:46:18.569 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000205441 s, 2.5 MB/s 2024-09-16T16:46:18.571 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T16:46:18.627 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 2024-09-16T16:46:18.683 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T16:46:18.683 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:18.683 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-16T16:46:18.683 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:18.683 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:18.683 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-16 16:46:03.719259205 +0000 2024-09-16T16:46:18.684 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-16 16:39:33.671192762 +0000 2024-09-16T16:46:18.684 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-16 16:39:33.671192762 +0000 2024-09-16T16:46:18.684 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-09-16 16:39:33.671192762 +0000 2024-09-16T16:46:18.684 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T16:46:18.746 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-16T16:46:18.746 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-16T16:46:18.746 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000252367 s, 2.0 MB/s 2024-09-16T16:46:18.748 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T16:46:18.804 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 2024-09-16T16:46:18.859 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T16:46:18.859 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:18.859 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-16T16:46:18.859 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:18.860 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:18.860 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-16 16:46:03.719259205 +0000 2024-09-16T16:46:18.860 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-16 16:39:34.022182611 +0000 2024-09-16T16:46:18.860 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-16 16:39:34.022182611 +0000 2024-09-16T16:46:18.860 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-09-16 16:39:34.022182611 +0000 2024-09-16T16:46:18.860 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T16:46:18.922 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-16T16:46:18.922 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-16T16:46:18.922 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.00018026 s, 2.8 MB/s 2024-09-16T16:46:18.923 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T16:46:18.979 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 2024-09-16T16:46:19.034 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T16:46:19.035 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:19.035 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-16T16:46:19.035 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:19.035 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:19.035 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-16 16:46:03.719259205 +0000 2024-09-16T16:46:19.035 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-16 16:39:34.340173414 +0000 2024-09-16T16:46:19.035 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-16 16:39:34.340173414 +0000 2024-09-16T16:46:19.035 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-09-16 16:39:34.340173414 +0000 2024-09-16T16:46:19.035 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T16:46:19.098 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-16T16:46:19.098 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-16T16:46:19.098 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000191174 s, 2.7 MB/s 2024-09-16T16:46:19.100 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T16:46:19.156 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:19.156 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-16T16:46:19.156 INFO:tasks.ceph:Generating config... 2024-09-16T16:46:19.158 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-16T16:46:19.158 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-16T16:46:19.158 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-16T16:46:19.158 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-16T16:46:19.158 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-16T16:46:19.158 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T16:46:19.158 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T16:46:19.158 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T16:46:19.158 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-16T16:46:19.159 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-16T16:46:19.159 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-16T16:46:19.159 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-16T16:46:19.159 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-16T16:46:19.159 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T16:46:19.159 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T16:46:19.159 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-16T16:46:19.159 INFO:tasks.ceph:[osd] osd class default list = * 2024-09-16T16:46:19.159 INFO:tasks.ceph:[osd] osd class load list = * 2024-09-16T16:46:19.159 INFO:tasks.ceph:[osd] osd objectstore = seastore 2024-09-16T16:46:19.159 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-16T16:46:19.159 INFO:tasks.ceph:[client] debug ms = 1 2024-09-16T16:46:19.159 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-16T16:46:19.159 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-16T16:46:19.160 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-16T16:46:19.160 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-16T16:46:19.160 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-16T16:46:19.160 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-16T16:46:19.160 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-16T16:46:19.160 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T16:46:19.160 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T16:46:19.160 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-16T16:46:19.160 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-16T16:46:19.160 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-16T16:46:19.160 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-16T16:46:19.160 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-16T16:46:19.161 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T16:46:19.161 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T16:46:19.223 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T16:46:19.227 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T16:46:19.282 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T16:46:19.307 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.89')] 2024-09-16T16:46:19.307 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.89', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-16T16:46:19.308 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:46:19.308 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T16:46:19.363 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.89 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:19.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:19.455+0000 7f5d3ecd4f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:19.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:19.455+0000 7f5d3ecd4f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:19.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:19.455+0000 7f5d3ecd4f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:19.456 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:19.457 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: generated fsid 747238a8-71dc-4442-98b8-945fe8c55201 2024-09-16T16:46:19.457 INFO:teuthology.orchestra.run.smithi089.stdout:setting min_mon_release = quincy 2024-09-16T16:46:19.457 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 0 2024-09-16T16:46:19.457 INFO:teuthology.orchestra.run.smithi089.stdout:fsid 747238a8-71dc-4442-98b8-945fe8c55201 2024-09-16T16:46:19.457 INFO:teuthology.orchestra.run.smithi089.stdout:last_changed 2024-09-16T16:46:19.457272+0000 2024-09-16T16:46:19.457 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-16T16:46:19.457272+0000 2024-09-16T16:46:19.457 INFO:teuthology.orchestra.run.smithi089.stdout:min_mon_release 17 (quincy) 2024-09-16T16:46:19.457 INFO:teuthology.orchestra.run.smithi089.stdout:election_strategy: 1 2024-09-16T16:46:19.457 INFO:teuthology.orchestra.run.smithi089.stdout:0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-16T16:46:19.457 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-16T16:46:19.458 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T16:46:19.473 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 747238a8-71dc-4442-98b8-945fe8c55201... 2024-09-16T16:46:19.474 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T16:46:19.516 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T16:46:19.555 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2024-09-16T16:46:19.556 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2024-09-16T16:46:19.556 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T16:46:19.556 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2024-09-16T16:46:19.556 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.556 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2024-09-16T16:46:19.556 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.556 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2024-09-16T16:46:19.556 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.556 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2024-09-16T16:46:19.556 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2024-09-16T16:46:19.556 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.556 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2024-09-16T16:46:19.557 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2024-09-16T16:46:19.557 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.557 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T16:46:19.557 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2024-09-16T16:46:19.557 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.557 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T16:46:19.557 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T16:46:19.557 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.557 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2024-09-16T16:46:19.557 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.557 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2024-09-16T16:46:19.557 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2024-09-16T16:46:19.558 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2024-09-16T16:46:19.558 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2024-09-16T16:46:19.558 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2024-09-16T16:46:19.558 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2024-09-16T16:46:19.558 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2024-09-16T16:46:19.558 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T16:46:19.558 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T16:46:19.558 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2024-09-16T16:46:19.558 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.558 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T16:46:19.558 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.559 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2024-09-16T16:46:19.559 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.559 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2024-09-16T16:46:19.559 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.559 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2024-09-16T16:46:19.559 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2024-09-16T16:46:19.559 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2024-09-16T16:46:19.559 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = 172.21.15.89 2024-09-16T16:46:19.559 INFO:teuthology.orchestra.run.smithi089.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T16:46:19.559 INFO:teuthology.orchestra.run.smithi089.stdout: ms client mode = crc 2024-09-16T16:46:19.559 INFO:teuthology.orchestra.run.smithi089.stdout: ms cluster mode = crc 2024-09-16T16:46:19.559 INFO:teuthology.orchestra.run.smithi089.stdout: ms mon client mode = crc 2024-09-16T16:46:19.560 INFO:teuthology.orchestra.run.smithi089.stdout: ms mon cluster mode = crc 2024-09-16T16:46:19.560 INFO:teuthology.orchestra.run.smithi089.stdout: ms mon service mode = crc 2024-09-16T16:46:19.560 INFO:teuthology.orchestra.run.smithi089.stdout: ms service mode = crc 2024-09-16T16:46:19.560 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = 747238a8-71dc-4442-98b8-945fe8c55201 2024-09-16T16:46:19.560 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.560 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2024-09-16T16:46:19.560 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2024-09-16T16:46:19.560 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.560 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2024-09-16T16:46:19.560 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2024-09-16T16:46:19.560 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2024-09-16T16:46:19.560 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.561 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2024-09-16T16:46:19.561 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2024-09-16T16:46:19.561 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.561 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2024-09-16T16:46:19.561 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2024-09-16T16:46:19.561 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2024-09-16T16:46:19.561 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug trim objects = true 2024-09-16T16:46:19.561 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.561 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2024-09-16T16:46:19.561 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2024-09-16T16:46:19.561 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.561 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2024-09-16T16:46:19.561 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.561 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2024-09-16T16:46:19.562 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.562 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2024-09-16T16:46:19.562 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.562 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2024-09-16T16:46:19.562 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2024-09-16T16:46:19.562 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.562 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2024-09-16T16:46:19.562 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2024-09-16T16:46:19.562 INFO:teuthology.orchestra.run.smithi089.stdout: debug monc = 20 2024-09-16T16:46:19.562 INFO:teuthology.orchestra.run.smithi089.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T16:46:19.562 INFO:teuthology.orchestra.run.smithi089.stdout: crimson osd obc lru size = 10 2024-09-16T16:46:19.562 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-09-16T16:46:19.562 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2024-09-16T16:46:19.562 INFO:teuthology.orchestra.run.smithi089.stdout: osd blocked scrub grace period = 3600 2024-09-16T16:46:19.563 INFO:teuthology.orchestra.run.smithi089.stdout: osd class default list = * 2024-09-16T16:46:19.563 INFO:teuthology.orchestra.run.smithi089.stdout: osd class load list = * 2024-09-16T16:46:19.563 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = seastore 2024-09-16T16:46:19.563 INFO:teuthology.orchestra.run.smithi089.stdout: osd shutdown pgref assert = True 2024-09-16T16:46:19.563 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.563 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2024-09-16T16:46:19.563 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-09-16T16:46:19.563 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2024-09-16T16:46:19.563 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2024-09-16T16:46:19.563 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2024-09-16T16:46:19.563 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:46:19.563 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:46:19.563 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2024-09-16T16:46:19.563 INFO:teuthology.orchestra.run.smithi089.stdout: mgr stats period = 30 2024-09-16T16:46:19.564 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.564 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2024-09-16T16:46:19.564 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-09-16T16:46:19.564 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2024-09-16T16:46:19.564 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2024-09-16T16:46:19.564 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2024-09-16T16:46:19.564 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2024-09-16T16:46:19.564 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2024-09-16T16:46:19.564 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:46:19.564 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2024-09-16T16:46:19.564 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2024-09-16T16:46:19.564 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:46:19.564 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.564 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T16:46:19.565 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T16:46:19.565 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T16:46:19.565 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.565 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T16:46:19.565 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T16:46:19.565 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T16:46:19.565 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.565 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2024-09-16T16:46:19.565 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2024-09-16T16:46:19.565 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.565 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2024-09-16T16:46:19.565 INFO:teuthology.orchestra.run.smithi089.stdout: mon min osdmap epochs = 50 2024-09-16T16:46:19.565 INFO:teuthology.orchestra.run.smithi089.stdout: mon osdmap full prune interval = 2 2024-09-16T16:46:19.565 INFO:teuthology.orchestra.run.smithi089.stdout: mon osdmap full prune min = 15 2024-09-16T16:46:19.565 INFO:teuthology.orchestra.run.smithi089.stdout: mon osdmap full prune txsize = 2 2024-09-16T16:46:19.566 INFO:teuthology.orchestra.run.smithi089.stdout: paxos service trim min = 10 2024-09-16T16:46:19.566 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on pool no app = False 2024-09-16T16:46:19.566 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default crimson = True 2024-09-16T16:46:19.566 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:19.566 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2024-09-16T16:46:19.566 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2024-09-16T16:46:19.566 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2024-09-16T16:46:19.566 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2024-09-16T16:46:19.566 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T16:46:19.566 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T16:46:19.566 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-09-16T16:46:19.566 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2024-09-16T16:46:19.566 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2024-09-16T16:46:19.566 INFO:teuthology.orchestra.run.smithi089.stdout: crimson seastar cpu cores = 0-2 2024-09-16T16:46:19.566 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2024-09-16T16:46:19.567 INFO:teuthology.orchestra.run.smithi089.stdout: crimson seastar cpu cores = 3-5 2024-09-16T16:46:19.567 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2024-09-16T16:46:19.567 INFO:teuthology.orchestra.run.smithi089.stdout: crimson seastar cpu cores = 0-2 2024-09-16T16:46:19.567 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2024-09-16T16:46:19.567 INFO:teuthology.orchestra.run.smithi089.stdout: crimson seastar cpu cores = 3-5 2024-09-16T16:46:19.567 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2024-09-16T16:46:19.567 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2024-09-16T16:46:19.567 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T16:46:19.567 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2024-09-16T16:46:19.567 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.568 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2024-09-16T16:46:19.568 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.568 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2024-09-16T16:46:19.568 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.568 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2024-09-16T16:46:19.568 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2024-09-16T16:46:19.568 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.568 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2024-09-16T16:46:19.568 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2024-09-16T16:46:19.568 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.568 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T16:46:19.568 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2024-09-16T16:46:19.568 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.568 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T16:46:19.568 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T16:46:19.569 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.569 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2024-09-16T16:46:19.569 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.569 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2024-09-16T16:46:19.569 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2024-09-16T16:46:19.569 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2024-09-16T16:46:19.569 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2024-09-16T16:46:19.569 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2024-09-16T16:46:19.569 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2024-09-16T16:46:19.569 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2024-09-16T16:46:19.569 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T16:46:19.569 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T16:46:19.569 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2024-09-16T16:46:19.569 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.570 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T16:46:19.570 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.570 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2024-09-16T16:46:19.570 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.570 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2024-09-16T16:46:19.570 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.570 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2024-09-16T16:46:19.570 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2024-09-16T16:46:19.570 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2024-09-16T16:46:19.570 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = 172.21.15.89 2024-09-16T16:46:19.570 INFO:teuthology.orchestra.run.smithi177.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T16:46:19.570 INFO:teuthology.orchestra.run.smithi177.stdout: ms client mode = crc 2024-09-16T16:46:19.570 INFO:teuthology.orchestra.run.smithi177.stdout: ms cluster mode = crc 2024-09-16T16:46:19.570 INFO:teuthology.orchestra.run.smithi177.stdout: ms mon client mode = crc 2024-09-16T16:46:19.571 INFO:teuthology.orchestra.run.smithi177.stdout: ms mon cluster mode = crc 2024-09-16T16:46:19.571 INFO:teuthology.orchestra.run.smithi177.stdout: ms mon service mode = crc 2024-09-16T16:46:19.571 INFO:teuthology.orchestra.run.smithi177.stdout: ms service mode = crc 2024-09-16T16:46:19.571 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = 747238a8-71dc-4442-98b8-945fe8c55201 2024-09-16T16:46:19.571 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.571 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2024-09-16T16:46:19.571 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2024-09-16T16:46:19.571 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.571 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2024-09-16T16:46:19.571 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2024-09-16T16:46:19.571 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2024-09-16T16:46:19.571 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.571 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2024-09-16T16:46:19.571 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2024-09-16T16:46:19.571 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.571 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2024-09-16T16:46:19.572 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2024-09-16T16:46:19.572 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2024-09-16T16:46:19.572 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug trim objects = true 2024-09-16T16:46:19.572 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.572 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2024-09-16T16:46:19.572 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2024-09-16T16:46:19.572 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.572 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2024-09-16T16:46:19.572 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.572 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2024-09-16T16:46:19.572 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.572 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2024-09-16T16:46:19.572 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.572 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2024-09-16T16:46:19.572 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2024-09-16T16:46:19.572 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.573 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2024-09-16T16:46:19.573 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2024-09-16T16:46:19.573 INFO:teuthology.orchestra.run.smithi177.stdout: debug monc = 20 2024-09-16T16:46:19.573 INFO:teuthology.orchestra.run.smithi177.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T16:46:19.573 INFO:teuthology.orchestra.run.smithi177.stdout: crimson osd obc lru size = 10 2024-09-16T16:46:19.573 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-09-16T16:46:19.573 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2024-09-16T16:46:19.573 INFO:teuthology.orchestra.run.smithi177.stdout: osd blocked scrub grace period = 3600 2024-09-16T16:46:19.573 INFO:teuthology.orchestra.run.smithi177.stdout: osd class default list = * 2024-09-16T16:46:19.573 INFO:teuthology.orchestra.run.smithi177.stdout: osd class load list = * 2024-09-16T16:46:19.573 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = seastore 2024-09-16T16:46:19.573 INFO:teuthology.orchestra.run.smithi177.stdout: osd shutdown pgref assert = True 2024-09-16T16:46:19.573 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.573 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2024-09-16T16:46:19.573 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-09-16T16:46:19.574 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2024-09-16T16:46:19.574 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-09-16T16:46:19.574 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-09-16T16:46:19.574 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:46:19.574 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:46:19.574 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2024-09-16T16:46:19.574 INFO:teuthology.orchestra.run.smithi177.stdout: mgr stats period = 30 2024-09-16T16:46:19.574 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.574 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2024-09-16T16:46:19.574 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-09-16T16:46:19.574 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-09-16T16:46:19.574 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2024-09-16T16:46:19.574 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-09-16T16:46:19.574 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2024-09-16T16:46:19.574 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2024-09-16T16:46:19.574 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:46:19.575 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2024-09-16T16:46:19.575 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2024-09-16T16:46:19.575 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:46:19.575 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.575 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T16:46:19.575 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T16:46:19.575 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T16:46:19.575 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.575 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T16:46:19.575 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T16:46:19.575 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T16:46:19.575 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.575 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2024-09-16T16:46:19.575 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2024-09-16T16:46:19.575 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.575 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2024-09-16T16:46:19.576 INFO:teuthology.orchestra.run.smithi177.stdout: mon min osdmap epochs = 50 2024-09-16T16:46:19.576 INFO:teuthology.orchestra.run.smithi177.stdout: mon osdmap full prune interval = 2 2024-09-16T16:46:19.576 INFO:teuthology.orchestra.run.smithi177.stdout: mon osdmap full prune min = 15 2024-09-16T16:46:19.576 INFO:teuthology.orchestra.run.smithi177.stdout: mon osdmap full prune txsize = 2 2024-09-16T16:46:19.576 INFO:teuthology.orchestra.run.smithi177.stdout: paxos service trim min = 10 2024-09-16T16:46:19.576 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on pool no app = False 2024-09-16T16:46:19.576 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default crimson = True 2024-09-16T16:46:19.576 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T16:46:19.576 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2024-09-16T16:46:19.576 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2024-09-16T16:46:19.576 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2024-09-16T16:46:19.576 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2024-09-16T16:46:19.576 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T16:46:19.576 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T16:46:19.576 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-09-16T16:46:19.577 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2024-09-16T16:46:19.577 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.0] 2024-09-16T16:46:19.577 INFO:teuthology.orchestra.run.smithi177.stdout: crimson seastar cpu cores = 0-2 2024-09-16T16:46:19.577 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.1] 2024-09-16T16:46:19.577 INFO:teuthology.orchestra.run.smithi177.stdout: crimson seastar cpu cores = 3-5 2024-09-16T16:46:19.577 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.2] 2024-09-16T16:46:19.577 INFO:teuthology.orchestra.run.smithi177.stdout: crimson seastar cpu cores = 0-2 2024-09-16T16:46:19.577 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.3] 2024-09-16T16:46:19.577 INFO:teuthology.orchestra.run.smithi177.stdout: crimson seastar cpu cores = 3-5 2024-09-16T16:46:19.578 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T16:46:19.579 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T16:46:19.683 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T16:46:19.683 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:46:19.683 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T16:46:19.699 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:46:19.699 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T16:46:19.754 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2024-09-16T16:46:19.754 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:46:19.754 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T16:46:19.754 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T16:46:19.828 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:46:19.828 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:19.883 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T16:46:19.884 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T16:46:19.884 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T16:46:19.884 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T16:46:19.919 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T16:46:19.920 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:19.976 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T16:46:19.976 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T16:46:19.976 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T16:46:20.095 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T16:46:20.098 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T16:46:20.098 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T16:46:20.099 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T16:46:20.148 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T16:46:20.161 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-16T16:46:20.211 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-16T16:46:20.225 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T16:46:20.225 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-16T16:46:20.225 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T16:46:20.249 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:20.249 INFO:tasks.ceph:role: osd.0 2024-09-16T16:46:20.249 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-16T16:46:20.249 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T16:46:20.321 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:46:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:46:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:46:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:46:20.321 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:46:20.321 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:46:20.321 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:46:20.322 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:46:20.322 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:46:20.322 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:46:20.834 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-09-16T16:46:20.836 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-09-16T16:46:20.836 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T16:46:20.984 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T16:46:21.017 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T16:46:21.083 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:21.084 INFO:tasks.ceph:role: osd.1 2024-09-16T16:46:21.084 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-16T16:46:21.084 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T16:46:21.157 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:46:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:46:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:46:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:46:21.157 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:46:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:46:21.157 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:46:21.157 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:46:21.157 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:46:21.157 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:46:21.609 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-09-16T16:46:21.611 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-09-16T16:46:21.612 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T16:46:21.705 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T16:46:21.734 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:22.090 INFO:teuthology.orchestra.run.smithi089.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:22.091 INFO:teuthology.orchestra.run.smithi089.stderr:INFO 2024-09-16 16:46:22,092 seastar - Reactor backend: linux-aio 2024-09-16T16:46:22.110 INFO:teuthology.orchestra.run.smithi089.stderr:==27638==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:22.232 INFO:teuthology.orchestra.run.smithi089.stderr:INFO 2024-09-16 16:46:22,233 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:46:22.232 INFO:teuthology.orchestra.run.smithi089.stderr:INFO 2024-09-16 16:46:22,233 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-16T16:46:22.233 INFO:teuthology.orchestra.run.smithi089.stderr:DEBUG 2024-09-16 16:46:22,234 [shard 0:main] seastar - reactor::drain 2024-09-16T16:46:22.753 INFO:teuthology.orchestra.run.smithi089.stderr:----------------------------------------------------- 2024-09-16T16:46:22.753 INFO:teuthology.orchestra.run.smithi089.stderr:Suppressions used: 2024-09-16T16:46:22.753 INFO:teuthology.orchestra.run.smithi089.stderr: count bytes template 2024-09-16T16:46:22.753 INFO:teuthology.orchestra.run.smithi089.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:22.753 INFO:teuthology.orchestra.run.smithi089.stderr:----------------------------------------------------- 2024-09-16T16:46:22.753 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-16T16:46:22.804 INFO:teuthology.orchestra.run.smithi089.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:22.808 INFO:teuthology.orchestra.run.smithi089.stderr:INFO 2024-09-16 16:46:22,808 seastar - Reactor backend: linux-aio 2024-09-16T16:46:22.817 INFO:teuthology.orchestra.run.smithi089.stderr:==27636==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:23.105 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x42198 0x3ef7b 0xfd531 0xb85348d 0xb853540 0xb853656 0xb853736 0xb8539b6 0xb853f61 0xb85436c 0xb85462b 0xba26389 0xba29be0 0xb9dc97b 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:23.105 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x377a553 0x3b8c072 0x3b8c278 0xb9e909a 0xb9ea53a 0xb9ea7b4 0xb9ea95c 0xba02054 0xba313d1 0xba31a18 0xb9d8ccf 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:23.105 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff885f5f10 0xffffffff885f64c0 0xffffffff884908cb 0xffffffff887a8239 0xffffffff8878e2a3 0xffffffff88796a3b 0xffffffff88796ebc 0xffffffff8848c884 0xffffffff890d1d62 0xffffffff89200bb2 2024-09-16T16:46:23.105 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:23.162 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x162bff 0x422c4 0x3ef7b 0xfd531 0x3c34f60 0x55593bc 0x9ed0efd 0x9ed14b6 0x9ed185e 0x9ed4c38 0x9ed5894 0x9ed5b57 0x9ed67ce 0x9e21d32 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:23.163 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff88aa5d17 0xffffffff887ba036 0xffffffff887bdce1 0xffffffff887bee42 0xffffffff887bf6b7 0xffffffff887e4853 0xffffffff8878ebde 0xffffffff88796a3b 0xffffffff88796ebc 0xffffffff8848c884 0xffffffff890d1d62 0xffffffff89200bb2 2024-09-16T16:46:23.163 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x162c23 0x422c4 0x3ef7b 0xfd531 0xba285ff 0xba286cf 0xb9d809d 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:23.163 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5fe9b63 0x5fe9dfc 0x5fe9fdf 0x5fea2b5 0x60389b3 0x6038bb9 0x5fb8d06 0x5e130e7 0x5e13f9c 0x3babc73 0x3babf2c 0xacfac28 0xac94f95 0xacfad51 0xacc7911 0x994634a 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:23.163 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:23.163 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff88796808 0xffffffff88796ebc 0xffffffff8848c884 0xffffffff890d1d62 0xffffffff89200bb2 2024-09-16T16:46:23.220 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x375f8b3 0x3778712 0xc3131f1 0xc3133ae 0xc4b4124 0xc4b213f 0x9983854 0x9e21a3c 0x99fffb1 0x9a005b7 0x98f673c 0x9274fe9 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:23.220 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:23.288 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5541fe6 0x9e33959 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:23.289 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:23.346 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x55426b5 0x9e3397b 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:23.346 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:23.374 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x9e33944 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:23.374 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:23.374 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab61 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:23.375 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:23.432 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x156f3 0xdd312 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:23.432 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:23.432 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 122 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10797f 0xdd2e1 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:23.432 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:23.454 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x156dc 0xdd312 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:23.454 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:23.539 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542d76 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:23.540 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:23.540 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 230 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4abc2 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:23.540 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:24.784 INFO:teuthology.orchestra.run.smithi089.stderr:----------------------------------------------------- 2024-09-16T16:46:24.784 INFO:teuthology.orchestra.run.smithi089.stderr:Suppressions used: 2024-09-16T16:46:24.784 INFO:teuthology.orchestra.run.smithi089.stderr: count bytes template 2024-09-16T16:46:24.784 INFO:teuthology.orchestra.run.smithi089.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:24.784 INFO:teuthology.orchestra.run.smithi089.stderr:----------------------------------------------------- 2024-09-16T16:46:24.784 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-16T16:46:24.811 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T16:46:24.835 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:25.113 INFO:teuthology.orchestra.run.smithi089.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:25.114 INFO:teuthology.orchestra.run.smithi089.stderr:INFO 2024-09-16 16:46:25,115 seastar - Reactor backend: linux-aio 2024-09-16T16:46:25.119 INFO:teuthology.orchestra.run.smithi089.stderr:==27687==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:25.241 INFO:teuthology.orchestra.run.smithi089.stderr:INFO 2024-09-16 16:46:25,238 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:46:25.241 INFO:teuthology.orchestra.run.smithi089.stderr:INFO 2024-09-16 16:46:25,238 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-16T16:46:25.241 INFO:teuthology.orchestra.run.smithi089.stderr:DEBUG 2024-09-16 16:46:25,239 [shard 0:main] seastar - reactor::drain 2024-09-16T16:46:25.752 INFO:teuthology.orchestra.run.smithi089.stderr:----------------------------------------------------- 2024-09-16T16:46:25.753 INFO:teuthology.orchestra.run.smithi089.stderr:Suppressions used: 2024-09-16T16:46:25.753 INFO:teuthology.orchestra.run.smithi089.stderr: count bytes template 2024-09-16T16:46:25.753 INFO:teuthology.orchestra.run.smithi089.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:25.753 INFO:teuthology.orchestra.run.smithi089.stderr:----------------------------------------------------- 2024-09-16T16:46:25.753 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-16T16:46:25.810 INFO:teuthology.orchestra.run.smithi089.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:25.814 INFO:teuthology.orchestra.run.smithi089.stderr:INFO 2024-09-16 16:46:25,814 seastar - Reactor backend: linux-aio 2024-09-16T16:46:25.823 INFO:teuthology.orchestra.run.smithi089.stderr:==27685==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:26.106 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x61146ea 0xba3480f 0xba348f6 0xba34b2c 0xba34cc8 0xba3505e 0xba35270 0xb9d20ef 0xb9d2514 0xb9d84d7 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.106 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:26.106 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab09 0x3ac7b0e 0x3b8c26d 0xb9fdc0e 0xba39123 0xba394ae 0xb9d98a8 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.107 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:26.164 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab7c 0x3815914 0x3816550 0xba2816b 0xba2861f 0xba286cf 0xb9d809d 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9e12036 0x9e2237e 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.164 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:26.164 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x162b83 0x444e9 0xfe5da 0x5cc3466 0x5cc3640 0x5cc38f7 0x5cc39ec 0xba1cab4 0xb9dc9ce 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:26.164 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:26.164 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133c2b 0xdd332 0x4bedc 0xba04196 0xba05489 0xba33d3f 0xba34389 0xb9cef3d 0x9e03d8c 0x9e0db49 0x9e2237e 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.164 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:26.287 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10797f 0xdd2fc 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:26.287 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:26.345 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x9e33948 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:26.345 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:26.397 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x53b10 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.397 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:26.400 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x8b56c 0x10d76c 0xdd31a 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.400 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:26.452 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xdd33a 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:26.452 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:26.454 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab61 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.454 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:26.457 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 122 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542c38 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.457 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:26.562 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab3d 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.562 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:26.565 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 230 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab6b 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.565 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:26.876 INFO:teuthology.orchestra.run.smithi089.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542745 0x9e3397b 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:26.877 INFO:teuthology.orchestra.run.smithi089.stderr:kernel callstack: 2024-09-16T16:46:27.787 INFO:teuthology.orchestra.run.smithi089.stderr:----------------------------------------------------- 2024-09-16T16:46:27.787 INFO:teuthology.orchestra.run.smithi089.stderr:Suppressions used: 2024-09-16T16:46:27.787 INFO:teuthology.orchestra.run.smithi089.stderr: count bytes template 2024-09-16T16:46:27.787 INFO:teuthology.orchestra.run.smithi089.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:27.787 INFO:teuthology.orchestra.run.smithi089.stderr:----------------------------------------------------- 2024-09-16T16:46:27.787 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-16T16:46:27.813 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T16:46:27.837 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T16:46:27.866 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:27.866 INFO:tasks.ceph:role: osd.2 2024-09-16T16:46:27.866 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T16:46:27.866 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T16:46:27.941 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:46:27.941 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:46:27.941 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:46:27.941 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:46:27.941 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:46:27.941 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:46:27.941 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:46:27.941 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:46:27.941 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:46:27.941 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:46:28.442 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-09-16T16:46:28.444 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-09-16T16:46:28.445 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-16T16:46:28.554 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T16:46:28.586 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-16T16:46:28.652 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:28.652 INFO:tasks.ceph:role: osd.3 2024-09-16T16:46:28.652 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T16:46:28.652 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T16:46:28.725 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:46:28.725 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:46:28.725 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:46:28.725 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:46:28.725 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:46:28.725 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:46:28.725 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:46:28.725 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:46:28.725 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:46:28.725 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:46:29.187 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-09-16T16:46:29.188 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-09-16T16:46:29.189 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-16T16:46:29.269 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-16T16:46:29.339 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:29.634 INFO:teuthology.orchestra.run.smithi177.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:29.635 INFO:teuthology.orchestra.run.smithi177.stderr:INFO 2024-09-16 16:46:29,636 seastar - Reactor backend: linux-aio 2024-09-16T16:46:29.646 INFO:teuthology.orchestra.run.smithi177.stderr:==27425==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:29.763 INFO:teuthology.orchestra.run.smithi177.stderr:INFO 2024-09-16 16:46:29,763 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:46:29.763 INFO:teuthology.orchestra.run.smithi177.stderr:INFO 2024-09-16 16:46:29,763 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-16T16:46:29.764 INFO:teuthology.orchestra.run.smithi177.stderr:DEBUG 2024-09-16 16:46:29,764 [shard 0:main] seastar - reactor::drain 2024-09-16T16:46:30.285 INFO:teuthology.orchestra.run.smithi177.stderr:----------------------------------------------------- 2024-09-16T16:46:30.285 INFO:teuthology.orchestra.run.smithi177.stderr:Suppressions used: 2024-09-16T16:46:30.285 INFO:teuthology.orchestra.run.smithi177.stderr: count bytes template 2024-09-16T16:46:30.285 INFO:teuthology.orchestra.run.smithi177.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:30.286 INFO:teuthology.orchestra.run.smithi177.stderr:----------------------------------------------------- 2024-09-16T16:46:30.286 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-09-16T16:46:30.343 INFO:teuthology.orchestra.run.smithi177.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:30.347 INFO:teuthology.orchestra.run.smithi177.stderr:INFO 2024-09-16 16:46:30,347 seastar - Reactor backend: linux-aio 2024-09-16T16:46:30.356 INFO:teuthology.orchestra.run.smithi177.stderr:==27423==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:30.421 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133c29 0xdd332 0x4b14c 0x362a270 0x382b1d8 0x416dc9b 0x5fb8ce4 0x5fb8ee0 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:30.421 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:30.640 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x36117b8 0xb9ce619 0x9843791 0x9af9974 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.641 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:30.641 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133c2d 0xdd332 0x4b14c 0x954d84f 0x954d968 0x95e38c3 0x95e3dd5 0x9af96cb 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.641 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:30.698 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x162bff 0x422c4 0x3ef7b 0xfd531 0x3c34f60 0x55593bc 0x9ed0efd 0x9ed14b6 0x9ed185e 0x9ed4c38 0x9ed5894 0x9ed5b57 0x9ed67ce 0x9e21d32 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.698 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x119673 0x11d39b 0x41608 0x41bbe 0x41c92 0x41f68 0x4214e 0x3ef7b 0xfd531 0x9ea10a3 0x9ed4a3f 0x9ed5894 0x9ed5b57 0x9ed67ce 0x9e21d32 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.698 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff8b78ebea 0xffffffff8b796a3b 0xffffffff8b796ebc 0xffffffff8b48c884 0xffffffff8c0d1d62 0xffffffff8c200bb2 2024-09-16T16:46:30.699 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff8b79bbc6 0xffffffff8b7a04d6 0xffffffff8b7a0b9d 0xffffffff8b76cd4d 0xffffffff8c0cd45f 0xffffffff8c200130 2024-09-16T16:46:30.821 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542000 0x9e33959 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:30.821 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:30.878 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5541db4 0x5542d9c 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:30.879 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:30.918 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x55426d0 0x9e3397b 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.918 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:30.919 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x8b56c 0x10d76c 0xdd31a 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.919 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:30.976 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5541dea 0x5542d9c 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.976 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 122 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x9e33966 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.976 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:30.976 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:30.986 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab0b 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:30.986 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:31.084 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 230 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xdd2d5 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:31.084 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab07 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:31.084 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:31.084 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:31.406 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab6e 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:31.406 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:32.346 INFO:teuthology.orchestra.run.smithi177.stderr:----------------------------------------------------- 2024-09-16T16:46:32.346 INFO:teuthology.orchestra.run.smithi177.stderr:Suppressions used: 2024-09-16T16:46:32.346 INFO:teuthology.orchestra.run.smithi177.stderr: count bytes template 2024-09-16T16:46:32.346 INFO:teuthology.orchestra.run.smithi177.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:32.346 INFO:teuthology.orchestra.run.smithi177.stderr:----------------------------------------------------- 2024-09-16T16:46:32.346 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-09-16T16:46:32.374 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T16:46:32.398 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:32.687 INFO:teuthology.orchestra.run.smithi177.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:32.688 INFO:teuthology.orchestra.run.smithi177.stderr:INFO 2024-09-16 16:46:32,689 seastar - Reactor backend: linux-aio 2024-09-16T16:46:32.694 INFO:teuthology.orchestra.run.smithi177.stderr:==27472==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:32.813 INFO:teuthology.orchestra.run.smithi177.stderr:INFO 2024-09-16 16:46:32,814 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:46:32.813 INFO:teuthology.orchestra.run.smithi177.stderr:INFO 2024-09-16 16:46:32,814 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-16T16:46:32.814 INFO:teuthology.orchestra.run.smithi177.stderr:DEBUG 2024-09-16 16:46:32,815 [shard 0:main] seastar - reactor::drain 2024-09-16T16:46:33.337 INFO:teuthology.orchestra.run.smithi177.stderr:----------------------------------------------------- 2024-09-16T16:46:33.337 INFO:teuthology.orchestra.run.smithi177.stderr:Suppressions used: 2024-09-16T16:46:33.337 INFO:teuthology.orchestra.run.smithi177.stderr: count bytes template 2024-09-16T16:46:33.337 INFO:teuthology.orchestra.run.smithi177.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:33.337 INFO:teuthology.orchestra.run.smithi177.stderr:----------------------------------------------------- 2024-09-16T16:46:33.337 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-09-16T16:46:33.394 INFO:teuthology.orchestra.run.smithi177.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:33.398 INFO:teuthology.orchestra.run.smithi177.stderr:INFO 2024-09-16 16:46:33,398 seastar - Reactor backend: linux-aio 2024-09-16T16:46:33.407 INFO:teuthology.orchestra.run.smithi177.stderr:==27470==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:33.692 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x386a099 0x386a570 0x95c9b5c 0x95c9c5d 0x95e3489 0x98436f5 0x9af9974 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:33.692 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:33.692 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab7c 0x3ac7b0e 0x3b8c26d 0xb9fdc0e 0xba39123 0xba394ae 0xb9d98a8 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:33.692 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:33.749 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4c62d 0xba0c8d7 0xba37031 0xba3767b 0xb9d99f0 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9e12036 0x9e2237e 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:33.750 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:33.750 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x42198 0x3ef7b 0xfd531 0x3c34f60 0x55593bc 0x9ed0efd 0x9ed14b6 0x9ed185e 0x9ed4c38 0x9ed5894 0x9ed5b57 0x9ed67ce 0x9e21d32 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:33.750 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff8b5f6008 0xffffffff8b5f64c0 0xffffffff8b4908cb 0xffffffff8b7a8239 0xffffffff8b78e2a3 0xffffffff8b796a3b 0xffffffff8b796ebc 0xffffffff8b48c884 0xffffffff8c0d1d62 0xffffffff8c200bb2 2024-09-16T16:46:33.889 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xdd33a 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:33.890 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:33.947 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x55426b1 0x9e3397b 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:33.947 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:33.981 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542ce7 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:33.981 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:33.981 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x357849f 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:33.981 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:34.038 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 123 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xdd323 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:34.038 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:34.038 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10796f 0xdd305 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:34.038 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:34.055 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542cac 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:34.055 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:34.146 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542dec 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:34.146 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 230 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5541f1d 0x9e33959 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:34.146 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:34.146 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:34.432 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542f29 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:34.432 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:34.489 INFO:teuthology.orchestra.run.smithi177.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xdd323 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:34.490 INFO:teuthology.orchestra.run.smithi177.stderr:kernel callstack: 2024-09-16T16:46:35.388 INFO:teuthology.orchestra.run.smithi177.stderr:----------------------------------------------------- 2024-09-16T16:46:35.388 INFO:teuthology.orchestra.run.smithi177.stderr:Suppressions used: 2024-09-16T16:46:35.388 INFO:teuthology.orchestra.run.smithi177.stderr: count bytes template 2024-09-16T16:46:35.389 INFO:teuthology.orchestra.run.smithi177.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:35.389 INFO:teuthology.orchestra.run.smithi177.stderr:----------------------------------------------------- 2024-09-16T16:46:35.389 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-09-16T16:46:35.414 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T16:46:35.438 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T16:46:35.439 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:46:35.439 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T16:46:35.469 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:46:35.469 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T16:46:35.537 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T16:46:35.538 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T16:46:35.562 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T16:46:35.562 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T16:46:35.627 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T16:46:35.627 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-16T16:46:35.692 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:46:35.692 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T16:46:35.711 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T16:46:35.711 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-16T16:46:35.747 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T16:46:35.747 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T16:46:35.778 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2024-09-16T16:46:35.779 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDeYOhmcPBlORAA/sdnLa9hb3UoydJjdRLPjw== 2024-09-16T16:46:35.779 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2024-09-16T16:46:35.779 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDhYOhmzKK8ORAALHfmxfqB2ZoxuN/+bdQFsg== 2024-09-16T16:46:35.779 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2024-09-16T16:46:35.779 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDcYOhmLri5BRAArCDI00ern6zf+IKKTvXOKQ== 2024-09-16T16:46:35.779 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2024-09-16T16:46:35.779 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDmYOhmFlj3HRAATRkuebvrD5UhTGLwkah3jA== 2024-09-16T16:46:35.779 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2024-09-16T16:46:35.779 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDpYOhmZvD6IBAAeUltqBysrRUHrlqam5bj9g== 2024-09-16T16:46:35.779 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2024-09-16T16:46:35.779 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDcYOhm+K7kCBAAUbsMidH/srR3O8EUrfUNRw== 2024-09-16T16:46:35.779 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2024-09-16T16:46:35.779 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDcYOhm4PGrDBAAgJ7B/hfXfEMZ/6TktU/fkA== 2024-09-16T16:46:35.780 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:46:35.888 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:46:35.951 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T16:46:36.011 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:46:36.072 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:46:36.133 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T16:46:36.240 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T16:46:36.303 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T16:46:36.304 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T16:46:36.328 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T16:46:36.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.439+0000 7fcc3ae32c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.439+0000 7fcc3ae32c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.453 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T16:46:36.477 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:36.532 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T16:46:36.533 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T16:46:36.533 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T16:46:36.575 INFO:tasks.ceph.mon.a:Started 2024-09-16T16:46:36.575 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T16:46:36.575 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T16:46:36.575 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T16:46:36.578 INFO:tasks.ceph.mgr.x:Started 2024-09-16T16:46:36.578 DEBUG:tasks.ceph:set 0 configs 2024-09-16T16:46:36.578 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T16:46:36.578 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T16:46:36.656 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-09-16T16:46:36.655+0000 7fb83fcfcc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.656 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-09-16T16:46:36.655+0000 7fb83fcfcc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.656 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-09-16T16:46:36.655+0000 7fb83fcfcc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.674 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T16:46:36.673+0000 7f83b8fc0000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.679+0000 7f8ecc991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.686+0000 7f8ecc991640 1 Processor -- start 2024-09-16T16:46:36.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.686+0000 7f8ecc991640 1 -- start start 2024-09-16T16:46:36.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.687+0000 7f8ecc991640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8ec8138720 0x7f8ec813ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:36.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.687+0000 7f8ecc991640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec8133040 con 0x7f8ec8132520 2024-09-16T16:46:36.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.687+0000 7f8ecc991640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f8ec806f6d0 con 0x7f8ec8138720 2024-09-16T16:46:36.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.687+0000 7f8ec5d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8ec8138720 0x7f8ec813ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:36.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.688+0000 7f8ec5d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8ec8138720 0x7f8ec813ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36228/0 (socket says 172.21.15.89:36228) 2024-09-16T16:46:36.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.688+0000 7f8ec659c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8ec8132520 0x7f8ec8132930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56976/0 (socket says 172.21.15.89:56976) 2024-09-16T16:46:36.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.688+0000 7f8ec5d9b640 1 -- 172.21.15.89:0/2736977408 learned_addr learned my addr 172.21.15.89:0/2736977408 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:36.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.688+0000 7f8ec5d9b640 1 -- 172.21.15.89:0/2736977408 >> v2:172.21.15.89:3300/0 conn(0x7f8ec8138720 msgr2=0x7f8ec813ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-16T16:46:36.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.688+0000 7f8ec5d9b640 1 -- 172.21.15.89:0/2736977408 >> v2:172.21.15.89:3300/0 conn(0x7f8ec8138720 msgr2=0x7f8ec813ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T16:46:36.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.688+0000 7f8ec5d9b640 1 --2- 172.21.15.89:0/2736977408 >> v2:172.21.15.89:3300/0 conn(0x7f8ec8138720 0x7f8ec813ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T16:46:36.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.688+0000 7f8ec5d9b640 1 --2- 172.21.15.89:0/2736977408 >> v2:172.21.15.89:3300/0 conn(0x7f8ec8138720 0x7f8ec813ab40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T16:46:36.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.691+0000 7f8ec559a640 1 -- 172.21.15.89:0/2736977408 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2762147050 0 0) 0x7f8eb8001110 con 0x7f8ec8132520 2024-09-16T16:46:36.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.691+0000 7f8ec559a640 1 -- 172.21.15.89:0/2736977408 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8eb0003580 con 0x7f8ec8132520 2024-09-16T16:46:36.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.692+0000 7f8ec559a640 1 -- 172.21.15.89:0/2736977408 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 152826452 0 0) 0x7f8eb0003580 con 0x7f8ec8132520 2024-09-16T16:46:36.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.692+0000 7f8ec559a640 1 -- 172.21.15.89:0/2736977408 >> v2:172.21.15.89:3300/0 conn(0x7f8ec8138720 msgr2=0x7f8ec813ab40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T16:46:36.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.692+0000 7f8ec559a640 1 --2- 172.21.15.89:0/2736977408 >> v2:172.21.15.89:3300/0 conn(0x7f8ec8138720 0x7f8ec813ab40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:36.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.692+0000 7f8ec559a640 1 -- 172.21.15.89:0/2736977408 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec806f3d0 con 0x7f8ec8132520 2024-09-16T16:46:36.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.692+0000 7f8ec559a640 1 -- 172.21.15.89:0/2736977408 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3114648563 0 0) 0x7f8eb80017b0 con 0x7f8ec8132520 2024-09-16T16:46:36.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.692+0000 7f8ec559a640 1 -- 172.21.15.89:0/2736977408 >> v1:172.21.15.89:6789/0 conn(0x7f8ec8132520 legacy=0x7f8ec8132930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:36.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.692+0000 7f8ec559a640 1 --2- 172.21.15.89:0/2736977408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eb0003a70 0x7f8eb0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:36.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.692+0000 7f8ec559a640 1 -- 172.21.15.89:0/2736977408 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec806f6d0 con 0x7f8eb0003a70 2024-09-16T16:46:36.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.692+0000 7f8ec659c640 1 --2- 172.21.15.89:0/2736977408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eb0003a70 0x7f8eb0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:36.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.692+0000 7f8ec659c640 1 -- 172.21.15.89:0/2736977408 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb0003580 con 0x7f8eb0003a70 2024-09-16T16:46:36.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.694+0000 7f8ec659c640 1 --2- 172.21.15.89:0/2736977408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eb0003a70 0x7f8eb0003ec0 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbc26a34c2c47a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:36.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.694+0000 7f8ec559a640 1 -- 172.21.15.89:0/2736977408 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8eb8007d80 con 0x7f8eb0003a70 2024-09-16T16:46:36.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.694+0000 7f8ec559a640 1 -- 172.21.15.89:0/2736977408 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8eb80059a0 con 0x7f8eb0003a70 2024-09-16T16:46:36.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.694+0000 7f8ec559a640 1 -- 172.21.15.89:0/2736977408 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8eb8005c40 con 0x7f8eb0003a70 2024-09-16T16:46:36.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.694+0000 7f8ecc991640 1 -- 172.21.15.89:0/2736977408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eb0003a70 msgr2=0x7f8eb0003ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:36.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.695+0000 7f8ecc991640 1 --2- 172.21.15.89:0/2736977408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eb0003a70 0x7f8eb0003ec0 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:36.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.695+0000 7f8ecc991640 1 -- 172.21.15.89:0/2736977408 shutdown_connections 2024-09-16T16:46:36.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.695+0000 7f8ecc991640 1 --2- 172.21.15.89:0/2736977408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eb0003a70 0x7f8eb0003ec0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:36.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.695+0000 7f8ecc991640 1 --2- 172.21.15.89:0/2736977408 >> v2:172.21.15.89:3300/0 conn(0x7f8ec8138720 0x7f8ec813ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:36.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.695+0000 7f8ecc991640 1 -- 172.21.15.89:0/2736977408 >> 172.21.15.89:0/2736977408 conn(0x7f8ec806e490 msgr2=0x7f8ec806e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:36.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.695+0000 7f8ecc991640 1 -- 172.21.15.89:0/2736977408 shutdown_connections 2024-09-16T16:46:36.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.695+0000 7f8ecc991640 1 -- 172.21.15.89:0/2736977408 wait complete. 2024-09-16T16:46:36.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.695+0000 7f8ecc991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.696 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T16:46:36.695+0000 7f83b8fc0000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.697 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T16:46:36.695+0000 7f83b8fc0000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.696+0000 7f8ecc991640 1 Processor -- start 2024-09-16T16:46:36.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.697+0000 7f8ecc991640 1 -- start start 2024-09-16T16:46:36.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.698+0000 7f8ecc991640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eb0003a70 0x7f8ec811f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:36.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.698+0000 7f8ecc991640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec811ef60 con 0x7f8eb0003a70 2024-09-16T16:46:36.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.698+0000 7f8ec659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eb0003a70 0x7f8ec811f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:36.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.698+0000 7f8ec659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eb0003a70 0x7f8ec811f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36242/0 (socket says 172.21.15.89:36242) 2024-09-16T16:46:36.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.698+0000 7f8ec659c640 1 -- 172.21.15.89:0/2943603264 learned_addr learned my addr 172.21.15.89:0/2943603264 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:36.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.698+0000 7f8ec659c640 1 -- 172.21.15.89:0/2943603264 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec8120330 con 0x7f8eb0003a70 2024-09-16T16:46:36.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.698+0000 7f8ec659c640 1 --2- 172.21.15.89:0/2943603264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eb0003a70 0x7f8ec811f180 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:36.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.698+0000 7f8eb6ffd640 1 -- 172.21.15.89:0/2943603264 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8eb8007d70 con 0x7f8eb0003a70 2024-09-16T16:46:36.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.698+0000 7f8eb6ffd640 1 -- 172.21.15.89:0/2943603264 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8eb8007040 con 0x7f8eb0003a70 2024-09-16T16:46:36.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.698+0000 7f8ecc991640 1 -- 172.21.15.89:0/2943603264 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec8122820 con 0x7f8eb0003a70 2024-09-16T16:46:36.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.698+0000 7f8eb6ffd640 1 -- 172.21.15.89:0/2943603264 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8eb80072e0 con 0x7f8eb0003a70 2024-09-16T16:46:36.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.698+0000 7f8ecc991640 1 -- 172.21.15.89:0/2943603264 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec811ebc0 con 0x7f8eb0003a70 2024-09-16T16:46:36.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.698+0000 7f8eb6ffd640 1 -- 172.21.15.89:0/2943603264 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f8eb8017430 con 0x7f8eb0003a70 2024-09-16T16:46:36.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.698+0000 7f8eb6ffd640 1 -- 172.21.15.89:0/2943603264 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (crc 0 0 0) 0x7f8eb8016c50 con 0x7f8eb0003a70 2024-09-16T16:46:36.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.699+0000 7f8ecc991640 1 -- 172.21.15.89:0/2943603264 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ec806a300 con 0x7f8eb0003a70 2024-09-16T16:46:36.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.702+0000 7f8eb6ffd640 1 -- 172.21.15.89:0/2943603264 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f8ec8133040 con 0x7f8eb0003a70 2024-09-16T16:46:36.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.763+0000 7f8ecc991640 1 -- 172.21.15.89:0/2943603264 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8ec811edb0 con 0x7f8eb0003a70 2024-09-16T16:46:36.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.764+0000 7f8eb6ffd640 1 -- 172.21.15.89:0/2943603264 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (crc 0 0 0) 0x7f8eb80163c0 con 0x7f8eb0003a70 2024-09-16T16:46:36.765 INFO:teuthology.orchestra.run.smithi089.stderr:adjusted tunables profile to default 2024-09-16T16:46:36.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.765+0000 7f8ecc991640 1 -- 172.21.15.89:0/2943603264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eb0003a70 msgr2=0x7f8ec811f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:36.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.765+0000 7f8ecc991640 1 --2- 172.21.15.89:0/2943603264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eb0003a70 0x7f8ec811f180 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:36.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.765+0000 7f8ecc991640 1 -- 172.21.15.89:0/2943603264 shutdown_connections 2024-09-16T16:46:36.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.765+0000 7f8ecc991640 1 --2- 172.21.15.89:0/2943603264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8eb0003a70 0x7f8ec811f180 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:36.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.765+0000 7f8ecc991640 1 -- 172.21.15.89:0/2943603264 >> 172.21.15.89:0/2943603264 conn(0x7f8ec806e490 msgr2=0x7f8ec8135400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:36.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.765+0000 7f8ecc991640 1 -- 172.21.15.89:0/2943603264 shutdown_connections 2024-09-16T16:46:36.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.765+0000 7f8ecc991640 1 -- 172.21.15.89:0/2943603264 wait complete. 2024-09-16T16:46:36.776 INFO:tasks.ceph:check_enable_crimson: True 2024-09-16T16:46:36.776 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-16T16:46:36.776 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-16T16:46:36.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.875+0000 7fdd62191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.881+0000 7fdd62191640 1 Processor -- start 2024-09-16T16:46:36.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.881+0000 7fdd62191640 1 -- start start 2024-09-16T16:46:36.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.882+0000 7fdd62191640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdd5c133bd0 0x7fdd5c138640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:36.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.882+0000 7fdd62191640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5c072d70 con 0x7fdd5c1330b0 2024-09-16T16:46:36.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.882+0000 7fdd62191640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7fdd5c09bd40 con 0x7fdd5c133bd0 2024-09-16T16:46:36.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.882+0000 7fdd5b7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fdd5c1330b0 0x7fdd5c1334c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:56988/0 (socket says 172.21.15.89:56988) 2024-09-16T16:46:36.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.882+0000 7fdd5b7fe640 1 -- 172.21.15.89:0/1593426013 learned_addr learned my addr 172.21.15.89:0/1593426013 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T16:46:36.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.882+0000 7fdd5affd640 1 --2- 172.21.15.89:0/1593426013 >> v2:172.21.15.89:3300/0 conn(0x7fdd5c133bd0 0x7fdd5c138640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:36.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.882+0000 7fdd5a7fc640 1 -- 172.21.15.89:0/1593426013 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282073725 0 0) 0x7fdd5c072d70 con 0x7fdd5c1330b0 2024-09-16T16:46:36.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.882+0000 7fdd5a7fc640 1 -- 172.21.15.89:0/1593426013 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd44003580 con 0x7fdd5c1330b0 2024-09-16T16:46:36.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.882+0000 7fdd5affd640 1 -- 172.21.15.89:0/1593426013 >> v1:172.21.15.89:6789/0 conn(0x7fdd5c1330b0 legacy=0x7fdd5c1334c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:36.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.882+0000 7fdd5affd640 1 -- 172.21.15.89:0/1593426013 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5c09d3f0 con 0x7fdd5c133bd0 2024-09-16T16:46:36.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.883+0000 7fdd5affd640 1 --2- 172.21.15.89:0/1593426013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd5c133bd0 0x7fdd5c138640 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1aa42c5fb804fc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:36.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.883+0000 7fdd5a7fc640 1 -- 172.21.15.89:0/1593426013 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdd4c009d90 con 0x7fdd5c133bd0 2024-09-16T16:46:36.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.883+0000 7fdd5a7fc640 1 -- 172.21.15.89:0/1593426013 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdd4c00e230 con 0x7fdd5c133bd0 2024-09-16T16:46:36.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.883+0000 7fdd5a7fc640 1 -- 172.21.15.89:0/1593426013 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdd4c00e4d0 con 0x7fdd5c133bd0 2024-09-16T16:46:36.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.883+0000 7fdd62191640 1 -- 172.21.15.89:0/1593426013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd5c133bd0 msgr2=0x7fdd5c138640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:36.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.883+0000 7fdd62191640 1 --2- 172.21.15.89:0/1593426013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd5c133bd0 0x7fdd5c138640 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:36.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.884+0000 7fdd62191640 1 -- 172.21.15.89:0/1593426013 shutdown_connections 2024-09-16T16:46:36.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.884+0000 7fdd62191640 1 --2- 172.21.15.89:0/1593426013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd5c133bd0 0x7fdd5c138640 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:36.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.884+0000 7fdd62191640 1 -- 172.21.15.89:0/1593426013 >> 172.21.15.89:0/1593426013 conn(0x7fdd5c0a25b0 msgr2=0x7fdd5c0a29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:36.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.884+0000 7fdd62191640 1 -- 172.21.15.89:0/1593426013 shutdown_connections 2024-09-16T16:46:36.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.884+0000 7fdd62191640 1 -- 172.21.15.89:0/1593426013 wait complete. 2024-09-16T16:46:36.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.884+0000 7fdd62191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.885+0000 7fdd62191640 1 Processor -- start 2024-09-16T16:46:36.886 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.885+0000 7fdd62191640 1 -- start start 2024-09-16T16:46:36.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.886+0000 7fdd62191640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd5c1330b0 0x7fdd5c11f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:36.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.886+0000 7fdd62191640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5c121e30 con 0x7fdd5c1330b0 2024-09-16T16:46:36.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.886+0000 7fdd5b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd5c1330b0 0x7fdd5c11f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:36.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.886+0000 7fdd5b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd5c1330b0 0x7fdd5c11f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36258/0 (socket says 172.21.15.89:36258) 2024-09-16T16:46:36.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.886+0000 7fdd5b7fe640 1 -- 172.21.15.89:0/790999174 learned_addr learned my addr 172.21.15.89:0/790999174 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:36.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.887+0000 7fdd5b7fe640 1 -- 172.21.15.89:0/790999174 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5c11ef60 con 0x7fdd5c1330b0 2024-09-16T16:46:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.887+0000 7fdd5b7fe640 1 --2- 172.21.15.89:0/790999174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd5c1330b0 0x7fdd5c11f320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.887+0000 7fdd43fff640 1 -- 172.21.15.89:0/790999174 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdd50005a60 con 0x7fdd5c1330b0 2024-09-16T16:46:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.887+0000 7fdd43fff640 1 -- 172.21.15.89:0/790999174 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdd50005bc0 con 0x7fdd5c1330b0 2024-09-16T16:46:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.887+0000 7fdd62191640 1 -- 172.21.15.89:0/790999174 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd5c122820 con 0x7fdd5c1330b0 2024-09-16T16:46:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.887+0000 7fdd43fff640 1 -- 172.21.15.89:0/790999174 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdd50005e60 con 0x7fdd5c1330b0 2024-09-16T16:46:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.887+0000 7fdd62191640 1 -- 172.21.15.89:0/790999174 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd5c11e8b0 con 0x7fdd5c1330b0 2024-09-16T16:46:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.887+0000 7fdd43fff640 1 -- 172.21.15.89:0/790999174 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fdd50007440 con 0x7fdd5c1330b0 2024-09-16T16:46:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.887+0000 7fdd43fff640 1 -- 172.21.15.89:0/790999174 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (crc 0 0 0) 0x7fdd5000f8e0 con 0x7fdd5c1330b0 2024-09-16T16:46:36.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.888+0000 7fdd62191640 1 -- 172.21.15.89:0/790999174 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd5c1334c0 con 0x7fdd5c1330b0 2024-09-16T16:46:36.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.890+0000 7fdd43fff640 1 -- 172.21.15.89:0/790999174 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fdd5000fb40 con 0x7fdd5c1330b0 2024-09-16T16:46:36.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:36.963+0000 7fdd62191640 1 -- 172.21.15.89:0/790999174 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) -- 0x7fdd5c0a1bd0 con 0x7fdd5c1330b0 2024-09-16T16:46:36.963 INFO:tasks.ceph.mon.a.smithi089.stderr:2024-09-16T16:46:36.963+0000 7fb8369f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-16T16:46:36.963 INFO:tasks.ceph.mon.a.smithi089.stderr:Please be aware that this feature is experimental, untested, 2024-09-16T16:46:36.964 INFO:tasks.ceph.mon.a.smithi089.stderr:unsupported, and may result in data corruption, data loss, 2024-09-16T16:46:36.964 INFO:tasks.ceph.mon.a.smithi089.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-16T16:46:36.964 INFO:tasks.ceph.mon.a.smithi089.stderr:feature with important data. 2024-09-16T16:46:36.964 INFO:tasks.ceph.mon.a.smithi089.stderr: 2024-09-16T16:46:37.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:37.765+0000 7fdd43fff640 1 -- 172.21.15.89:0/790999174 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) ==== 99+0+0 (crc 0 0 0) 0x7fdd5000fce0 con 0x7fdd5c1330b0 2024-09-16T16:46:37.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:37.766+0000 7fdd62191640 1 -- 172.21.15.89:0/790999174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd5c1330b0 msgr2=0x7fdd5c11f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:37.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:37.766+0000 7fdd62191640 1 --2- 172.21.15.89:0/790999174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd5c1330b0 0x7fdd5c11f320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:37.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:37.766+0000 7fdd62191640 1 -- 172.21.15.89:0/790999174 shutdown_connections 2024-09-16T16:46:37.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:37.766+0000 7fdd62191640 1 --2- 172.21.15.89:0/790999174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd5c1330b0 0x7fdd5c11f320 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:37.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:37.766+0000 7fdd62191640 1 -- 172.21.15.89:0/790999174 >> 172.21.15.89:0/790999174 conn(0x7fdd5c0a25b0 msgr2=0x7fdd5c09d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:37.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:37.766+0000 7fdd62191640 1 -- 172.21.15.89:0/790999174 shutdown_connections 2024-09-16T16:46:37.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:37.766+0000 7fdd62191640 1 -- 172.21.15.89:0/790999174 wait complete. 2024-09-16T16:46:37.777 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T16:46:37.778 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:46:37.778 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T16:46:37.803 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:46:37.803 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T16:46:37.867 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T16:46:37.868 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T16:46:37.892 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T16:46:37.893 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-16T16:46:37.958 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new fb249ec8-d1ab-4204-b3c2-71a37e34be86 0 2024-09-16T16:46:38.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.100+0000 7f3ea3111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:38.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.106+0000 7f3ea3111640 1 Processor -- start 2024-09-16T16:46:38.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.106+0000 7f3ea3111640 1 -- start start 2024-09-16T16:46:38.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.106+0000 7f3ea3111640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3e9c1191d0 0x7f3e9c1195e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:38.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.106+0000 7f3ea3111640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e9c114ff0 con 0x7f3e9c1144d0 2024-09-16T16:46:38.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.106+0000 7f3ea3111640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f3e9c115180 con 0x7f3e9c1191d0 2024-09-16T16:46:38.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.107+0000 7f3ea0ead640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3e9c1191d0 0x7f3e9c1195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:38.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.107+0000 7f3ea0ead640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3e9c1191d0 0x7f3e9c1195e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.177:54502/0 (socket says 172.21.15.177:54502) 2024-09-16T16:46:38.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.107+0000 7f3ea0ead640 1 -- 172.21.15.177:0/4206316694 learned_addr learned my addr 172.21.15.177:0/4206316694 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-16T16:46:38.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.107+0000 7f3e93fff640 1 --1- 172.21.15.177:0/4206316694 >> v1:172.21.15.89:6789/0 conn(0x7f3e9c1144d0 0x7f3e9c1148e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.177:58572/0 (socket says 172.21.15.177:58572) 2024-09-16T16:46:38.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.107+0000 7f3ea0ead640 1 -- 172.21.15.177:0/4206316694 >> v1:172.21.15.89:6789/0 conn(0x7f3e9c1144d0 legacy=0x7f3e9c1148e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:38.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.107+0000 7f3e937fe640 1 -- 172.21.15.177:0/4206316694 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 971835789 0 0) 0x7f3e9c114ff0 con 0x7f3e9c1144d0 2024-09-16T16:46:38.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.107+0000 7f3ea0ead640 1 -- 172.21.15.177:0/4206316694 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9c1152f0 con 0x7f3e9c1191d0 2024-09-16T16:46:38.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.108+0000 7f3ea0ead640 1 --2- 172.21.15.177:0/4206316694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e9c1191d0 0x7f3e9c1195e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a7315328920ec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:38.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.108+0000 7f3e937fe640 1 -- 172.21.15.177:0/4206316694 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3e98009e50 con 0x7f3e9c1191d0 2024-09-16T16:46:38.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.108+0000 7f3e937fe640 1 -- 172.21.15.177:0/4206316694 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3e9800e230 con 0x7f3e9c1191d0 2024-09-16T16:46:38.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.108+0000 7f3e937fe640 1 -- 172.21.15.177:0/4206316694 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3e9800e4d0 con 0x7f3e9c1191d0 2024-09-16T16:46:38.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.108+0000 7f3ea3111640 1 -- 172.21.15.177:0/4206316694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e9c1191d0 msgr2=0x7f3e9c1195e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:38.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.108+0000 7f3ea3111640 1 --2- 172.21.15.177:0/4206316694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e9c1191d0 0x7f3e9c1195e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:38.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.108+0000 7f3ea3111640 1 -- 172.21.15.177:0/4206316694 shutdown_connections 2024-09-16T16:46:38.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.108+0000 7f3ea3111640 1 --2- 172.21.15.177:0/4206316694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e9c1191d0 0x7f3e9c1195e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:38.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.108+0000 7f3ea3111640 1 -- 172.21.15.177:0/4206316694 >> 172.21.15.177:0/4206316694 conn(0x7f3e9c06ff60 msgr2=0x7f3e9c112db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:38.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.108+0000 7f3ea3111640 1 -- 172.21.15.177:0/4206316694 shutdown_connections 2024-09-16T16:46:38.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.109+0000 7f3ea3111640 1 -- 172.21.15.177:0/4206316694 wait complete. 2024-09-16T16:46:38.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.109+0000 7f3ea3111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:38.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.109+0000 7f3ea3111640 1 Processor -- start 2024-09-16T16:46:38.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.109+0000 7f3ea3111640 1 -- start start 2024-09-16T16:46:38.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.110+0000 7f3ea3111640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e9c1144d0 0x7f3e9c1a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:38.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.110+0000 7f3ea3111640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c1a9580 con 0x7f3e9c1144d0 2024-09-16T16:46:38.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.110+0000 7f3ea0ead640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e9c1144d0 0x7f3e9c1a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:38.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.110+0000 7f3ea0ead640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e9c1144d0 0x7f3e9c1a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.177:54516/0 (socket says 172.21.15.177:54516) 2024-09-16T16:46:38.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.110+0000 7f3ea0ead640 1 -- 172.21.15.177:0/3461743224 learned_addr learned my addr 172.21.15.177:0/3461743224 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-16T16:46:38.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.110+0000 7f3ea0ead640 1 -- 172.21.15.177:0/3461743224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9c1a96c0 con 0x7f3e9c1144d0 2024-09-16T16:46:38.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.111+0000 7f3ea0ead640 1 --2- 172.21.15.177:0/3461743224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e9c1144d0 0x7f3e9c1a8fb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:38.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.111+0000 7f3e917fa640 1 -- 172.21.15.177:0/3461743224 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3e9800ee60 con 0x7f3e9c1144d0 2024-09-16T16:46:38.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.111+0000 7f3e917fa640 1 -- 172.21.15.177:0/3461743224 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3e98015420 con 0x7f3e9c1144d0 2024-09-16T16:46:38.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.111+0000 7f3ea3111640 1 -- 172.21.15.177:0/3461743224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9c1a9910 con 0x7f3e9c1144d0 2024-09-16T16:46:38.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.111+0000 7f3e917fa640 1 -- 172.21.15.177:0/3461743224 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3e980156c0 con 0x7f3e9c1144d0 2024-09-16T16:46:38.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.111+0000 7f3ea3111640 1 -- 172.21.15.177:0/3461743224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e9c1ae810 con 0x7f3e9c1144d0 2024-09-16T16:46:38.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.111+0000 7f3e917fa640 1 -- 172.21.15.177:0/3461743224 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f3e98015c00 con 0x7f3e9c1144d0 2024-09-16T16:46:38.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.111+0000 7f3e917fa640 1 -- 172.21.15.177:0/3461743224 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 747+0+0 (crc 0 0 0) 0x7f3e980116d0 con 0x7f3e9c1144d0 2024-09-16T16:46:38.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.112+0000 7f3ea3111640 1 -- 172.21.15.177:0/3461743224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e9c1203d0 con 0x7f3e9c1144d0 2024-09-16T16:46:38.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.114+0000 7f3e917fa640 1 -- 172.21.15.177:0/3461743224 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f3e98011890 con 0x7f3e9c1144d0 2024-09-16T16:46:38.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.185+0000 7f3ea3111640 1 -- 172.21.15.177:0/3461743224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fb249ec8-d1ab-4204-b3c2-71a37e34be86", "id": 0} v 0) -- 0x7f3e9c1205b0 con 0x7f3e9c1144d0 2024-09-16T16:46:38.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.187+0000 7f3e917fa640 1 -- 172.21.15.177:0/3461743224 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb249ec8-d1ab-4204-b3c2-71a37e34be86", "id": 0}]=0 v4) ==== 112+0+2 (crc 0 0 0) 0x7f3e98011a30 con 0x7f3e9c1144d0 2024-09-16T16:46:38.187 INFO:teuthology.orchestra.run.smithi177.stdout:0 2024-09-16T16:46:38.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.188+0000 7f3ea3111640 1 -- 172.21.15.177:0/3461743224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e9c1144d0 msgr2=0x7f3e9c1a8fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:38.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.188+0000 7f3ea3111640 1 --2- 172.21.15.177:0/3461743224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e9c1144d0 0x7f3e9c1a8fb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:38.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.188+0000 7f3ea3111640 1 -- 172.21.15.177:0/3461743224 shutdown_connections 2024-09-16T16:46:38.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.188+0000 7f3ea3111640 1 --2- 172.21.15.177:0/3461743224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e9c1144d0 0x7f3e9c1a8fb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:38.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.188+0000 7f3ea3111640 1 -- 172.21.15.177:0/3461743224 >> 172.21.15.177:0/3461743224 conn(0x7f3e9c06ff60 msgr2=0x7f3e9c110da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:38.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.188+0000 7f3ea3111640 1 -- 172.21.15.177:0/3461743224 shutdown_connections 2024-09-16T16:46:38.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.188+0000 7f3ea3111640 1 -- 172.21.15.177:0/3461743224 wait complete. 2024-09-16T16:46:38.199 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new e2f9a1fc-171f-41e1-93e0-7415da80187d 1 2024-09-16T16:46:38.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.300+0000 7f25c4c97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:38.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.307+0000 7f25c4c97640 1 Processor -- start 2024-09-16T16:46:38.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.307+0000 7f25c4c97640 1 -- start start 2024-09-16T16:46:38.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.308+0000 7f25c4c97640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f25c01191d0 0x7f25c01195e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:38.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.308+0000 7f25c4c97640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25c0114ff0 con 0x7f25c01144d0 2024-09-16T16:46:38.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.308+0000 7f25c4c97640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f25c0115180 con 0x7f25c01191d0 2024-09-16T16:46:38.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.308+0000 7f25be59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f25c01191d0 0x7f25c01195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:38.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.308+0000 7f25be59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f25c01191d0 0x7f25c01195e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.177:54520/0 (socket says 172.21.15.177:54520) 2024-09-16T16:46:38.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.308+0000 7f25bdd9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f25c01144d0 0x7f25c01148e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.177:58580/0 (socket says 172.21.15.177:58580) 2024-09-16T16:46:38.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.308+0000 7f25be59c640 1 -- 172.21.15.177:0/773589994 learned_addr learned my addr 172.21.15.177:0/773589994 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-16T16:46:38.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.308+0000 7f25be59c640 1 -- 172.21.15.177:0/773589994 >> v1:172.21.15.89:6789/0 conn(0x7f25c01144d0 legacy=0x7f25c01148e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:38.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.308+0000 7f25be59c640 1 -- 172.21.15.177:0/773589994 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c01152f0 con 0x7f25c01191d0 2024-09-16T16:46:38.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.309+0000 7f25be59c640 1 --2- 172.21.15.177:0/773589994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c01191d0 0x7f25c01195e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d30e8e7d754676f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:38.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.309+0000 7f25bd59a640 1 -- 172.21.15.177:0/773589994 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f25b0009e50 con 0x7f25c01191d0 2024-09-16T16:46:38.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.309+0000 7f25bd59a640 1 -- 172.21.15.177:0/773589994 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f25b000e230 con 0x7f25c01191d0 2024-09-16T16:46:38.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.309+0000 7f25bd59a640 1 -- 172.21.15.177:0/773589994 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f25b000e4d0 con 0x7f25c01191d0 2024-09-16T16:46:38.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.310+0000 7f25c4c97640 1 -- 172.21.15.177:0/773589994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c01191d0 msgr2=0x7f25c01195e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:38.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.310+0000 7f25c4c97640 1 --2- 172.21.15.177:0/773589994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c01191d0 0x7f25c01195e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:38.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.310+0000 7f25c4c97640 1 -- 172.21.15.177:0/773589994 shutdown_connections 2024-09-16T16:46:38.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.310+0000 7f25c4c97640 1 --2- 172.21.15.177:0/773589994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c01191d0 0x7f25c01195e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:38.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.310+0000 7f25c4c97640 1 -- 172.21.15.177:0/773589994 >> 172.21.15.177:0/773589994 conn(0x7f25c006ff60 msgr2=0x7f25c0112db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:38.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.310+0000 7f25c4c97640 1 -- 172.21.15.177:0/773589994 shutdown_connections 2024-09-16T16:46:38.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.310+0000 7f25c4c97640 1 -- 172.21.15.177:0/773589994 wait complete. 2024-09-16T16:46:38.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.310+0000 7f25c4c97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:38.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.311+0000 7f25c4c97640 1 Processor -- start 2024-09-16T16:46:38.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.311+0000 7f25c4c97640 1 -- start start 2024-09-16T16:46:38.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.311+0000 7f25c4c97640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c01144d0 0x7f25c01a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:38.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.311+0000 7f25c4c97640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f25c01a96a0 con 0x7f25c01144d0 2024-09-16T16:46:38.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.312+0000 7f25be59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c01144d0 0x7f25c01a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:38.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.312+0000 7f25be59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c01144d0 0x7f25c01a90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.177:54536/0 (socket says 172.21.15.177:54536) 2024-09-16T16:46:38.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.312+0000 7f25be59c640 1 -- 172.21.15.177:0/144101476 learned_addr learned my addr 172.21.15.177:0/144101476 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-16T16:46:38.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.312+0000 7f25be59c640 1 -- 172.21.15.177:0/144101476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c01a97e0 con 0x7f25c01144d0 2024-09-16T16:46:38.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.312+0000 7f25be59c640 1 --2- 172.21.15.177:0/144101476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c01144d0 0x7f25c01a90d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:38.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.312+0000 7f25aeffd640 1 -- 172.21.15.177:0/144101476 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f25b000eea0 con 0x7f25c01144d0 2024-09-16T16:46:38.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.312+0000 7f25aeffd640 1 -- 172.21.15.177:0/144101476 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f25b0015420 con 0x7f25c01144d0 2024-09-16T16:46:38.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.312+0000 7f25c4c97640 1 -- 172.21.15.177:0/144101476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c01a9a30 con 0x7f25c01144d0 2024-09-16T16:46:38.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.312+0000 7f25aeffd640 1 -- 172.21.15.177:0/144101476 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f25b00156c0 con 0x7f25c01144d0 2024-09-16T16:46:38.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.312+0000 7f25c4c97640 1 -- 172.21.15.177:0/144101476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c01ae9b0 con 0x7f25c01144d0 2024-09-16T16:46:38.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.312+0000 7f25aeffd640 1 -- 172.21.15.177:0/144101476 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f25b0015c00 con 0x7f25c01144d0 2024-09-16T16:46:38.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.312+0000 7f25aeffd640 1 -- 172.21.15.177:0/144101476 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 862+0+0 (crc 0 0 0) 0x7f25b0011740 con 0x7f25c01144d0 2024-09-16T16:46:38.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.313+0000 7f25c4c97640 1 -- 172.21.15.177:0/144101476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c01203d0 con 0x7f25c01144d0 2024-09-16T16:46:38.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.316+0000 7f25aeffd640 1 -- 172.21.15.177:0/144101476 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f25b0011900 con 0x7f25c01144d0 2024-09-16T16:46:38.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.386+0000 7f25c4c97640 1 -- 172.21.15.177:0/144101476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e2f9a1fc-171f-41e1-93e0-7415da80187d", "id": 1} v 0) -- 0x7f25c01205b0 con 0x7f25c01144d0 2024-09-16T16:46:38.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.388+0000 7f25aeffd640 1 -- 172.21.15.177:0/144101476 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e2f9a1fc-171f-41e1-93e0-7415da80187d", "id": 1}]=0 v5) ==== 112+0+2 (crc 0 0 0) 0x7f25b0011aa0 con 0x7f25c01144d0 2024-09-16T16:46:38.388 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-09-16T16:46:38.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.389+0000 7f25c4c97640 1 -- 172.21.15.177:0/144101476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c01144d0 msgr2=0x7f25c01a90d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:38.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.389+0000 7f25c4c97640 1 --2- 172.21.15.177:0/144101476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c01144d0 0x7f25c01a90d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:38.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.389+0000 7f25c4c97640 1 -- 172.21.15.177:0/144101476 shutdown_connections 2024-09-16T16:46:38.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.389+0000 7f25c4c97640 1 --2- 172.21.15.177:0/144101476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25c01144d0 0x7f25c01a90d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:38.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.389+0000 7f25c4c97640 1 -- 172.21.15.177:0/144101476 >> 172.21.15.177:0/144101476 conn(0x7f25c006ff60 msgr2=0x7f25c0117960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:38.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.389+0000 7f25c4c97640 1 -- 172.21.15.177:0/144101476 shutdown_connections 2024-09-16T16:46:38.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.389+0000 7f25c4c97640 1 -- 172.21.15.177:0/144101476 wait complete. 2024-09-16T16:46:38.400 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new e95520d6-1eb4-43a1-b6db-21fe2f976fdc 2 2024-09-16T16:46:38.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.502+0000 7fed6904f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:38.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.508+0000 7fed6904f640 1 Processor -- start 2024-09-16T16:46:38.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.508+0000 7fed6904f640 1 -- start start 2024-09-16T16:46:38.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.508+0000 7fed6904f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fed641191d0 0x7fed641195e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:38.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.508+0000 7fed6904f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed64114ff0 con 0x7fed641144d0 2024-09-16T16:46:38.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.508+0000 7fed6904f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7fed64115180 con 0x7fed641191d0 2024-09-16T16:46:38.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.509+0000 7fed62d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fed641191d0 0x7fed641195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:38.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.509+0000 7fed6259c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fed641144d0 0x7fed641148e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.177:58586/0 (socket says 172.21.15.177:58586) 2024-09-16T16:46:38.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.509+0000 7fed62d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fed641191d0 0x7fed641195e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.177:54538/0 (socket says 172.21.15.177:54538) 2024-09-16T16:46:38.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.509+0000 7fed6259c640 1 -- 172.21.15.177:0/410703650 learned_addr learned my addr 172.21.15.177:0/410703650 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T16:46:38.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.509+0000 7fed62d9d640 1 -- 172.21.15.177:0/410703650 >> v1:172.21.15.89:6789/0 conn(0x7fed641144d0 legacy=0x7fed641148e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:38.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.509+0000 7fed62d9d640 1 -- 172.21.15.177:0/410703650 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed641152f0 con 0x7fed641191d0 2024-09-16T16:46:38.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.509+0000 7fed61d9b640 1 -- 172.21.15.177:0/410703650 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2961308083 0 0) 0x7fed64114ff0 con 0x7fed641144d0 2024-09-16T16:46:38.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.509+0000 7fed62d9d640 1 --2- 172.21.15.177:0/410703650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed641191d0 0x7fed641195e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5379c1b56f9001e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:38.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.509+0000 7fed61d9b640 1 -- 172.21.15.177:0/410703650 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed54009d90 con 0x7fed641191d0 2024-09-16T16:46:38.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.509+0000 7fed61d9b640 1 -- 172.21.15.177:0/410703650 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fed5400e230 con 0x7fed641191d0 2024-09-16T16:46:38.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.509+0000 7fed61d9b640 1 -- 172.21.15.177:0/410703650 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed5400e4d0 con 0x7fed641191d0 2024-09-16T16:46:38.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.510+0000 7fed6904f640 1 -- 172.21.15.177:0/410703650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed641191d0 msgr2=0x7fed641195e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:38.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.510+0000 7fed6904f640 1 --2- 172.21.15.177:0/410703650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed641191d0 0x7fed641195e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:38.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.510+0000 7fed6904f640 1 -- 172.21.15.177:0/410703650 shutdown_connections 2024-09-16T16:46:38.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.510+0000 7fed6904f640 1 --2- 172.21.15.177:0/410703650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed641191d0 0x7fed641195e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:38.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.510+0000 7fed6904f640 1 -- 172.21.15.177:0/410703650 >> 172.21.15.177:0/410703650 conn(0x7fed6406ff60 msgr2=0x7fed64112db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:38.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.510+0000 7fed6904f640 1 -- 172.21.15.177:0/410703650 shutdown_connections 2024-09-16T16:46:38.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.510+0000 7fed6904f640 1 -- 172.21.15.177:0/410703650 wait complete. 2024-09-16T16:46:38.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.510+0000 7fed6904f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:38.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.511+0000 7fed6904f640 1 Processor -- start 2024-09-16T16:46:38.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.511+0000 7fed6904f640 1 -- start start 2024-09-16T16:46:38.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.512+0000 7fed6904f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed641144d0 0x7fed641a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:38.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.512+0000 7fed6904f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fed641a96a0 con 0x7fed641144d0 2024-09-16T16:46:38.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.512+0000 7fed62d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed641144d0 0x7fed641a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:38.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.512+0000 7fed62d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed641144d0 0x7fed641a90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.177:54554/0 (socket says 172.21.15.177:54554) 2024-09-16T16:46:38.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.512+0000 7fed62d9d640 1 -- 172.21.15.177:0/2881403942 learned_addr learned my addr 172.21.15.177:0/2881403942 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-16T16:46:38.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.512+0000 7fed62d9d640 1 -- 172.21.15.177:0/2881403942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed641a97e0 con 0x7fed641144d0 2024-09-16T16:46:38.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.513+0000 7fed62d9d640 1 --2- 172.21.15.177:0/2881403942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed641144d0 0x7fed641a90d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:38.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.513+0000 7fed4b7fe640 1 -- 172.21.15.177:0/2881403942 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed54014750 con 0x7fed641144d0 2024-09-16T16:46:38.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.513+0000 7fed4b7fe640 1 -- 172.21.15.177:0/2881403942 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fed540148b0 con 0x7fed641144d0 2024-09-16T16:46:38.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.513+0000 7fed6904f640 1 -- 172.21.15.177:0/2881403942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed641a9a30 con 0x7fed641144d0 2024-09-16T16:46:38.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.513+0000 7fed4b7fe640 1 -- 172.21.15.177:0/2881403942 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed54014b50 con 0x7fed641144d0 2024-09-16T16:46:38.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.513+0000 7fed6904f640 1 -- 172.21.15.177:0/2881403942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed641ae930 con 0x7fed641144d0 2024-09-16T16:46:38.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.513+0000 7fed4b7fe640 1 -- 172.21.15.177:0/2881403942 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fed54013790 con 0x7fed641144d0 2024-09-16T16:46:38.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.513+0000 7fed4b7fe640 1 -- 172.21.15.177:0/2881403942 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 977+0+0 (crc 0 0 0) 0x7fed54019040 con 0x7fed641144d0 2024-09-16T16:46:38.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.514+0000 7fed6904f640 1 -- 172.21.15.177:0/2881403942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed641203d0 con 0x7fed641144d0 2024-09-16T16:46:38.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.517+0000 7fed4b7fe640 1 -- 172.21.15.177:0/2881403942 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fed54014cb0 con 0x7fed641144d0 2024-09-16T16:46:38.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.586+0000 7fed6904f640 1 -- 172.21.15.177:0/2881403942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e95520d6-1eb4-43a1-b6db-21fe2f976fdc", "id": 2} v 0) -- 0x7fed64120560 con 0x7fed641144d0 2024-09-16T16:46:38.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.590+0000 7fed4b7fe640 1 -- 172.21.15.177:0/2881403942 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e95520d6-1eb4-43a1-b6db-21fe2f976fdc", "id": 2}]=0 v6) ==== 112+0+2 (crc 0 0 0) 0x7fed54014e50 con 0x7fed641144d0 2024-09-16T16:46:38.590 INFO:teuthology.orchestra.run.smithi177.stdout:2 2024-09-16T16:46:38.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.591+0000 7fed6904f640 1 -- 172.21.15.177:0/2881403942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed641144d0 msgr2=0x7fed641a90d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:38.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.591+0000 7fed6904f640 1 --2- 172.21.15.177:0/2881403942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed641144d0 0x7fed641a90d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:38.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.591+0000 7fed6904f640 1 -- 172.21.15.177:0/2881403942 shutdown_connections 2024-09-16T16:46:38.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.591+0000 7fed6904f640 1 --2- 172.21.15.177:0/2881403942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed641144d0 0x7fed641a90d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:38.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.591+0000 7fed6904f640 1 -- 172.21.15.177:0/2881403942 >> 172.21.15.177:0/2881403942 conn(0x7fed6406ff60 msgr2=0x7fed64117820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:38.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.591+0000 7fed6904f640 1 -- 172.21.15.177:0/2881403942 shutdown_connections 2024-09-16T16:46:38.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.591+0000 7fed6904f640 1 -- 172.21.15.177:0/2881403942 wait complete. 2024-09-16T16:46:38.602 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 8c090f0a-e303-4058-bef0-2f9bfc8c6a6e 3 2024-09-16T16:46:38.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.704+0000 7f2fd1348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:38.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.711+0000 7f2fd1348640 1 Processor -- start 2024-09-16T16:46:38.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.711+0000 7f2fd1348640 1 -- start start 2024-09-16T16:46:38.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.711+0000 7f2fd1348640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2fcc1191d0 0x7f2fcc1195e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:38.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.711+0000 7f2fd1348640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fcc114ff0 con 0x7f2fcc1144d0 2024-09-16T16:46:38.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.711+0000 7f2fd1348640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f2fcc115180 con 0x7f2fcc1191d0 2024-09-16T16:46:38.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.711+0000 7f2fcaffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2fcc1191d0 0x7f2fcc1195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:38.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.712+0000 7f2fcaffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2fcc1191d0 0x7f2fcc1195e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.177:54566/0 (socket says 172.21.15.177:54566) 2024-09-16T16:46:38.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.712+0000 7f2fcaffd640 1 -- 172.21.15.177:0/1783131926 learned_addr learned my addr 172.21.15.177:0/1783131926 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-16T16:46:38.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.712+0000 7f2fca7fc640 1 --1- 172.21.15.177:0/1783131926 >> v1:172.21.15.89:6789/0 conn(0x7f2fcc1144d0 0x7f2fcc1148e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.177:58600/0 (socket says 172.21.15.177:58600) 2024-09-16T16:46:38.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.712+0000 7f2fcaffd640 1 -- 172.21.15.177:0/1783131926 >> v1:172.21.15.89:6789/0 conn(0x7f2fcc1144d0 legacy=0x7f2fcc1148e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:38.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.712+0000 7f2fcaffd640 1 -- 172.21.15.177:0/1783131926 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc1152f0 con 0x7f2fcc1191d0 2024-09-16T16:46:38.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.712+0000 7f2fc9ffb640 1 -- 172.21.15.177:0/1783131926 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4219312508 0 0) 0x7f2fcc114ff0 con 0x7f2fcc1144d0 2024-09-16T16:46:38.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.712+0000 7f2fcaffd640 1 --2- 172.21.15.177:0/1783131926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc1191d0 0x7f2fcc1195e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3c06074c730503 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:38.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.712+0000 7f2fc9ffb640 1 -- 172.21.15.177:0/1783131926 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2fbc009e50 con 0x7f2fcc1191d0 2024-09-16T16:46:38.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.712+0000 7f2fc9ffb640 1 -- 172.21.15.177:0/1783131926 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2fbc00e230 con 0x7f2fcc1191d0 2024-09-16T16:46:38.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.712+0000 7f2fc9ffb640 1 -- 172.21.15.177:0/1783131926 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2fbc00e4d0 con 0x7f2fcc1191d0 2024-09-16T16:46:38.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.713+0000 7f2fd1348640 1 -- 172.21.15.177:0/1783131926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc1191d0 msgr2=0x7f2fcc1195e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:38.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.713+0000 7f2fd1348640 1 --2- 172.21.15.177:0/1783131926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc1191d0 0x7f2fcc1195e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:38.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.713+0000 7f2fd1348640 1 -- 172.21.15.177:0/1783131926 shutdown_connections 2024-09-16T16:46:38.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.713+0000 7f2fd1348640 1 --2- 172.21.15.177:0/1783131926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc1191d0 0x7f2fcc1195e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:38.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.713+0000 7f2fd1348640 1 -- 172.21.15.177:0/1783131926 >> 172.21.15.177:0/1783131926 conn(0x7f2fcc06ff60 msgr2=0x7f2fcc112db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:38.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.713+0000 7f2fd1348640 1 -- 172.21.15.177:0/1783131926 shutdown_connections 2024-09-16T16:46:38.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.713+0000 7f2fd1348640 1 -- 172.21.15.177:0/1783131926 wait complete. 2024-09-16T16:46:38.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.713+0000 7f2fd1348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:38.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.714+0000 7f2fd1348640 1 Processor -- start 2024-09-16T16:46:38.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.714+0000 7f2fd1348640 1 -- start start 2024-09-16T16:46:38.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.714+0000 7f2fd1348640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc1144d0 0x7f2fcc1a8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:38.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.715+0000 7f2fd1348640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc1a9560 con 0x7f2fcc1144d0 2024-09-16T16:46:38.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.715+0000 7f2fcaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc1144d0 0x7f2fcc1a8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:38.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.715+0000 7f2fcaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc1144d0 0x7f2fcc1a8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.177:54576/0 (socket says 172.21.15.177:54576) 2024-09-16T16:46:38.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.715+0000 7f2fcaffd640 1 -- 172.21.15.177:0/4188171865 learned_addr learned my addr 172.21.15.177:0/4188171865 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-16T16:46:38.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.715+0000 7f2fcaffd640 1 -- 172.21.15.177:0/4188171865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc1a96a0 con 0x7f2fcc1144d0 2024-09-16T16:46:38.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.715+0000 7f2fcaffd640 1 --2- 172.21.15.177:0/4188171865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc1144d0 0x7f2fcc1a8f90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:38.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.716+0000 7f2fc37fe640 1 -- 172.21.15.177:0/4188171865 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2fbc015420 con 0x7f2fcc1144d0 2024-09-16T16:46:38.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.716+0000 7f2fc37fe640 1 -- 172.21.15.177:0/4188171865 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2fbc015580 con 0x7f2fcc1144d0 2024-09-16T16:46:38.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.716+0000 7f2fd1348640 1 -- 172.21.15.177:0/4188171865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fcc1a98f0 con 0x7f2fcc1144d0 2024-09-16T16:46:38.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.716+0000 7f2fc37fe640 1 -- 172.21.15.177:0/4188171865 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2fbc015820 con 0x7f2fcc1144d0 2024-09-16T16:46:38.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.716+0000 7f2fd1348640 1 -- 172.21.15.177:0/4188171865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fcc1ae870 con 0x7f2fcc1144d0 2024-09-16T16:46:38.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.716+0000 7f2fc37fe640 1 -- 172.21.15.177:0/4188171865 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f2fbc0143b0 con 0x7f2fcc1144d0 2024-09-16T16:46:38.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.716+0000 7f2fc37fe640 1 -- 172.21.15.177:0/4188171865 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1092+0+0 (crc 0 0 0) 0x7f2fbc011830 con 0x7f2fcc1144d0 2024-09-16T16:46:38.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.717+0000 7f2fd1348640 1 -- 172.21.15.177:0/4188171865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fcc1203d0 con 0x7f2fcc1144d0 2024-09-16T16:46:38.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.719+0000 7f2fc37fe640 1 -- 172.21.15.177:0/4188171865 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f2fbc011380 con 0x7f2fcc1144d0 2024-09-16T16:46:38.790 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.790+0000 7f2fd1348640 1 -- 172.21.15.177:0/4188171865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8c090f0a-e303-4058-bef0-2f9bfc8c6a6e", "id": 3} v 0) -- 0x7f2fcc1205b0 con 0x7f2fcc1144d0 2024-09-16T16:46:38.792 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.792+0000 7f2fc37fe640 1 -- 172.21.15.177:0/4188171865 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c090f0a-e303-4058-bef0-2f9bfc8c6a6e", "id": 3}]=0 v7) ==== 112+0+2 (crc 0 0 0) 0x7f2fbc0115a0 con 0x7f2fcc1144d0 2024-09-16T16:46:38.792 INFO:teuthology.orchestra.run.smithi177.stdout:3 2024-09-16T16:46:38.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.793+0000 7f2fd1348640 1 -- 172.21.15.177:0/4188171865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc1144d0 msgr2=0x7f2fcc1a8f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:38.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.793+0000 7f2fd1348640 1 --2- 172.21.15.177:0/4188171865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc1144d0 0x7f2fcc1a8f90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:38.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.793+0000 7f2fd1348640 1 -- 172.21.15.177:0/4188171865 shutdown_connections 2024-09-16T16:46:38.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.793+0000 7f2fd1348640 1 --2- 172.21.15.177:0/4188171865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fcc1144d0 0x7f2fcc1a8f90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:38.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.793+0000 7f2fd1348640 1 -- 172.21.15.177:0/4188171865 >> 172.21.15.177:0/4188171865 conn(0x7f2fcc06ff60 msgr2=0x7f2fcc1177a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:38.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.793+0000 7f2fd1348640 1 -- 172.21.15.177:0/4188171865 shutdown_connections 2024-09-16T16:46:38.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T16:46:38.793+0000 7f2fd1348640 1 -- 172.21.15.177:0/4188171865 wait complete. 2024-09-16T16:46:38.804 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-16T16:46:38.834 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T16:46:38.834 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T16:46:38.876 INFO:tasks.ceph.osd.0:Started 2024-09-16T16:46:38.877 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-16T16:46:38.905 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T16:46:38.905 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-16T16:46:38.948 INFO:tasks.ceph.osd.1:Started 2024-09-16T16:46:38.948 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-16T16:46:38.978 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T16:46:38.978 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-16T16:46:39.021 INFO:tasks.ceph.osd.2:Started 2024-09-16T16:46:39.021 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-16T16:46:39.052 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T16:46:39.053 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-16T16:46:39.095 INFO:tasks.ceph.osd.3:Started 2024-09-16T16:46:39.095 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:46:39.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.207+0000 7ff57ef11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:39.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.211+0000 7ff57ef11640 1 Processor -- start 2024-09-16T16:46:39.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.211+0000 7ff57ef11640 1 -- start start 2024-09-16T16:46:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.213+0000 7ff57ef11640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff578138720 0x7ff57813ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.213+0000 7ff57ef11640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff578133040 con 0x7ff578132520 2024-09-16T16:46:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.213+0000 7ff57ef11640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7ff57806f6d0 con 0x7ff578138720 2024-09-16T16:46:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.213+0000 7ff577fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff578138720 0x7ff57813ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.213+0000 7ff57ccad640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff578132520 0x7ff578132930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35822/0 (socket says 172.21.15.89:35822) 2024-09-16T16:46:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.213+0000 7ff57ccad640 1 -- 172.21.15.89:0/3987589753 learned_addr learned my addr 172.21.15.89:0/3987589753 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T16:46:39.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.213+0000 7ff577fff640 1 -- 172.21.15.89:0/3987589753 >> v1:172.21.15.89:6789/0 conn(0x7ff578132520 legacy=0x7ff578132930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:39.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.213+0000 7ff5777fe640 1 -- 172.21.15.89:0/3987589753 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1154589377 0 0) 0x7ff570001110 con 0x7ff578132520 2024-09-16T16:46:39.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.213+0000 7ff577fff640 1 -- 172.21.15.89:0/3987589753 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57806f3d0 con 0x7ff578138720 2024-09-16T16:46:39.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.213+0000 7ff577fff640 1 --2- 172.21.15.89:0/3987589753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff578138720 0x7ff57813ab40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247952a5205cfb68 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:39.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.213+0000 7ff5777fe640 1 -- 172.21.15.89:0/3987589753 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff56800e040 con 0x7ff578138720 2024-09-16T16:46:39.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.213+0000 7ff5777fe640 1 -- 172.21.15.89:0/3987589753 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff568007670 con 0x7ff578138720 2024-09-16T16:46:39.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.213+0000 7ff5777fe640 1 -- 172.21.15.89:0/3987589753 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff568007910 con 0x7ff578138720 2024-09-16T16:46:39.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.214+0000 7ff57ef11640 1 -- 172.21.15.89:0/3987589753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff578138720 msgr2=0x7ff57813ab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:39.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.214+0000 7ff57ef11640 1 --2- 172.21.15.89:0/3987589753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff578138720 0x7ff57813ab40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:39.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.214+0000 7ff57ef11640 1 -- 172.21.15.89:0/3987589753 shutdown_connections 2024-09-16T16:46:39.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.214+0000 7ff57ef11640 1 --2- 172.21.15.89:0/3987589753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff578138720 0x7ff57813ab40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:39.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.214+0000 7ff57ef11640 1 -- 172.21.15.89:0/3987589753 >> 172.21.15.89:0/3987589753 conn(0x7ff57806e490 msgr2=0x7ff57806e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:39.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.214+0000 7ff57ef11640 1 -- 172.21.15.89:0/3987589753 shutdown_connections 2024-09-16T16:46:39.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.214+0000 7ff57ef11640 1 -- 172.21.15.89:0/3987589753 wait complete. 2024-09-16T16:46:39.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.214+0000 7ff57ef11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:39.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.216+0000 7ff57ef11640 1 Processor -- start 2024-09-16T16:46:39.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.216+0000 7ff57ef11640 1 -- start start 2024-09-16T16:46:39.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.217+0000 7ff57ef11640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff578132520 0x7ff57811f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:39.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.217+0000 7ff57ef11640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff578122c10 con 0x7ff578132520 2024-09-16T16:46:39.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.217+0000 7ff57ccad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff578132520 0x7ff57811f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:39.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.217+0000 7ff57ccad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff578132520 0x7ff57811f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59416/0 (socket says 172.21.15.89:59416) 2024-09-16T16:46:39.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.217+0000 7ff57ccad640 1 -- 172.21.15.89:0/374404327 learned_addr learned my addr 172.21.15.89:0/374404327 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:39.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.217+0000 7ff57ccad640 1 -- 172.21.15.89:0/374404327 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57811f1c0 con 0x7ff578132520 2024-09-16T16:46:39.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.218+0000 7ff57ccad640 1 --2- 172.21.15.89:0/374404327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff578132520 0x7ff57811f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:39.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.218+0000 7ff5757fa640 1 -- 172.21.15.89:0/374404327 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff570004b80 con 0x7ff578132520 2024-09-16T16:46:39.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.218+0000 7ff5757fa640 1 -- 172.21.15.89:0/374404327 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff570004ce0 con 0x7ff578132520 2024-09-16T16:46:39.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.218+0000 7ff5757fa640 1 -- 172.21.15.89:0/374404327 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff570007120 con 0x7ff578132520 2024-09-16T16:46:39.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.218+0000 7ff57ef11640 1 -- 172.21.15.89:0/374404327 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff578120790 con 0x7ff578132520 2024-09-16T16:46:39.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.218+0000 7ff57ef11640 1 -- 172.21.15.89:0/374404327 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5781220c0 con 0x7ff578132520 2024-09-16T16:46:39.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.218+0000 7ff5757fa640 1 -- 172.21.15.89:0/374404327 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7ff57000c520 con 0x7ff578132520 2024-09-16T16:46:39.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.218+0000 7ff5757fa640 1 -- 172.21.15.89:0/374404327 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7ff57000fc00 con 0x7ff578132520 2024-09-16T16:46:39.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.219+0000 7ff57ef11640 1 -- 172.21.15.89:0/374404327 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff578120f90 con 0x7ff578132520 2024-09-16T16:46:39.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.221+0000 7ff5757fa640 1 -- 172.21.15.89:0/374404327 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7ff578133040 con 0x7ff578132520 2024-09-16T16:46:39.283 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.283+0000 7ff57ef11640 1 -- 172.21.15.89:0/374404327 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff57806a300 con 0x7ff578132520 2024-09-16T16:46:39.284 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.283+0000 7ff5757fa640 1 -- 172.21.15.89:0/374404327 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7ff570007660 con 0x7ff578132520 2024-09-16T16:46:39.284 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:39.284 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":7,"fsid":"747238a8-71dc-4442-98b8-945fe8c55201","created":"2024-09-16T16:46:36.683580+0000","modified":"2024-09-16T16:46:38.791805+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T16:46:38.791805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"fb249ec8-d1ab-4204-b3c2-71a37e34be86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e2f9a1fc-171f-41e1-93e0-7415da80187d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e95520d6-1eb4-43a1-b6db-21fe2f976fdc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8c090f0a-e303-4058-bef0-2f9bfc8c6a6e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:46:39.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.284+0000 7ff57ef11640 1 -- 172.21.15.89:0/374404327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff578132520 msgr2=0x7ff57811f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:39.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.284+0000 7ff57ef11640 1 --2- 172.21.15.89:0/374404327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff578132520 0x7ff57811f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:39.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.284+0000 7ff57ef11640 1 -- 172.21.15.89:0/374404327 shutdown_connections 2024-09-16T16:46:39.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.284+0000 7ff57ef11640 1 --2- 172.21.15.89:0/374404327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff578132520 0x7ff57811f580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:39.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.284+0000 7ff57ef11640 1 -- 172.21.15.89:0/374404327 >> 172.21.15.89:0/374404327 conn(0x7ff57806e490 msgr2=0x7ff5780a3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:39.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.284+0000 7ff57ef11640 1 -- 172.21.15.89:0/374404327 shutdown_connections 2024-09-16T16:46:39.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:39.284+0000 7ff57ef11640 1 -- 172.21.15.89:0/374404327 wait complete. 2024-09-16T16:46:39.296 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T16:46:39.296 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T16:46:39.698 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T16:46:39.801 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.796+0000 7fce714ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:39.801 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.801+0000 7fce714ec640 1 Processor -- start 2024-09-16T16:46:39.801 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.801+0000 7fce714ec640 1 -- start start 2024-09-16T16:46:39.803 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.802+0000 7fce714ec640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fce6c135d80 0x7fce6c13ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:39.804 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.802+0000 7fce714ec640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6c06a7b0 con 0x7fce6c0a0c70 2024-09-16T16:46:39.804 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.802+0000 7fce714ec640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7fce6c09f9f0 con 0x7fce6c135d80 2024-09-16T16:46:39.804 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.802+0000 7fce6a7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fce6c135d80 0x7fce6c13ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:39.804 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.802+0000 7fce6affd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fce6c0a0c70 0x7fce6c135670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35836/0 (socket says 172.21.15.89:35836) 2024-09-16T16:46:39.804 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.802+0000 7fce6affd640 1 -- 172.21.15.89:0/4135937159 learned_addr learned my addr 172.21.15.89:0/4135937159 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T16:46:39.804 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.803+0000 7fce6a7fc640 1 -- 172.21.15.89:0/4135937159 >> v1:172.21.15.89:6789/0 conn(0x7fce6c0a0c70 legacy=0x7fce6c135670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:39.804 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.803+0000 7fce6a7fc640 1 -- 172.21.15.89:0/4135937159 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6c09f6e0 con 0x7fce6c135d80 2024-09-16T16:46:39.804 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.803+0000 7fce6a7fc640 1 --2- 172.21.15.89:0/4135937159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce6c135d80 0x7fce6c13ac50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1483f4297440359 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:39.804 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.803+0000 7fce69ffb640 1 -- 172.21.15.89:0/4135937159 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce54009d80 con 0x7fce6c135d80 2024-09-16T16:46:39.804 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.803+0000 7fce69ffb640 1 -- 172.21.15.89:0/4135937159 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fce5400e230 con 0x7fce6c135d80 2024-09-16T16:46:39.804 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.803+0000 7fce69ffb640 1 -- 172.21.15.89:0/4135937159 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce5400e4d0 con 0x7fce6c135d80 2024-09-16T16:46:39.805 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.804+0000 7fce714ec640 1 -- 172.21.15.89:0/4135937159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce6c135d80 msgr2=0x7fce6c13ac50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:39.805 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.804+0000 7fce714ec640 1 --2- 172.21.15.89:0/4135937159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce6c135d80 0x7fce6c13ac50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:39.805 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.804+0000 7fce714ec640 1 -- 172.21.15.89:0/4135937159 shutdown_connections 2024-09-16T16:46:39.806 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.804+0000 7fce714ec640 1 --2- 172.21.15.89:0/4135937159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce6c135d80 0x7fce6c13ac50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:39.806 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.804+0000 7fce714ec640 1 -- 172.21.15.89:0/4135937159 >> 172.21.15.89:0/4135937159 conn(0x7fce6c0a5f60 msgr2=0x7fce6c0a6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:39.806 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.804+0000 7fce714ec640 1 -- 172.21.15.89:0/4135937159 shutdown_connections 2024-09-16T16:46:39.806 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.804+0000 7fce714ec640 1 -- 172.21.15.89:0/4135937159 wait complete. 2024-09-16T16:46:39.806 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.804+0000 7fce714ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:39.806 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.806+0000 7fce714ec640 1 Processor -- start 2024-09-16T16:46:39.807 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.806+0000 7fce714ec640 1 -- start start 2024-09-16T16:46:39.808 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.807+0000 7fce714ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce6c135d80 0x7fce6c091ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:39.808 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.807+0000 7fce714ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c09ef20 con 0x7fce6c135d80 2024-09-16T16:46:39.809 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.807+0000 7fce6affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce6c135d80 0x7fce6c091ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:39.809 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.807+0000 7fce6affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce6c135d80 0x7fce6c091ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59440/0 (socket says 172.21.15.89:59440) 2024-09-16T16:46:39.809 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.807+0000 7fce6affd640 1 -- 172.21.15.89:0/2776582179 learned_addr learned my addr 172.21.15.89:0/2776582179 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:39.809 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.807+0000 7fce6affd640 1 -- 172.21.15.89:0/2776582179 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6c09f1e0 con 0x7fce6c135d80 2024-09-16T16:46:39.809 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.807+0000 7fce6affd640 1 --2- 172.21.15.89:0/2776582179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce6c135d80 0x7fce6c091ab0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:39.809 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.808+0000 7fce637fe640 1 -- 172.21.15.89:0/2776582179 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce5c005a60 con 0x7fce6c135d80 2024-09-16T16:46:39.809 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.808+0000 7fce637fe640 1 -- 172.21.15.89:0/2776582179 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fce5c005bc0 con 0x7fce6c135d80 2024-09-16T16:46:39.809 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.808+0000 7fce637fe640 1 -- 172.21.15.89:0/2776582179 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce5c005e60 con 0x7fce6c135d80 2024-09-16T16:46:39.809 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.808+0000 7fce714ec640 1 -- 172.21.15.89:0/2776582179 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6c131a90 con 0x7fce6c135d80 2024-09-16T16:46:39.809 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.808+0000 7fce714ec640 1 -- 172.21.15.89:0/2776582179 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce6c134bc0 con 0x7fce6c135d80 2024-09-16T16:46:39.809 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.808+0000 7fce637fe640 1 -- 172.21.15.89:0/2776582179 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fce5c00cb80 con 0x7fce6c135d80 2024-09-16T16:46:39.809 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.808+0000 7fce637fe640 1 -- 172.21.15.89:0/2776582179 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7fce5c00fc00 con 0x7fce6c135d80 2024-09-16T16:46:39.810 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.809+0000 7fce714ec640 1 -- 172.21.15.89:0/2776582179 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce6c0a0c70 con 0x7fce6c135d80 2024-09-16T16:46:39.811 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.811+0000 7fce637fe640 1 -- 172.21.15.89:0/2776582179 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fce5c00fe60 con 0x7fce6c135d80 2024-09-16T16:46:39.873 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.872+0000 7fce714ec640 1 -- 172.21.15.89:0/2776582179 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce6c132820 con 0x7fce6c135d80 2024-09-16T16:46:39.873 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.872+0000 7fce637fe640 1 -- 172.21.15.89:0/2776582179 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7fce5c00f6e0 con 0x7fce6c135d80 2024-09-16T16:46:39.873 INFO:teuthology.misc.health.smithi089.stdout: 2024-09-16T16:46:39.873 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":7,"fsid":"747238a8-71dc-4442-98b8-945fe8c55201","created":"2024-09-16T16:46:36.683580+0000","modified":"2024-09-16T16:46:38.791805+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T16:46:38.791805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"fb249ec8-d1ab-4204-b3c2-71a37e34be86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e2f9a1fc-171f-41e1-93e0-7415da80187d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e95520d6-1eb4-43a1-b6db-21fe2f976fdc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8c090f0a-e303-4058-bef0-2f9bfc8c6a6e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:46:39.874 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.873+0000 7fce714ec640 1 -- 172.21.15.89:0/2776582179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce6c135d80 msgr2=0x7fce6c091ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:39.874 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.873+0000 7fce714ec640 1 --2- 172.21.15.89:0/2776582179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce6c135d80 0x7fce6c091ab0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:39.874 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.873+0000 7fce714ec640 1 -- 172.21.15.89:0/2776582179 shutdown_connections 2024-09-16T16:46:39.875 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.873+0000 7fce714ec640 1 --2- 172.21.15.89:0/2776582179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce6c135d80 0x7fce6c091ab0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:39.875 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.873+0000 7fce714ec640 1 -- 172.21.15.89:0/2776582179 >> 172.21.15.89:0/2776582179 conn(0x7fce6c0a5f60 msgr2=0x7fce6c0a3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:39.875 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.873+0000 7fce714ec640 1 -- 172.21.15.89:0/2776582179 shutdown_connections 2024-09-16T16:46:39.875 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:39.873+0000 7fce714ec640 1 -- 172.21.15.89:0/2776582179 wait complete. 2024-09-16T16:46:39.883 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-16T16:46:42.144 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T16:46:42.143+0000 7f83561d7640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-16T16:46:46.287 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T16:46:46.388 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.384+0000 7f6963751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:46.389 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.388+0000 7f6963751640 1 Processor -- start 2024-09-16T16:46:46.389 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.388+0000 7f6963751640 1 -- start start 2024-09-16T16:46:46.391 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.389+0000 7f6963751640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f695c132f40 0x7f695c137730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:46.392 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.389+0000 7f6963751640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f695c0707e0 con 0x7f695c09b3d0 2024-09-16T16:46:46.392 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.389+0000 7f6963751640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f695c06c4a0 con 0x7f695c132f40 2024-09-16T16:46:46.392 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.389+0000 7f6960cec640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f695c132f40 0x7f695c137730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:46.392 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.389+0000 7f69614ed640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f695c09b3d0 0x7f695c132830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35842/0 (socket says 172.21.15.89:35842) 2024-09-16T16:46:46.392 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.389+0000 7f69614ed640 1 -- 172.21.15.89:0/931053482 learned_addr learned my addr 172.21.15.89:0/931053482 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T16:46:46.392 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.390+0000 7f6960cec640 1 -- 172.21.15.89:0/931053482 >> v1:172.21.15.89:6789/0 conn(0x7f695c09b3d0 legacy=0x7f695c132830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:46.392 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.390+0000 7f6953fff640 1 -- 172.21.15.89:0/931053482 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1574528998 0 0) 0x7f695c0707e0 con 0x7f695c09b3d0 2024-09-16T16:46:46.392 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.390+0000 7f6960cec640 1 -- 172.21.15.89:0/931053482 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695c133350 con 0x7f695c132f40 2024-09-16T16:46:46.392 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.390+0000 7f6960cec640 1 --2- 172.21.15.89:0/931053482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f695c132f40 0x7f695c137730 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276e3840cca5efe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:46.392 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.390+0000 7f6953fff640 1 -- 172.21.15.89:0/931053482 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f694c009d90 con 0x7f695c132f40 2024-09-16T16:46:46.392 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.390+0000 7f6953fff640 1 -- 172.21.15.89:0/931053482 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f694c00e230 con 0x7f695c132f40 2024-09-16T16:46:46.392 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.390+0000 7f6953fff640 1 -- 172.21.15.89:0/931053482 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f694c00e4d0 con 0x7f695c132f40 2024-09-16T16:46:46.394 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.391+0000 7f6963751640 1 -- 172.21.15.89:0/931053482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f695c132f40 msgr2=0x7f695c137730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:46.394 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.391+0000 7f6963751640 1 --2- 172.21.15.89:0/931053482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f695c132f40 0x7f695c137730 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:46.394 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.391+0000 7f6963751640 1 -- 172.21.15.89:0/931053482 shutdown_connections 2024-09-16T16:46:46.394 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.391+0000 7f6963751640 1 --2- 172.21.15.89:0/931053482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f695c132f40 0x7f695c137730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:46.394 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.391+0000 7f6963751640 1 -- 172.21.15.89:0/931053482 >> 172.21.15.89:0/931053482 conn(0x7f695c0a1f00 msgr2=0x7f695c0a2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:46.394 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.391+0000 7f6963751640 1 -- 172.21.15.89:0/931053482 shutdown_connections 2024-09-16T16:46:46.394 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.391+0000 7f6963751640 1 -- 172.21.15.89:0/931053482 wait complete. 2024-09-16T16:46:46.394 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.391+0000 7f6963751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:46.394 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.392+0000 7f6963751640 1 Processor -- start 2024-09-16T16:46:46.394 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.392+0000 7f6963751640 1 -- start start 2024-09-16T16:46:46.396 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.393+0000 7f6963751640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f695c09b3d0 0x7f695c12d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:46.396 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.393+0000 7f6963751640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f695c12e0b0 con 0x7f695c09b3d0 2024-09-16T16:46:46.396 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.393+0000 7f69614ed640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f695c09b3d0 0x7f695c12d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:46.396 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.393+0000 7f69614ed640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f695c09b3d0 0x7f695c12d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59464/0 (socket says 172.21.15.89:59464) 2024-09-16T16:46:46.396 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.393+0000 7f69614ed640 1 -- 172.21.15.89:0/1961377864 learned_addr learned my addr 172.21.15.89:0/1961377864 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:46.396 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.394+0000 7f69614ed640 1 -- 172.21.15.89:0/1961377864 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695c0744c0 con 0x7f695c09b3d0 2024-09-16T16:46:46.396 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.394+0000 7f69614ed640 1 --2- 172.21.15.89:0/1961377864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f695c09b3d0 0x7f695c12d920 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:46.396 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.394+0000 7f6951ffb640 1 -- 172.21.15.89:0/1961377864 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6958004b80 con 0x7f695c09b3d0 2024-09-16T16:46:46.397 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.394+0000 7f6951ffb640 1 -- 172.21.15.89:0/1961377864 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6958004ce0 con 0x7f695c09b3d0 2024-09-16T16:46:46.397 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.394+0000 7f6951ffb640 1 -- 172.21.15.89:0/1961377864 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6958007120 con 0x7f695c09b3d0 2024-09-16T16:46:46.397 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.394+0000 7f6963751640 1 -- 172.21.15.89:0/1961377864 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f695c074a50 con 0x7f695c09b3d0 2024-09-16T16:46:46.397 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.394+0000 7f6963751640 1 -- 172.21.15.89:0/1961377864 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f695c12f6c0 con 0x7f695c09b3d0 2024-09-16T16:46:46.398 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.395+0000 7f6963751640 1 -- 172.21.15.89:0/1961377864 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f695c138f10 con 0x7f695c09b3d0 2024-09-16T16:46:46.398 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.395+0000 7f6951ffb640 1 -- 172.21.15.89:0/1961377864 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7f69580072d0 con 0x7f695c09b3d0 2024-09-16T16:46:46.398 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.396+0000 7f6951ffb640 1 --2- 172.21.15.89:0/1961377864 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f694003e8a0 0x7f6940040db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:46.398 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.396+0000 7f6951ffb640 1 -- 172.21.15.89:0/1961377864 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2319+0+0 (crc 0 0 0) 0x7f695804f540 con 0x7f695c09b3d0 2024-09-16T16:46:46.398 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.396+0000 7f6960cec640 1 --2- 172.21.15.89:0/1961377864 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f694003e8a0 0x7f6940040db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:46.398 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.397+0000 7f6960cec640 1 --2- 172.21.15.89:0/1961377864 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f694003e8a0 0x7f6940040db0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:46.403 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.402+0000 7f6951ffb640 1 -- 172.21.15.89:0/1961377864 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f695800f230 con 0x7f695c09b3d0 2024-09-16T16:46:46.588 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.587+0000 7f6963751640 1 -- 172.21.15.89:0/1961377864 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f695c132830 con 0x7f695c09b3d0 2024-09-16T16:46:46.589 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.587+0000 7f6951ffb640 1 -- 172.21.15.89:0/1961377864 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+6939 (crc 0 0 0) 0x7f695800a0c0 con 0x7f695c09b3d0 2024-09-16T16:46:46.589 INFO:teuthology.misc.health.smithi089.stdout: 2024-09-16T16:46:46.589 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":11,"fsid":"747238a8-71dc-4442-98b8-945fe8c55201","created":"2024-09-16T16:46:36.683580+0000","modified":"2024-09-16T16:46:46.202523+0000","last_up_change":"2024-09-16T16:46:43.196279+0000","last_in_change":"2024-09-16T16:46:38.791805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:45.169648+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb249ec8-d1ab-4204-b3c2-71a37e34be86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6801","nonce":3499031688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":3499031688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":3499031688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6807","nonce":3499031688}]},"public_addr":"172.21.15.89:6801/3499031688","cluster_addr":"172.21.15.89:6800/3499031688","heartbeat_back_addr":"172.21.15.89:6806/3499031688","heartbeat_front_addr":"172.21.15.89:6807/3499031688","state":["exists","up"]},{"osd":1,"uuid":"e2f9a1fc-171f-41e1-93e0-7415da80187d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6803","nonce":245700216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":245700216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6805","nonce":245700216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":245700216}]},"public_addr":"172.21.15.89:6803/245700216","cluster_addr":"172.21.15.89:6802/245700216","heartbeat_back_addr":"172.21.15.89:6805/245700216","heartbeat_front_addr":"172.21.15.89:6804/245700216","state":["exists","up"]},{"osd":2,"uuid":"e95520d6-1eb4-43a1-b6db-21fe2f976fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":229775330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":229775330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":229775330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":229775330}]},"public_addr":"172.21.15.177:6806/229775330","cluster_addr":"172.21.15.177:6805/229775330","heartbeat_back_addr":"172.21.15.177:6814/229775330","heartbeat_front_addr":"172.21.15.177:6813/229775330","state":["exists","up"]},{"osd":3,"uuid":"8c090f0a-e303-4058-bef0-2f9bfc8c6a6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":75130198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":75130198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":75130198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":75130198}]},"public_addr":"172.21.15.177:6807/75130198","cluster_addr":"172.21.15.177:6804/75130198","heartbeat_back_addr":"172.21.15.177:6810/75130198","heartbeat_front_addr":"172.21.15.177:6809/75130198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:46:46.592 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.590+0000 7f6963751640 1 -- 172.21.15.89:0/1961377864 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f694003e8a0 msgr2=0x7f6940040db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:46.592 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.590+0000 7f6963751640 1 --2- 172.21.15.89:0/1961377864 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f694003e8a0 0x7f6940040db0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:46.592 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.590+0000 7f6963751640 1 -- 172.21.15.89:0/1961377864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f695c09b3d0 msgr2=0x7f695c12d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:46.592 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.590+0000 7f6963751640 1 --2- 172.21.15.89:0/1961377864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f695c09b3d0 0x7f695c12d920 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:46.592 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.590+0000 7f6963751640 1 -- 172.21.15.89:0/1961377864 shutdown_connections 2024-09-16T16:46:46.592 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.590+0000 7f6963751640 1 --2- 172.21.15.89:0/1961377864 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f694003e8a0 0x7f6940040db0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:46.592 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.590+0000 7f6963751640 1 --2- 172.21.15.89:0/1961377864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f695c09b3d0 0x7f695c12d920 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:46.592 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.590+0000 7f6963751640 1 -- 172.21.15.89:0/1961377864 >> 172.21.15.89:0/1961377864 conn(0x7f695c0a1f00 msgr2=0x7f695c09f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:46.592 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.590+0000 7f6963751640 1 -- 172.21.15.89:0/1961377864 shutdown_connections 2024-09-16T16:46:46.592 INFO:teuthology.misc.health.smithi089.stderr:2024-09-16T16:46:46.590+0000 7f6963751640 1 -- 172.21.15.89:0/1961377864 wait complete. 2024-09-16T16:46:46.601 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-16T16:46:46.601 INFO:tasks.ceph:Creating RBD pool 2024-09-16T16:46:46.601 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T16:46:46.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.704+0000 7f0b57951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:46.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.712+0000 7f0b57951640 1 Processor -- start 2024-09-16T16:46:46.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.712+0000 7f0b57951640 1 -- start start 2024-09-16T16:46:46.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.713+0000 7f0b57951640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0b50135e20 0x7f0b5013a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:46.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.713+0000 7f0b57951640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b500a1bc0 con 0x7f0b50135300 2024-09-16T16:46:46.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.713+0000 7f0b57951640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f0b5006f800 con 0x7f0b50135e20 2024-09-16T16:46:46.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.714+0000 7f0b54eec640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0b50135e20 0x7f0b5013a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:46.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.714+0000 7f0b556ed640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0b50135300 0x7f0b50135710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35856/0 (socket says 172.21.15.89:35856) 2024-09-16T16:46:46.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.714+0000 7f0b556ed640 1 -- 172.21.15.89:0/1891244875 learned_addr learned my addr 172.21.15.89:0/1891244875 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T16:46:46.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.714+0000 7f0b54eec640 1 -- 172.21.15.89:0/1891244875 >> v1:172.21.15.89:6789/0 conn(0x7f0b50135300 legacy=0x7f0b50135710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:46.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.714+0000 7f0b54eec640 1 -- 172.21.15.89:0/1891244875 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5006f2b0 con 0x7f0b50135e20 2024-09-16T16:46:46.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.714+0000 7f0b54eec640 1 --2- 172.21.15.89:0/1891244875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b50135e20 0x7f0b5013a870 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebac0623270d4ce server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:46.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.739+0000 7f0b47fff640 1 -- 172.21.15.89:0/1891244875 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b40009d90 con 0x7f0b50135e20 2024-09-16T16:46:46.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.739+0000 7f0b47fff640 1 -- 172.21.15.89:0/1891244875 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0b4000e230 con 0x7f0b50135e20 2024-09-16T16:46:46.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.739+0000 7f0b47fff640 1 -- 172.21.15.89:0/1891244875 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b4000e4d0 con 0x7f0b50135e20 2024-09-16T16:46:46.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.740+0000 7f0b57951640 1 -- 172.21.15.89:0/1891244875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b50135e20 msgr2=0x7f0b5013a870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:46.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.740+0000 7f0b57951640 1 --2- 172.21.15.89:0/1891244875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b50135e20 0x7f0b5013a870 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:46.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.740+0000 7f0b57951640 1 -- 172.21.15.89:0/1891244875 shutdown_connections 2024-09-16T16:46:46.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.740+0000 7f0b57951640 1 --2- 172.21.15.89:0/1891244875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b50135e20 0x7f0b5013a870 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:46.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.740+0000 7f0b57951640 1 -- 172.21.15.89:0/1891244875 >> 172.21.15.89:0/1891244875 conn(0x7f0b5006e3e0 msgr2=0x7f0b5006e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:46.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.740+0000 7f0b57951640 1 -- 172.21.15.89:0/1891244875 shutdown_connections 2024-09-16T16:46:46.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.740+0000 7f0b57951640 1 -- 172.21.15.89:0/1891244875 wait complete. 2024-09-16T16:46:46.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.741+0000 7f0b57951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:46.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.742+0000 7f0b57951640 1 Processor -- start 2024-09-16T16:46:46.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.742+0000 7f0b57951640 1 -- start start 2024-09-16T16:46:46.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.743+0000 7f0b57951640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b50135300 0x7f0b5011fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:46.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.743+0000 7f0b57951640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0b50121210 con 0x7f0b50135300 2024-09-16T16:46:46.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.743+0000 7f0b556ed640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b50135300 0x7f0b5011fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:46.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.743+0000 7f0b556ed640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b50135300 0x7f0b5011fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59480/0 (socket says 172.21.15.89:59480) 2024-09-16T16:46:46.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.743+0000 7f0b556ed640 1 -- 172.21.15.89:0/2890628381 learned_addr learned my addr 172.21.15.89:0/2890628381 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:46.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.744+0000 7f0b556ed640 1 -- 172.21.15.89:0/2890628381 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b500a38d0 con 0x7f0b50135300 2024-09-16T16:46:46.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.744+0000 7f0b556ed640 1 --2- 172.21.15.89:0/2890628381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b50135300 0x7f0b5011fed0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:46.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.744+0000 7f0b45ffb640 1 -- 172.21.15.89:0/2890628381 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b4c005a60 con 0x7f0b50135300 2024-09-16T16:46:46.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.744+0000 7f0b45ffb640 1 -- 172.21.15.89:0/2890628381 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0b4c005bc0 con 0x7f0b50135300 2024-09-16T16:46:46.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.744+0000 7f0b57951640 1 -- 172.21.15.89:0/2890628381 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b50123b70 con 0x7f0b50135300 2024-09-16T16:46:46.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.744+0000 7f0b45ffb640 1 -- 172.21.15.89:0/2890628381 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b4c005e60 con 0x7f0b50135300 2024-09-16T16:46:46.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.744+0000 7f0b57951640 1 -- 172.21.15.89:0/2890628381 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b50121910 con 0x7f0b50135300 2024-09-16T16:46:46.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.745+0000 7f0b57951640 1 -- 172.21.15.89:0/2890628381 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b5006a300 con 0x7f0b50135300 2024-09-16T16:46:46.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.745+0000 7f0b45ffb640 1 -- 172.21.15.89:0/2890628381 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7f0b4c00c7f0 con 0x7f0b50135300 2024-09-16T16:46:46.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.745+0000 7f0b45ffb640 1 --2- 172.21.15.89:0/2890628381 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f0b3403e8a0 0x7f0b34040db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:46.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.745+0000 7f0b45ffb640 1 -- 172.21.15.89:0/2890628381 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2319+0+0 (crc 0 0 0) 0x7f0b4c04f350 con 0x7f0b50135300 2024-09-16T16:46:46.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.746+0000 7f0b54eec640 1 --2- 172.21.15.89:0/2890628381 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f0b3403e8a0 0x7f0b34040db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:46.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.746+0000 7f0b54eec640 1 --2- 172.21.15.89:0/2890628381 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f0b3403e8a0 0x7f0b34040db0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:46.753 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.752+0000 7f0b45ffb640 1 -- 172.21.15.89:0/2890628381 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f0b4c00dc10 con 0x7f0b50135300 2024-09-16T16:46:46.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:46.938+0000 7f0b57951640 1 -- 172.21.15.89:0/2890628381 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f0b50135710 con 0x7f0b50135300 2024-09-16T16:46:47.207 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.207+0000 7f0b45ffb640 1 -- 172.21.15.89:0/2890628381 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v12) ==== 109+0+0 (crc 0 0 0) 0x7f0b4c00d610 con 0x7f0b50135300 2024-09-16T16:46:47.207 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'rbd' created 2024-09-16T16:46:47.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.208+0000 7f0b57951640 1 -- 172.21.15.89:0/2890628381 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f0b3403e8a0 msgr2=0x7f0b34040db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:47.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.208+0000 7f0b57951640 1 --2- 172.21.15.89:0/2890628381 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f0b3403e8a0 0x7f0b34040db0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:47.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.208+0000 7f0b57951640 1 -- 172.21.15.89:0/2890628381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b50135300 msgr2=0x7f0b5011fed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:47.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.208+0000 7f0b57951640 1 --2- 172.21.15.89:0/2890628381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b50135300 0x7f0b5011fed0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:47.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.208+0000 7f0b57951640 1 -- 172.21.15.89:0/2890628381 shutdown_connections 2024-09-16T16:46:47.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.208+0000 7f0b57951640 1 --2- 172.21.15.89:0/2890628381 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f0b3403e8a0 0x7f0b34040db0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:47.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.208+0000 7f0b57951640 1 --2- 172.21.15.89:0/2890628381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b50135300 0x7f0b5011fed0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:47.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.208+0000 7f0b57951640 1 -- 172.21.15.89:0/2890628381 >> 172.21.15.89:0/2890628381 conn(0x7f0b5006e3e0 msgr2=0x7f0b501bd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:47.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.209+0000 7f0b57951640 1 -- 172.21.15.89:0/2890628381 shutdown_connections 2024-09-16T16:46:47.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.209+0000 7f0b57951640 1 -- 172.21.15.89:0/2890628381 wait complete. 2024-09-16T16:46:47.223 DEBUG:teuthology.orchestra.run.smithi089:> rbd --cluster ceph pool init rbd 2024-09-16T16:46:47.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.324+0000 7f73fcc10ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:47.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.325+0000 7f73fcc10ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:47.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.326+0000 7f73fcc10ac0 1 Processor -- start 2024-09-16T16:46:47.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.326+0000 7f73fcc10ac0 1 -- start start 2024-09-16T16:46:47.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.327+0000 7f73fcc10ac0 1 --2- >> v2:172.21.15.89:3300/0 conn(0xeee520 0xeee930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:47.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.327+0000 7f73fcc10ac0 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0xd53180 con 0xeef790 2024-09-16T16:46:47.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.327+0000 7f73fcc10ac0 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0xd92b90 con 0xeee520 2024-09-16T16:46:47.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.327+0000 7f73f6208640 1 --2- >> v2:172.21.15.89:3300/0 conn(0xeee520 0xeee930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:47.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.327+0000 7f73f6208640 1 --2- >> v2:172.21.15.89:3300/0 conn(0xeee520 0xeee930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59484/0 (socket says 172.21.15.89:59484) 2024-09-16T16:46:47.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.327+0000 7f73f6208640 1 -- 172.21.15.89:0/2507763762 learned_addr learned my addr 172.21.15.89:0/2507763762 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:47.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.327+0000 7f73f6208640 1 -- 172.21.15.89:0/2507763762 >> v1:172.21.15.89:6789/0 conn(0xeef790 legacy=0xeede10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:47.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.327+0000 7f73f6208640 1 -- 172.21.15.89:0/2507763762 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0xd28f80 con 0xeee520 2024-09-16T16:46:47.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.327+0000 7f73f5a07640 1 -- 172.21.15.89:0/2507763762 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2630455505 0 0) 0xd53180 con 0xeef790 2024-09-16T16:46:47.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.328+0000 7f73f6208640 1 --2- 172.21.15.89:0/2507763762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xeee520 0xeee930 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8731c5eb8cad0ecb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:47.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.329+0000 7f73f5a07640 1 -- 172.21.15.89:0/2507763762 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f73e002d840 con 0xeee520 2024-09-16T16:46:47.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.329+0000 7f73f5a07640 1 -- 172.21.15.89:0/2507763762 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f73e002d9a0 con 0xeee520 2024-09-16T16:46:47.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.329+0000 7f73f5a07640 1 -- 172.21.15.89:0/2507763762 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f73e002dc40 con 0xeee520 2024-09-16T16:46:47.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.329+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/2507763762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xeee520 msgr2=0xeee930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:47.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.329+0000 7f73fcc10ac0 1 --2- 172.21.15.89:0/2507763762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xeee520 0xeee930 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:47.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.329+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/2507763762 shutdown_connections 2024-09-16T16:46:47.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.329+0000 7f73fcc10ac0 1 --2- 172.21.15.89:0/2507763762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xeee520 0xeee930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:47.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.329+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/2507763762 >> 172.21.15.89:0/2507763762 conn(0xcfbf70 msgr2=0xeec6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:47.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.329+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/2507763762 shutdown_connections 2024-09-16T16:46:47.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.329+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/2507763762 wait complete. 2024-09-16T16:46:47.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.330+0000 7f73fcc10ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:47.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.331+0000 7f73fcc10ac0 1 Processor -- start 2024-09-16T16:46:47.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.331+0000 7f73fcc10ac0 1 -- start start 2024-09-16T16:46:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.332+0000 7f73fcc10ac0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xeee520 0xf952a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.332+0000 7f73fcc10ac0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0xd9d8f0 con 0xeee520 2024-09-16T16:46:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.332+0000 7f73f6a09640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xeee520 0xf952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.332+0000 7f73f6a09640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xeee520 0xf952a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59496/0 (socket says 172.21.15.89:59496) 2024-09-16T16:46:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.332+0000 7f73f6a09640 1 -- 172.21.15.89:0/136107690 learned_addr learned my addr 172.21.15.89:0/136107690 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.332+0000 7f73f6a09640 1 -- 172.21.15.89:0/136107690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd37800 con 0xeee520 2024-09-16T16:46:47.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.332+0000 7f73f6a09640 1 --2- 172.21.15.89:0/136107690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xeee520 0xf952a0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:47.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.332+0000 7f73deffd640 1 -- 172.21.15.89:0/136107690 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f73ec00b710 con 0xeee520 2024-09-16T16:46:47.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.332+0000 7f73deffd640 1 -- 172.21.15.89:0/136107690 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f73ec00b870 con 0xeee520 2024-09-16T16:46:47.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.332+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/136107690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xd29310 con 0xeee520 2024-09-16T16:46:47.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.333+0000 7f73deffd640 1 -- 172.21.15.89:0/136107690 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f73ec00bb10 con 0xeee520 2024-09-16T16:46:47.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.333+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/136107690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0xd28d70 con 0xeee520 2024-09-16T16:46:47.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.334+0000 7f73deffd640 1 -- 172.21.15.89:0/136107690 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7f73ec00bc70 con 0xeee520 2024-09-16T16:46:47.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.334+0000 7f73deffd640 1 --2- 172.21.15.89:0/136107690 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f73d803d130 0x7f73d803f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:47.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.334+0000 7f73deffd640 1 -- 172.21.15.89:0/136107690 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2661+0+0 (crc 0 0 0) 0x7f73ec012040 con 0xeee520 2024-09-16T16:46:47.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.334+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/136107690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0xef4b70 con 0xeee520 2024-09-16T16:46:47.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.334+0000 7f73f6208640 1 --2- 172.21.15.89:0/136107690 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f73d803d130 0x7f73d803f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:47.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:47.335+0000 7f73f6208640 1 --2- 172.21.15.89:0/136107690 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f73d803d130 0x7f73d803f640 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:48.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.036+0000 7f73deffd640 1 -- 172.21.15.89:0/136107690 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f73ec002bf0 con 0xeee520 2024-09-16T16:46:48.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.216+0000 7f73deffd640 1 -- 172.21.15.89:0/136107690 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v13) ==== 141+0+0 (crc 0 0 0) 0x7f73ec010120 con 0xeee520 2024-09-16T16:46:48.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.216+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/136107690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0xd50520 con 0xeee520 2024-09-16T16:46:48.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.219+0000 7f73deffd640 1 -- 172.21.15.89:0/136107690 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (crc 0 0 0) 0x7f73ec021660 con 0xeee520 2024-09-16T16:46:48.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.219+0000 7f73f5206640 1 -- 172.21.15.89:0/136107690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=13}) -- 0x7f73d0002ae0 con 0xeee520 2024-09-16T16:46:48.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.220+0000 7f73deffd640 1 -- 172.21.15.89:0/136107690 <== mon.0 v2:172.21.15.89:3300/0 9 ==== osd_map(13..13 src has 1..13) ==== 658+0+0 (crc 0 0 0) 0x7f73ec006540 con 0xeee520 2024-09-16T16:46:48.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.220+0000 7f73fcc10ac0 1 --2- 172.21.15.89:0/136107690 >> v2:172.21.15.89:6803/245700216 conn(0xeef790 0xf91d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:48.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.220+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/136107690 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13) -- 0xf92250 con 0xeef790 2024-09-16T16:46:48.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.223+0000 7f73f7c6b640 1 --2- 172.21.15.89:0/136107690 >> v2:172.21.15.89:6803/245700216 conn(0xeef790 0xf91d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T16:46:48.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.251+0000 7f73f7c6b640 1 --2- 172.21.15.89:0/136107690 >> v2:172.21.15.89:6803/245700216 conn(0xeef790 0xf91d10 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:48.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.319+0000 7f73f7c6b640 1 -- 172.21.15.89:0/136107690 <== osd.1 v2:172.21.15.89:6803/245700216 1 ==== osd_op_reply(1 rbd_trash [create] v13'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f73e800a4b0 con 0xeef790 2024-09-16T16:46:48.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.322+0000 7f73fcc10ac0 1 --2- 172.21.15.89:0/136107690 >> v2:172.21.15.89:6801/3499031688 conn(0xfeb780 0xfedc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:48.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.322+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/136107690 --> v2:172.21.15.89:6801/3499031688 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e13) -- 0xfee230 con 0xfeb780 2024-09-16T16:46:48.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.323+0000 7f73f6a09640 1 --2- 172.21.15.89:0/136107690 >> v2:172.21.15.89:6801/3499031688 conn(0xfeb780 0xfedc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T16:46:48.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.327+0000 7f73f6a09640 1 --2- 172.21.15.89:0/136107690 >> v2:172.21.15.89:6801/3499031688 conn(0xfeb780 0xfedc60 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:48.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.331+0000 7f73f6a09640 1 -- 172.21.15.89:0/136107690 <== osd.0 v2:172.21.15.89:6801/3499031688 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f73ec051ba0 con 0xfeb780 2024-09-16T16:46:48.332 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.331+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/136107690 --> v2:172.21.15.89:6801/3499031688 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e13) -- 0xfeac40 con 0xfeb780 2024-09-16T16:46:48.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.334+0000 7f73f6a09640 1 -- 172.21.15.89:0/136107690 <== osd.0 v2:172.21.15.89:6801/3499031688 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f73ec051ba0 con 0xfeb780 2024-09-16T16:46:48.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:48.334+0000 7f73f4a05640 1 -- 172.21.15.89:0/136107690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f73d4001f60 con 0xeee520 2024-09-16T16:46:49.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:49.223+0000 7f73deffd640 1 -- 172.21.15.89:0/136107690 <== mon.0 v2:172.21.15.89:3300/0 10 ==== pool_op_reply(tid 4 (0) Success v14) ==== 55+0+0 (crc 0 0 0) 0x7f73ec010810 con 0xeee520 2024-09-16T16:46:49.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:49.223+0000 7f73deffd640 1 -- 172.21.15.89:0/136107690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=14}) -- 0x7f73d80423e0 con 0xeee520 2024-09-16T16:46:49.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:49.223+0000 7f73deffd640 1 -- 172.21.15.89:0/136107690 <== mon.0 v2:172.21.15.89:3300/0 11 ==== osd_map(14..14 src has 1..14) ==== 626+0+0 (crc 0 0 0) 0x7f73ec006c50 con 0xeee520 2024-09-16T16:46:49.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:49.223+0000 7f73f5206640 1 -- 172.21.15.89:0/136107690 --> v2:172.21.15.89:6801/3499031688 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) -- 0x7f73d0005640 con 0xfeb780 2024-09-16T16:46:49.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:49.263+0000 7f73f6a09640 1 -- 172.21.15.89:0/136107690 <== osd.0 v2:172.21.15.89:6801/3499031688 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v14'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f73ec051ba0 con 0xfeb780 2024-09-16T16:46:49.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:49.263+0000 7f73f4a05640 1 -- 172.21.15.89:0/136107690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v14) -- 0x7f73d4003370 con 0xeee520 2024-09-16T16:46:50.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.225+0000 7f73deffd640 1 -- 172.21.15.89:0/136107690 <== mon.0 v2:172.21.15.89:3300/0 12 ==== pool_op_reply(tid 6 (0) Success v15) ==== 43+0+0 (crc 0 0 0) 0x7f73ec0109f0 con 0xeee520 2024-09-16T16:46:50.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.225+0000 7f73deffd640 1 -- 172.21.15.89:0/136107690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7f73d8042620 con 0xeee520 2024-09-16T16:46:50.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.225+0000 7f73deffd640 1 -- 172.21.15.89:0/136107690 <== mon.0 v2:172.21.15.89:3300/0 13 ==== osd_map(15..15 src has 1..15) ==== 654+0+0 (crc 0 0 0) 0x7f73ec006e10 con 0xeee520 2024-09-16T16:46:50.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.225+0000 7f73f5206640 1 -- 172.21.15.89:0/136107690 --> v2:172.21.15.89:6801/3499031688 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x7f73d00059e0 con 0xfeb780 2024-09-16T16:46:50.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73f6a09640 1 -- 172.21.15.89:0/136107690 <== osd.0 v2:172.21.15.89:6801/3499031688 4 ==== osd_op_reply(7 rbd_info [write 0~19] v15'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73ec051ba0 con 0xfeb780 2024-09-16T16:46:50.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/136107690 >> v2:172.21.15.89:6801/3499031688 conn(0xfeb780 msgr2=0xfedc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:50.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73fcc10ac0 1 --2- 172.21.15.89:0/136107690 >> v2:172.21.15.89:6801/3499031688 conn(0xfeb780 0xfedc60 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/136107690 >> v2:172.21.15.89:6803/245700216 conn(0xeef790 msgr2=0xf91d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:50.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73fcc10ac0 1 --2- 172.21.15.89:0/136107690 >> v2:172.21.15.89:6803/245700216 conn(0xeef790 0xf91d10 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/136107690 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f73d803d130 msgr2=0x7f73d803f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:50.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73fcc10ac0 1 --2- 172.21.15.89:0/136107690 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f73d803d130 0x7f73d803f640 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/136107690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xeee520 msgr2=0xf952a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:50.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73fcc10ac0 1 --2- 172.21.15.89:0/136107690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xeee520 0xf952a0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/136107690 shutdown_connections 2024-09-16T16:46:50.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73fcc10ac0 1 --2- 172.21.15.89:0/136107690 >> v2:172.21.15.89:6801/3499031688 conn(0xfeb780 0xfedc60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73fcc10ac0 1 --2- 172.21.15.89:0/136107690 >> v2:172.21.15.89:6803/245700216 conn(0xeef790 0xf91d10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73fcc10ac0 1 --2- 172.21.15.89:0/136107690 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f73d803d130 0x7f73d803f640 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73fcc10ac0 1 --2- 172.21.15.89:0/136107690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xeee520 0xf952a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/136107690 >> 172.21.15.89:0/136107690 conn(0xcfbf70 msgr2=0xef8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:50.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/136107690 shutdown_connections 2024-09-16T16:46:50.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.269+0000 7f73fcc10ac0 1 -- 172.21.15.89:0/136107690 wait complete. 2024-09-16T16:46:50.274 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T16:46:50.275 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-16T16:46:50.275 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T16:46:50.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.379+0000 7f35e72a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:50.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.385+0000 7f35e72a3640 1 Processor -- start 2024-09-16T16:46:50.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.385+0000 7f35e72a3640 1 -- start start 2024-09-16T16:46:50.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.386+0000 7f35e72a3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f35e00733a0 0x7f35e0133320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:50.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.386+0000 7f35e72a3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e0074420 con 0x7f35e0133860 2024-09-16T16:46:50.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.386+0000 7f35e72a3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f35e00749a0 con 0x7f35e00733a0 2024-09-16T16:46:50.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.386+0000 7f35e503f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f35e00733a0 0x7f35e0133320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:50.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.386+0000 7f35e503f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f35e00733a0 0x7f35e0133320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36112/0 (socket says 172.21.15.89:36112) 2024-09-16T16:46:50.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.386+0000 7f35e503f640 1 -- 172.21.15.89:0/793138806 learned_addr learned my addr 172.21.15.89:0/793138806 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:50.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.386+0000 7f35e483e640 1 --1- 172.21.15.89:0/793138806 >> v1:172.21.15.89:6789/0 conn(0x7f35e0133860 0x7f35e009a0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51702/0 (socket says 172.21.15.89:51702) 2024-09-16T16:46:50.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.387+0000 7f35e503f640 1 -- 172.21.15.89:0/793138806 >> v1:172.21.15.89:6789/0 conn(0x7f35e0133860 legacy=0x7f35e009a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:50.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.387+0000 7f35e503f640 1 -- 172.21.15.89:0/793138806 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e0074110 con 0x7f35e00733a0 2024-09-16T16:46:50.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.387+0000 7f35e503f640 1 --2- 172.21.15.89:0/793138806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e00733a0 0x7f35e0133320 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba7e48c287ec3cb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:50.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.387+0000 7f35d7fff640 1 -- 172.21.15.89:0/793138806 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f35dc009e50 con 0x7f35e00733a0 2024-09-16T16:46:50.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.387+0000 7f35d7fff640 1 -- 172.21.15.89:0/793138806 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f35dc00e230 con 0x7f35e00733a0 2024-09-16T16:46:50.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.387+0000 7f35d7fff640 1 -- 172.21.15.89:0/793138806 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f35dc00e4d0 con 0x7f35e00733a0 2024-09-16T16:46:50.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.387+0000 7f35e72a3640 1 -- 172.21.15.89:0/793138806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e00733a0 msgr2=0x7f35e0133320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:50.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.387+0000 7f35e72a3640 1 --2- 172.21.15.89:0/793138806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e00733a0 0x7f35e0133320 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.388+0000 7f35e72a3640 1 -- 172.21.15.89:0/793138806 shutdown_connections 2024-09-16T16:46:50.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.388+0000 7f35e72a3640 1 --2- 172.21.15.89:0/793138806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e00733a0 0x7f35e0133320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.388+0000 7f35e72a3640 1 -- 172.21.15.89:0/793138806 >> 172.21.15.89:0/793138806 conn(0x7f35e00a0de0 msgr2=0x7f35e00a11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:50.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.388+0000 7f35e72a3640 1 -- 172.21.15.89:0/793138806 shutdown_connections 2024-09-16T16:46:50.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.388+0000 7f35e72a3640 1 -- 172.21.15.89:0/793138806 wait complete. 2024-09-16T16:46:50.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.388+0000 7f35e72a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:50.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.389+0000 7f35e72a3640 1 Processor -- start 2024-09-16T16:46:50.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.390+0000 7f35e72a3640 1 -- start start 2024-09-16T16:46:50.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.390+0000 7f35e72a3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e0133860 0x7f35e012ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:50.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.391+0000 7f35e72a3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f35e012e8e0 con 0x7f35e0133860 2024-09-16T16:46:50.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.391+0000 7f35e503f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e0133860 0x7f35e012ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:50.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.391+0000 7f35e503f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e0133860 0x7f35e012ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36114/0 (socket says 172.21.15.89:36114) 2024-09-16T16:46:50.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.391+0000 7f35e503f640 1 -- 172.21.15.89:0/3166549354 learned_addr learned my addr 172.21.15.89:0/3166549354 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:50.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.391+0000 7f35e503f640 1 -- 172.21.15.89:0/3166549354 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e012f8b0 con 0x7f35e0133860 2024-09-16T16:46:50.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.391+0000 7f35e503f640 1 --2- 172.21.15.89:0/3166549354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e0133860 0x7f35e012ef30 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:50.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.391+0000 7f35d5ffb640 1 -- 172.21.15.89:0/3166549354 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f35dc00eda0 con 0x7f35e0133860 2024-09-16T16:46:50.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.391+0000 7f35d5ffb640 1 -- 172.21.15.89:0/3166549354 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f35dc015420 con 0x7f35e0133860 2024-09-16T16:46:50.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.391+0000 7f35e72a3640 1 -- 172.21.15.89:0/3166549354 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e012d7f0 con 0x7f35e0133860 2024-09-16T16:46:50.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.391+0000 7f35d5ffb640 1 -- 172.21.15.89:0/3166549354 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f35dc0156c0 con 0x7f35e0133860 2024-09-16T16:46:50.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.391+0000 7f35e72a3640 1 -- 172.21.15.89:0/3166549354 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e012fff0 con 0x7f35e0133860 2024-09-16T16:46:50.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.392+0000 7f35d5ffb640 1 -- 172.21.15.89:0/3166549354 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f35dc015870 con 0x7f35e0133860 2024-09-16T16:46:50.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.392+0000 7f35e72a3640 1 -- 172.21.15.89:0/3166549354 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e012f630 con 0x7f35e0133860 2024-09-16T16:46:50.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.392+0000 7f35d5ffb640 1 --2- 172.21.15.89:0/3166549354 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f35c403e930 0x7f35c4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:50.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.393+0000 7f35d5ffb640 1 -- 172.21.15.89:0/3166549354 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f35dc050d20 con 0x7f35e0133860 2024-09-16T16:46:50.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.393+0000 7f35e483e640 1 --2- 172.21.15.89:0/3166549354 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f35c403e930 0x7f35c4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:50.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.393+0000 7f35e483e640 1 --2- 172.21.15.89:0/3166549354 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f35c403e930 0x7f35c4040e40 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:50.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.398+0000 7f35d5ffb640 1 -- 172.21.15.89:0/3166549354 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f35dc00f2a0 con 0x7f35e0133860 2024-09-16T16:46:50.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.573+0000 7f35e72a3640 1 -- 172.21.15.89:0/3166549354 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f35e00733a0 con 0x7f35e0133860 2024-09-16T16:46:50.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.574+0000 7f35d5ffb640 1 -- 172.21.15.89:0/3166549354 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (crc 0 0 0) 0x7f35dc0059f0 con 0x7f35e0133860 2024-09-16T16:46:50.575 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:50.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.576+0000 7f35e72a3640 1 -- 172.21.15.89:0/3166549354 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f35c403e930 msgr2=0x7f35c4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:50.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.576+0000 7f35e72a3640 1 --2- 172.21.15.89:0/3166549354 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f35c403e930 0x7f35c4040e40 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.576+0000 7f35e72a3640 1 -- 172.21.15.89:0/3166549354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e0133860 msgr2=0x7f35e012ef30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:50.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.576+0000 7f35e72a3640 1 --2- 172.21.15.89:0/3166549354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e0133860 0x7f35e012ef30 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.576+0000 7f35e72a3640 1 -- 172.21.15.89:0/3166549354 shutdown_connections 2024-09-16T16:46:50.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.576+0000 7f35e72a3640 1 --2- 172.21.15.89:0/3166549354 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f35c403e930 0x7f35c4040e40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.576+0000 7f35e72a3640 1 --2- 172.21.15.89:0/3166549354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e0133860 0x7f35e012ef30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.576+0000 7f35e72a3640 1 -- 172.21.15.89:0/3166549354 >> 172.21.15.89:0/3166549354 conn(0x7f35e00a0de0 msgr2=0x7f35e00a1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:50.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.576+0000 7f35e72a3640 1 -- 172.21.15.89:0/3166549354 shutdown_connections 2024-09-16T16:46:50.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.577+0000 7f35e72a3640 1 -- 172.21.15.89:0/3166549354 wait complete. 2024-09-16T16:46:50.587 INFO:teuthology.orchestra.run.smithi089.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-16T16:46:50.588 INFO:tasks.ceph_manager:config epoch is 1 2024-09-16T16:46:50.588 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T16:46:50.588 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T16:46:50.588 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T16:46:50.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.691+0000 7f6383697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:50.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.696+0000 7f6383697640 1 Processor -- start 2024-09-16T16:46:50.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.696+0000 7f6383697640 1 -- start start 2024-09-16T16:46:50.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.697+0000 7f6383697640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f637c131300 0x7f637c131710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:50.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.697+0000 7f6383697640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f637c09ce60 con 0x7f637c132030 2024-09-16T16:46:50.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.697+0000 7f6383697640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f637c09e010 con 0x7f637c131300 2024-09-16T16:46:50.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.697+0000 7f6381433640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f637c131300 0x7f637c131710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:50.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.697+0000 7f6380c32640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f637c132030 0x7f637c132440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51718/0 (socket says 172.21.15.89:51718) 2024-09-16T16:46:50.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.697+0000 7f6380c32640 1 -- 172.21.15.89:0/3018932668 learned_addr learned my addr 172.21.15.89:0/3018932668 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T16:46:50.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.697+0000 7f6381433640 1 -- 172.21.15.89:0/3018932668 >> v1:172.21.15.89:6789/0 conn(0x7f637c132030 legacy=0x7f637c132440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:50.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.697+0000 7f6373fff640 1 -- 172.21.15.89:0/3018932668 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2768819451 0 0) 0x7f637c09ce60 con 0x7f637c132030 2024-09-16T16:46:50.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.697+0000 7f6381433640 1 -- 172.21.15.89:0/3018932668 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637c0a0aa0 con 0x7f637c131300 2024-09-16T16:46:50.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.697+0000 7f6381433640 1 --2- 172.21.15.89:0/3018932668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f637c131300 0x7f637c131710 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50eaeec59c5635e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:50.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.698+0000 7f6373fff640 1 -- 172.21.15.89:0/3018932668 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6378009d60 con 0x7f637c131300 2024-09-16T16:46:50.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.698+0000 7f6373fff640 1 -- 172.21.15.89:0/3018932668 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f637800e230 con 0x7f637c131300 2024-09-16T16:46:50.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.698+0000 7f6373fff640 1 -- 172.21.15.89:0/3018932668 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f637800e4d0 con 0x7f637c131300 2024-09-16T16:46:50.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.698+0000 7f6383697640 1 -- 172.21.15.89:0/3018932668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f637c131300 msgr2=0x7f637c131710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:50.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.698+0000 7f6383697640 1 --2- 172.21.15.89:0/3018932668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f637c131300 0x7f637c131710 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.698+0000 7f6383697640 1 -- 172.21.15.89:0/3018932668 shutdown_connections 2024-09-16T16:46:50.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.698+0000 7f6383697640 1 --2- 172.21.15.89:0/3018932668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f637c131300 0x7f637c131710 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.698+0000 7f6383697640 1 -- 172.21.15.89:0/3018932668 >> 172.21.15.89:0/3018932668 conn(0x7f637c069d10 msgr2=0x7f637c09f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:50.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.698+0000 7f6383697640 1 -- 172.21.15.89:0/3018932668 shutdown_connections 2024-09-16T16:46:50.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.699+0000 7f6383697640 1 -- 172.21.15.89:0/3018932668 wait complete. 2024-09-16T16:46:50.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.699+0000 7f6383697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:50.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.700+0000 7f6383697640 1 Processor -- start 2024-09-16T16:46:50.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.700+0000 7f6383697640 1 -- start start 2024-09-16T16:46:50.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.701+0000 7f6383697640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f637c131300 0x7f637c11cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:50.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.701+0000 7f6383697640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f637c120970 con 0x7f637c131300 2024-09-16T16:46:50.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.701+0000 7f6381433640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f637c131300 0x7f637c11cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:50.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.701+0000 7f6381433640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f637c131300 0x7f637c11cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36134/0 (socket says 172.21.15.89:36134) 2024-09-16T16:46:50.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.701+0000 7f6381433640 1 -- 172.21.15.89:0/4246848070 learned_addr learned my addr 172.21.15.89:0/4246848070 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:50.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.701+0000 7f6381433640 1 -- 172.21.15.89:0/4246848070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637c11df50 con 0x7f637c131300 2024-09-16T16:46:50.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.702+0000 7f6381433640 1 --2- 172.21.15.89:0/4246848070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f637c131300 0x7f637c11cc80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:50.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.702+0000 7f6371ffb640 1 -- 172.21.15.89:0/4246848070 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6378014620 con 0x7f637c131300 2024-09-16T16:46:50.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.702+0000 7f6371ffb640 1 -- 172.21.15.89:0/4246848070 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6378014780 con 0x7f637c131300 2024-09-16T16:46:50.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.702+0000 7f6383697640 1 -- 172.21.15.89:0/4246848070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f637c11e680 con 0x7f637c131300 2024-09-16T16:46:50.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.702+0000 7f6371ffb640 1 -- 172.21.15.89:0/4246848070 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6378014a20 con 0x7f637c131300 2024-09-16T16:46:50.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.702+0000 7f6383697640 1 -- 172.21.15.89:0/4246848070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f637c120b70 con 0x7f637c131300 2024-09-16T16:46:50.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.703+0000 7f6371ffb640 1 -- 172.21.15.89:0/4246848070 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6378014bd0 con 0x7f637c131300 2024-09-16T16:46:50.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.703+0000 7f6383697640 1 -- 172.21.15.89:0/4246848070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f637c09db70 con 0x7f637c131300 2024-09-16T16:46:50.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.703+0000 7f6371ffb640 1 --2- 172.21.15.89:0/4246848070 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f636003e960 0x7f6360040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:50.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.703+0000 7f6371ffb640 1 -- 172.21.15.89:0/4246848070 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f6378019040 con 0x7f637c131300 2024-09-16T16:46:50.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.703+0000 7f6380c32640 1 --2- 172.21.15.89:0/4246848070 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f636003e960 0x7f6360040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:50.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.704+0000 7f6380c32640 1 --2- 172.21.15.89:0/4246848070 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f636003e960 0x7f6360040e70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:50.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.708+0000 7f6371ffb640 1 -- 172.21.15.89:0/4246848070 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f6378011570 con 0x7f637c131300 2024-09-16T16:46:50.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.929+0000 7f6383697640 1 -- 172.21.15.89:0/4246848070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f637c11f4a0 con 0x7f637c131300 2024-09-16T16:46:50.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.931+0000 7f6371ffb640 1 -- 172.21.15.89:0/4246848070 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+97906 (crc 0 0 0) 0x7f6378018190 con 0x7f637c131300 2024-09-16T16:46:50.933 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.934+0000 7f6383697640 1 -- 172.21.15.89:0/4246848070 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f636003e960 msgr2=0x7f6360040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.934+0000 7f6383697640 1 --2- 172.21.15.89:0/4246848070 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f636003e960 0x7f6360040e70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.934+0000 7f6383697640 1 -- 172.21.15.89:0/4246848070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f637c131300 msgr2=0x7f637c11cc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.934+0000 7f6383697640 1 --2- 172.21.15.89:0/4246848070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f637c131300 0x7f637c11cc80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.934+0000 7f6383697640 1 -- 172.21.15.89:0/4246848070 shutdown_connections 2024-09-16T16:46:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.934+0000 7f6383697640 1 --2- 172.21.15.89:0/4246848070 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f636003e960 0x7f6360040e70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.934+0000 7f6383697640 1 --2- 172.21.15.89:0/4246848070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f637c131300 0x7f637c11cc80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.934+0000 7f6383697640 1 -- 172.21.15.89:0/4246848070 >> 172.21.15.89:0/4246848070 conn(0x7f637c069d10 msgr2=0x7f637c09f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.934+0000 7f6383697640 1 -- 172.21.15.89:0/4246848070 shutdown_connections 2024-09-16T16:46:50.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:50.934+0000 7f6383697640 1 -- 172.21.15.89:0/4246848070 wait complete. 2024-09-16T16:46:50.945 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1212166405},{"type":"v1","addr":"172.21.15.177:6801","nonce":1212166405}]},"active_addr":"172.21.15.177:6801/1212166405","active_change":"2024-09-16T16:46:41.132701+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":316800276}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":633782683}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":2982687629}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":1334330280}]}]} 2024-09-16T16:46:50.947 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T16:46:50.947 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T16:46:50.947 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:46:51.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.050+0000 7f0be5751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.054+0000 7f0be5751640 1 Processor -- start 2024-09-16T16:46:51.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.055+0000 7f0be5751640 1 -- start start 2024-09-16T16:46:51.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.056+0000 7f0be5751640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0be0138720 0x7f0be013ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.056+0000 7f0be5751640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0be0133040 con 0x7f0be0132520 2024-09-16T16:46:51.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.056+0000 7f0be5751640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f0be006f6d0 con 0x7f0be0138720 2024-09-16T16:46:51.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.056+0000 7f0bd67fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0be0138720 0x7f0be013ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.056+0000 7f0bdeffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0be0132520 0x7f0be0132930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51734/0 (socket says 172.21.15.89:51734) 2024-09-16T16:46:51.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.056+0000 7f0bd67fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0be0138720 0x7f0be013ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36144/0 (socket says 172.21.15.89:36144) 2024-09-16T16:46:51.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.056+0000 7f0bdeffd640 1 -- 172.21.15.89:0/1425202875 learned_addr learned my addr 172.21.15.89:0/1425202875 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T16:46:51.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.056+0000 7f0bd67fc640 1 -- 172.21.15.89:0/1425202875 >> v1:172.21.15.89:6789/0 conn(0x7f0be0132520 legacy=0x7f0be0132930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.056+0000 7f0bd67fc640 1 -- 172.21.15.89:0/1425202875 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be006f3d0 con 0x7f0be0138720 2024-09-16T16:46:51.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.056+0000 7f0bd67fc640 1 --2- 172.21.15.89:0/1425202875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be0138720 0x7f0be013ab40 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65bfa7447c3d204 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.056+0000 7f0bde7fc640 1 -- 172.21.15.89:0/1425202875 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0bc8009d90 con 0x7f0be0138720 2024-09-16T16:46:51.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.056+0000 7f0bde7fc640 1 -- 172.21.15.89:0/1425202875 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0bc800e230 con 0x7f0be0138720 2024-09-16T16:46:51.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.056+0000 7f0bde7fc640 1 -- 172.21.15.89:0/1425202875 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0bc800e4d0 con 0x7f0be0138720 2024-09-16T16:46:51.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.057+0000 7f0be5751640 1 -- 172.21.15.89:0/1425202875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be0138720 msgr2=0x7f0be013ab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.057+0000 7f0be5751640 1 --2- 172.21.15.89:0/1425202875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be0138720 0x7f0be013ab40 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.057+0000 7f0be5751640 1 -- 172.21.15.89:0/1425202875 shutdown_connections 2024-09-16T16:46:51.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.057+0000 7f0be5751640 1 --2- 172.21.15.89:0/1425202875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be0138720 0x7f0be013ab40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.057+0000 7f0be5751640 1 -- 172.21.15.89:0/1425202875 >> 172.21.15.89:0/1425202875 conn(0x7f0be006e490 msgr2=0x7f0be006e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.057+0000 7f0be5751640 1 -- 172.21.15.89:0/1425202875 shutdown_connections 2024-09-16T16:46:51.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.057+0000 7f0be5751640 1 -- 172.21.15.89:0/1425202875 wait complete. 2024-09-16T16:46:51.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.057+0000 7f0be5751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.059+0000 7f0be5751640 1 Processor -- start 2024-09-16T16:46:51.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.059+0000 7f0be5751640 1 -- start start 2024-09-16T16:46:51.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.060+0000 7f0be5751640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be0132520 0x7f0be0130c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.060+0000 7f0be5751640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0be01313d0 con 0x7f0be0132520 2024-09-16T16:46:51.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.060+0000 7f0bdeffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be0132520 0x7f0be0130c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.060+0000 7f0bdeffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be0132520 0x7f0be0130c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36154/0 (socket says 172.21.15.89:36154) 2024-09-16T16:46:51.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.060+0000 7f0bdeffd640 1 -- 172.21.15.89:0/528289834 learned_addr learned my addr 172.21.15.89:0/528289834 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:51.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.060+0000 7f0bdeffd640 1 -- 172.21.15.89:0/528289834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be00a07b0 con 0x7f0be0132520 2024-09-16T16:46:51.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.060+0000 7f0bdeffd640 1 --2- 172.21.15.89:0/528289834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be0132520 0x7f0be0130c70 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.061+0000 7f0bd7fff640 1 -- 172.21.15.89:0/528289834 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0bd0005a60 con 0x7f0be0132520 2024-09-16T16:46:51.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.061+0000 7f0bd7fff640 1 -- 172.21.15.89:0/528289834 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0bd0005bc0 con 0x7f0be0132520 2024-09-16T16:46:51.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.061+0000 7f0bd7fff640 1 -- 172.21.15.89:0/528289834 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0bd0005e60 con 0x7f0be0132520 2024-09-16T16:46:51.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.061+0000 7f0be5751640 1 -- 172.21.15.89:0/528289834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be0120bc0 con 0x7f0be0132520 2024-09-16T16:46:51.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.061+0000 7f0be5751640 1 -- 172.21.15.89:0/528289834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be0120030 con 0x7f0be0132520 2024-09-16T16:46:51.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.062+0000 7f0be5751640 1 -- 172.21.15.89:0/528289834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0be006a300 con 0x7f0be0132520 2024-09-16T16:46:51.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.062+0000 7f0bd7fff640 1 -- 172.21.15.89:0/528289834 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0bd000c7f0 con 0x7f0be0132520 2024-09-16T16:46:51.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.062+0000 7f0bd7fff640 1 --2- 172.21.15.89:0/528289834 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f0bc003e930 0x7f0bc0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.062+0000 7f0bd7fff640 1 -- 172.21.15.89:0/528289834 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f0bd004f520 con 0x7f0be0132520 2024-09-16T16:46:51.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.062+0000 7f0bd67fc640 1 --2- 172.21.15.89:0/528289834 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f0bc003e930 0x7f0bc0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.063+0000 7f0bd67fc640 1 --2- 172.21.15.89:0/528289834 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f0bc003e930 0x7f0bc0040e40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.067+0000 7f0bd7fff640 1 -- 172.21.15.89:0/528289834 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f0bd000dc10 con 0x7f0be0132520 2024-09-16T16:46:51.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.247+0000 7f0be5751640 1 -- 172.21.15.89:0/528289834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0be0133040 con 0x7f0be0132520 2024-09-16T16:46:51.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.248+0000 7f0bd7fff640 1 -- 172.21.15.89:0/528289834 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8851 (crc 0 0 0) 0x7f0be0133040 con 0x7f0be0132520 2024-09-16T16:46:51.249 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:51.249 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":15,"fsid":"747238a8-71dc-4442-98b8-945fe8c55201","created":"2024-09-16T16:46:36.683580+0000","modified":"2024-09-16T16:46:50.221057+0000","last_up_change":"2024-09-16T16:46:43.196279+0000","last_in_change":"2024-09-16T16:46:38.791805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:45.169648+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:46:46.943517+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb249ec8-d1ab-4204-b3c2-71a37e34be86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6801","nonce":3499031688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":3499031688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":3499031688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6807","nonce":3499031688}]},"public_addr":"172.21.15.89:6801/3499031688","cluster_addr":"172.21.15.89:6800/3499031688","heartbeat_back_addr":"172.21.15.89:6806/3499031688","heartbeat_front_addr":"172.21.15.89:6807/3499031688","state":["exists","up"]},{"osd":1,"uuid":"e2f9a1fc-171f-41e1-93e0-7415da80187d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6803","nonce":245700216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":245700216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6805","nonce":245700216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":245700216}]},"public_addr":"172.21.15.89:6803/245700216","cluster_addr":"172.21.15.89:6802/245700216","heartbeat_back_addr":"172.21.15.89:6805/245700216","heartbeat_front_addr":"172.21.15.89:6804/245700216","state":["exists","up"]},{"osd":2,"uuid":"e95520d6-1eb4-43a1-b6db-21fe2f976fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":229775330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":229775330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":229775330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":229775330}]},"public_addr":"172.21.15.177:6806/229775330","cluster_addr":"172.21.15.177:6805/229775330","heartbeat_back_addr":"172.21.15.177:6814/229775330","heartbeat_front_addr":"172.21.15.177:6813/229775330","state":["exists","up"]},{"osd":3,"uuid":"8c090f0a-e303-4058-bef0-2f9bfc8c6a6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":75130198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":75130198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":75130198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":75130198}]},"public_addr":"172.21.15.177:6807/75130198","cluster_addr":"172.21.15.177:6804/75130198","heartbeat_back_addr":"172.21.15.177:6810/75130198","heartbeat_front_addr":"172.21.15.177:6809/75130198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:46:51.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.250+0000 7f0be5751640 1 -- 172.21.15.89:0/528289834 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f0bc003e930 msgr2=0x7f0bc0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.250+0000 7f0be5751640 1 --2- 172.21.15.89:0/528289834 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f0bc003e930 0x7f0bc0040e40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.250+0000 7f0be5751640 1 -- 172.21.15.89:0/528289834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be0132520 msgr2=0x7f0be0130c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.250+0000 7f0be5751640 1 --2- 172.21.15.89:0/528289834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be0132520 0x7f0be0130c70 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.250+0000 7f0be5751640 1 -- 172.21.15.89:0/528289834 shutdown_connections 2024-09-16T16:46:51.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.250+0000 7f0be5751640 1 --2- 172.21.15.89:0/528289834 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f0bc003e930 0x7f0bc0040e40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.250+0000 7f0be5751640 1 --2- 172.21.15.89:0/528289834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be0132520 0x7f0be0130c70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.250+0000 7f0be5751640 1 -- 172.21.15.89:0/528289834 >> 172.21.15.89:0/528289834 conn(0x7f0be006e490 msgr2=0x7f0be00a3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.251+0000 7f0be5751640 1 -- 172.21.15.89:0/528289834 shutdown_connections 2024-09-16T16:46:51.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.251+0000 7f0be5751640 1 -- 172.21.15.89:0/528289834 wait complete. 2024-09-16T16:46:51.262 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T16:46:51.262 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:46:51.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.365+0000 7f8872ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.370+0000 7f8872ea3640 1 Processor -- start 2024-09-16T16:46:51.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.370+0000 7f8872ea3640 1 -- start start 2024-09-16T16:46:51.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.371+0000 7f8872ea3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f886c09d010 0x7f886c09d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.371+0000 7f8872ea3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f886c0a02a0 con 0x7f886c132170 2024-09-16T16:46:51.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.371+0000 7f8872ea3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f886c09c550 con 0x7f886c09d010 2024-09-16T16:46:51.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.372+0000 7f8870c3f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f886c09d010 0x7f886c09d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.372+0000 7f886bfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f886c132170 0x7f886c132580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51736/0 (socket says 172.21.15.89:51736) 2024-09-16T16:46:51.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.372+0000 7f8870c3f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f886c09d010 0x7f886c09d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36162/0 (socket says 172.21.15.89:36162) 2024-09-16T16:46:51.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.372+0000 7f886bfff640 1 -- 172.21.15.89:0/1488952032 learned_addr learned my addr 172.21.15.89:0/1488952032 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T16:46:51.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.372+0000 7f8870c3f640 1 -- 172.21.15.89:0/1488952032 >> v1:172.21.15.89:6789/0 conn(0x7f886c132170 legacy=0x7f886c132580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.372+0000 7f8870c3f640 1 -- 172.21.15.89:0/1488952032 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f886c09cac0 con 0x7f886c09d010 2024-09-16T16:46:51.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.372+0000 7f886b7fe640 1 -- 172.21.15.89:0/1488952032 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1676872065 0 0) 0x7f886c0a02a0 con 0x7f886c132170 2024-09-16T16:46:51.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.372+0000 7f8870c3f640 1 --2- 172.21.15.89:0/1488952032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f886c09d010 0x7f886c09d420 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b2473d67ffdbf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.372+0000 7f886b7fe640 1 -- 172.21.15.89:0/1488952032 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8860009d90 con 0x7f886c09d010 2024-09-16T16:46:51.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.372+0000 7f886b7fe640 1 -- 172.21.15.89:0/1488952032 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f886000e230 con 0x7f886c09d010 2024-09-16T16:46:51.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.372+0000 7f886b7fe640 1 -- 172.21.15.89:0/1488952032 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f886000e4d0 con 0x7f886c09d010 2024-09-16T16:46:51.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.373+0000 7f8872ea3640 1 -- 172.21.15.89:0/1488952032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f886c09d010 msgr2=0x7f886c09d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.373+0000 7f8872ea3640 1 --2- 172.21.15.89:0/1488952032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f886c09d010 0x7f886c09d420 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.373+0000 7f8872ea3640 1 -- 172.21.15.89:0/1488952032 shutdown_connections 2024-09-16T16:46:51.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.373+0000 7f8872ea3640 1 --2- 172.21.15.89:0/1488952032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f886c09d010 0x7f886c09d420 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.373+0000 7f8872ea3640 1 -- 172.21.15.89:0/1488952032 >> 172.21.15.89:0/1488952032 conn(0x7f886c0a0de0 msgr2=0x7f886c0a11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.373+0000 7f8872ea3640 1 -- 172.21.15.89:0/1488952032 shutdown_connections 2024-09-16T16:46:51.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.373+0000 7f8872ea3640 1 -- 172.21.15.89:0/1488952032 wait complete. 2024-09-16T16:46:51.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.373+0000 7f8872ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.375+0000 7f8872ea3640 1 Processor -- start 2024-09-16T16:46:51.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.375+0000 7f8872ea3640 1 -- start start 2024-09-16T16:46:51.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.376+0000 7f8872ea3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f886c09d010 0x7f886c130240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.376+0000 7f8872ea3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f886c09dd50 con 0x7f886c09d010 2024-09-16T16:46:51.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.376+0000 7f8870c3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f886c09d010 0x7f886c130240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.376+0000 7f8870c3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f886c09d010 0x7f886c130240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36166/0 (socket says 172.21.15.89:36166) 2024-09-16T16:46:51.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.376+0000 7f8870c3f640 1 -- 172.21.15.89:0/3351472254 learned_addr learned my addr 172.21.15.89:0/3351472254 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:51.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.376+0000 7f8870c3f640 1 -- 172.21.15.89:0/3351472254 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f886c09af30 con 0x7f886c09d010 2024-09-16T16:46:51.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.376+0000 7f8870c3f640 1 --2- 172.21.15.89:0/3351472254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f886c09d010 0x7f886c130240 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.376+0000 7f88697fa640 1 -- 172.21.15.89:0/3351472254 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8860013610 con 0x7f886c09d010 2024-09-16T16:46:51.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.376+0000 7f88697fa640 1 -- 172.21.15.89:0/3351472254 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8860013770 con 0x7f886c09d010 2024-09-16T16:46:51.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.376+0000 7f88697fa640 1 -- 172.21.15.89:0/3351472254 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8860013a10 con 0x7f886c09d010 2024-09-16T16:46:51.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.376+0000 7f8872ea3640 1 -- 172.21.15.89:0/3351472254 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f886c070ff0 con 0x7f886c09d010 2024-09-16T16:46:51.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.377+0000 7f8872ea3640 1 -- 172.21.15.89:0/3351472254 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f886c09ab90 con 0x7f886c09d010 2024-09-16T16:46:51.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.377+0000 7f8872ea3640 1 -- 172.21.15.89:0/3351472254 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f886c131bd0 con 0x7f886c09d010 2024-09-16T16:46:51.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.378+0000 7f88697fa640 1 -- 172.21.15.89:0/3351472254 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8860013c10 con 0x7f886c09d010 2024-09-16T16:46:51.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.378+0000 7f88697fa640 1 --2- 172.21.15.89:0/3351472254 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f885003e910 0x7f8850040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.378+0000 7f88697fa640 1 -- 172.21.15.89:0/3351472254 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f8860018040 con 0x7f886c09d010 2024-09-16T16:46:51.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.378+0000 7f886bfff640 1 --2- 172.21.15.89:0/3351472254 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f885003e910 0x7f8850040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.379+0000 7f886bfff640 1 --2- 172.21.15.89:0/3351472254 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f885003e910 0x7f8850040e20 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.383+0000 7f88697fa640 1 -- 172.21.15.89:0/3351472254 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f8860011380 con 0x7f886c09d010 2024-09-16T16:46:51.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.559+0000 7f8872ea3640 1 -- 172.21.15.89:0/3351472254 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f886c09e2c0 con 0x7f886c09d010 2024-09-16T16:46:51.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.560+0000 7f88697fa640 1 -- 172.21.15.89:0/3351472254 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8851 (crc 0 0 0) 0x7f8860018a50 con 0x7f886c09d010 2024-09-16T16:46:51.560 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:51.560 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":15,"fsid":"747238a8-71dc-4442-98b8-945fe8c55201","created":"2024-09-16T16:46:36.683580+0000","modified":"2024-09-16T16:46:50.221057+0000","last_up_change":"2024-09-16T16:46:43.196279+0000","last_in_change":"2024-09-16T16:46:38.791805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:45.169648+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:46:46.943517+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb249ec8-d1ab-4204-b3c2-71a37e34be86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6801","nonce":3499031688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":3499031688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":3499031688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6807","nonce":3499031688}]},"public_addr":"172.21.15.89:6801/3499031688","cluster_addr":"172.21.15.89:6800/3499031688","heartbeat_back_addr":"172.21.15.89:6806/3499031688","heartbeat_front_addr":"172.21.15.89:6807/3499031688","state":["exists","up"]},{"osd":1,"uuid":"e2f9a1fc-171f-41e1-93e0-7415da80187d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6803","nonce":245700216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":245700216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6805","nonce":245700216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":245700216}]},"public_addr":"172.21.15.89:6803/245700216","cluster_addr":"172.21.15.89:6802/245700216","heartbeat_back_addr":"172.21.15.89:6805/245700216","heartbeat_front_addr":"172.21.15.89:6804/245700216","state":["exists","up"]},{"osd":2,"uuid":"e95520d6-1eb4-43a1-b6db-21fe2f976fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":229775330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":229775330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":229775330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":229775330}]},"public_addr":"172.21.15.177:6806/229775330","cluster_addr":"172.21.15.177:6805/229775330","heartbeat_back_addr":"172.21.15.177:6814/229775330","heartbeat_front_addr":"172.21.15.177:6813/229775330","state":["exists","up"]},{"osd":3,"uuid":"8c090f0a-e303-4058-bef0-2f9bfc8c6a6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":75130198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":75130198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":75130198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":75130198}]},"public_addr":"172.21.15.177:6807/75130198","cluster_addr":"172.21.15.177:6804/75130198","heartbeat_back_addr":"172.21.15.177:6810/75130198","heartbeat_front_addr":"172.21.15.177:6809/75130198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:46:51.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.562+0000 7f8872ea3640 1 -- 172.21.15.89:0/3351472254 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f885003e910 msgr2=0x7f8850040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.562+0000 7f8872ea3640 1 --2- 172.21.15.89:0/3351472254 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f885003e910 0x7f8850040e20 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.562+0000 7f8872ea3640 1 -- 172.21.15.89:0/3351472254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f886c09d010 msgr2=0x7f886c130240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.562+0000 7f8872ea3640 1 --2- 172.21.15.89:0/3351472254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f886c09d010 0x7f886c130240 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.562+0000 7f8872ea3640 1 -- 172.21.15.89:0/3351472254 shutdown_connections 2024-09-16T16:46:51.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.562+0000 7f8872ea3640 1 --2- 172.21.15.89:0/3351472254 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f885003e910 0x7f8850040e20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.562+0000 7f8872ea3640 1 --2- 172.21.15.89:0/3351472254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f886c09d010 0x7f886c130240 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.562+0000 7f8872ea3640 1 -- 172.21.15.89:0/3351472254 >> 172.21.15.89:0/3351472254 conn(0x7f886c0a0de0 msgr2=0x7f886c09b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.562+0000 7f8872ea3640 1 -- 172.21.15.89:0/3351472254 shutdown_connections 2024-09-16T16:46:51.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.562+0000 7f8872ea3640 1 -- 172.21.15.89:0/3351472254 wait complete. 2024-09-16T16:46:51.573 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T16:46:51.574 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T16:46:51.574 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T16:46:51.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T16:46:51.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.687+0000 7f37df991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.687+0000 7f72ebd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.687+0000 7efdbe991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.687+0000 7f5e0f0ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.692+0000 7f72ebd91640 1 Processor -- start 2024-09-16T16:46:51.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.693+0000 7f37df991640 1 Processor -- start 2024-09-16T16:46:51.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.693+0000 7f5e0f0ac640 1 Processor -- start 2024-09-16T16:46:51.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.693+0000 7efdbe991640 1 Processor -- start 2024-09-16T16:46:51.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.693+0000 7f5e0f0ac640 1 -- start start 2024-09-16T16:46:51.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.693+0000 7f72ebd91640 1 -- start start 2024-09-16T16:46:51.695 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.693+0000 7efdbe991640 1 -- start start 2024-09-16T16:46:51.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.693+0000 7f37df991640 1 -- start start 2024-09-16T16:46:51.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7f72ebd91640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f72e409daa0 0x7f72e409ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7efdbe991640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efdb8135380 0x7efdb81377a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7f72ebd91640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72e412f190 con 0x7f72e409cfa0 2024-09-16T16:46:51.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7f72ebd91640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f72e40706a0 con 0x7f72e409daa0 2024-09-16T16:46:51.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7f72e9b2d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f72e409daa0 0x7f72e409ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7efdbe991640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb809ce60 con 0x7efdb8131300 2024-09-16T16:46:51.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7efdbe991640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7efdb809e010 con 0x7efdb8135380 2024-09-16T16:46:51.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7efdb7fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7efdb8131300 0x7efdb8131710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51748/0 (socket says 172.21.15.89:51748) 2024-09-16T16:46:51.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7efdb7fff640 1 -- 172.21.15.89:0/2742380621 learned_addr learned my addr 172.21.15.89:0/2742380621 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T16:46:51.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7f37dd72d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f37d8132520 0x7f37d8132930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51758/0 (socket says 172.21.15.89:51758) 2024-09-16T16:46:51.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7f37df991640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f37d8138720 0x7f37d813ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7f72e9b2d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f72e409daa0 0x7f72e409ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36168/0 (socket says 172.21.15.89:36168) 2024-09-16T16:46:51.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7f72e9b2d640 1 -- 172.21.15.89:0/3835338784 learned_addr learned my addr 172.21.15.89:0/3835338784 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:51.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7efdb77fe640 1 --2- 172.21.15.89:0/2742380621 >> v2:172.21.15.89:3300/0 conn(0x7efdb8135380 0x7efdb81377a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7f37dd72d640 1 -- 172.21.15.89:0/1060256550 learned_addr learned my addr 172.21.15.89:0/1060256550 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T16:46:51.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7f72e932c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f72e409cfa0 0x7f72e4131770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51740/0 (socket says 172.21.15.89:51740) 2024-09-16T16:46:51.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7f5e0f0ac640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5e081317f0 0x7f5e08131c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.694+0000 7f37df991640 1 -- 172.21.15.89:0/1060256550 --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d8133040 con 0x7f37d8132520 2024-09-16T16:46:51.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f5e0f0ac640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e0809d310 con 0x7f5e0809ba50 2024-09-16T16:46:51.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f37df991640 1 -- 172.21.15.89:0/1060256550 --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f37d806f6d0 con 0x7f37d8138720 2024-09-16T16:46:51.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f5e0f0ac640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f5e0809d800 con 0x7f5e081317f0 2024-09-16T16:46:51.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f5e0ce48640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5e081317f0 0x7f5e08131c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f5e0ce48640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5e081317f0 0x7f5e08131c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36198/0 (socket says 172.21.15.89:36198) 2024-09-16T16:46:51.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f5e0ce48640 1 -- 172.21.15.89:0/1123024289 learned_addr learned my addr 172.21.15.89:0/1123024289 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:51.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f37dcf2c640 1 --2- 172.21.15.89:0/1060256550 >> v2:172.21.15.89:3300/0 conn(0x7f37d8138720 0x7f37d813ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f72e9b2d640 1 -- 172.21.15.89:0/3835338784 >> v1:172.21.15.89:6789/0 conn(0x7f72e409cfa0 legacy=0x7f72e4131770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f72e9b2d640 1 -- 172.21.15.89:0/3835338784 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e412e970 con 0x7f72e409daa0 2024-09-16T16:46:51.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7efdb6ffd640 1 -- 172.21.15.89:0/2742380621 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653470310 0 0) 0x7efdb809ce60 con 0x7efdb8131300 2024-09-16T16:46:51.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7efdb77fe640 1 -- 172.21.15.89:0/2742380621 >> v1:172.21.15.89:6789/0 conn(0x7efdb8131300 legacy=0x7efdb8131710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7efdb77fe640 1 -- 172.21.15.89:0/2742380621 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb8131e20 con 0x7efdb8135380 2024-09-16T16:46:51.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f37cffff640 1 -- 172.21.15.89:0/1060256550 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3441440868 0 0) 0x7f37d4001110 con 0x7f37d8132520 2024-09-16T16:46:51.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f37cffff640 1 -- 172.21.15.89:0/1060256550 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37c4003580 con 0x7f37d8132520 2024-09-16T16:46:51.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f5e0ce48640 1 -- 172.21.15.89:0/1123024289 >> v1:172.21.15.89:6789/0 conn(0x7f5e0809ba50 legacy=0x7f5e0809be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T16:46:51.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f5e0ce48640 1 -- 172.21.15.89:0/1123024289 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e081313a0 con 0x7f5e081317f0 2024-09-16T16:46:51.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f5e0ce48640 1 --2- 172.21.15.89:0/1123024289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e081317f0 0x7f5e08131c00 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284717cf05bc7b73 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f72e9b2d640 1 --2- 172.21.15.89:0/3835338784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e409daa0 0x7f72e409ca60 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2820a8284fa851b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f37dcf2c640 1 -- 172.21.15.89:0/1060256550 >> v1:172.21.15.89:6789/0 conn(0x7f37d8132520 legacy=0x7f37d8132930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7efdb77fe640 1 --2- 172.21.15.89:0/2742380621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb8135380 0x7efdb81377a0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1bda596cccaca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f37dcf2c640 1 -- 172.21.15.89:0/1060256550 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d806f3d0 con 0x7f37d8138720 2024-09-16T16:46:51.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7f37dcf2c640 1 --2- 172.21.15.89:0/1060256550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37d8138720 0x7f37d813ab40 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360d7f3007fd0e9e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.695+0000 7efdb6ffd640 1 -- 172.21.15.89:0/2742380621 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efdac009d90 con 0x7efdb8135380 2024-09-16T16:46:51.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.696+0000 7efdb6ffd640 1 -- 172.21.15.89:0/2742380621 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efdac00e230 con 0x7efdb8135380 2024-09-16T16:46:51.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.696+0000 7efdb6ffd640 1 -- 172.21.15.89:0/2742380621 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efdac00e4d0 con 0x7efdb8135380 2024-09-16T16:46:51.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.696+0000 7f5e077fe640 1 -- 172.21.15.89:0/1123024289 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5dfc00b720 con 0x7f5e081317f0 2024-09-16T16:46:51.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.696+0000 7f72e8b2b640 1 -- 172.21.15.89:0/3835338784 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f72e0009e10 con 0x7f72e409daa0 2024-09-16T16:46:51.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.696+0000 7f5e077fe640 1 -- 172.21.15.89:0/1123024289 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5dfc00b880 con 0x7f5e081317f0 2024-09-16T16:46:51.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.696+0000 7f5e077fe640 1 -- 172.21.15.89:0/1123024289 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5dfc00bb20 con 0x7f5e081317f0 2024-09-16T16:46:51.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.696+0000 7f72e8b2b640 1 -- 172.21.15.89:0/3835338784 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f72e000f470 con 0x7f72e409daa0 2024-09-16T16:46:51.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.696+0000 7f72e8b2b640 1 -- 172.21.15.89:0/3835338784 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f72e000f710 con 0x7f72e409daa0 2024-09-16T16:46:51.707 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.696+0000 7efdbe991640 1 -- 172.21.15.89:0/2742380621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb8135380 msgr2=0x7efdb81377a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.696+0000 7efdbe991640 1 --2- 172.21.15.89:0/2742380621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb8135380 0x7efdb81377a0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f37cffff640 1 -- 172.21.15.89:0/1060256550 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f37c8009d90 con 0x7f37d8138720 2024-09-16T16:46:51.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f37cffff640 1 -- 172.21.15.89:0/1060256550 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f37c800e230 con 0x7f37d8138720 2024-09-16T16:46:51.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f37cffff640 1 -- 172.21.15.89:0/1060256550 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f37c800e4d0 con 0x7f37d8138720 2024-09-16T16:46:51.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7efdbe991640 1 -- 172.21.15.89:0/2742380621 shutdown_connections 2024-09-16T16:46:51.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7efdbe991640 1 --2- 172.21.15.89:0/2742380621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb8135380 0x7efdb81377a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7efdbe991640 1 -- 172.21.15.89:0/2742380621 >> 172.21.15.89:0/2742380621 conn(0x7efdb8069d10 msgr2=0x7efdb809f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7efdbe991640 1 -- 172.21.15.89:0/2742380621 shutdown_connections 2024-09-16T16:46:51.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7efdbe991640 1 -- 172.21.15.89:0/2742380621 wait complete. 2024-09-16T16:46:51.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f5e0f0ac640 1 -- 172.21.15.89:0/1123024289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e081317f0 msgr2=0x7f5e08131c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f5e0f0ac640 1 --2- 172.21.15.89:0/1123024289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e081317f0 0x7f5e08131c00 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f72ebd91640 1 -- 172.21.15.89:0/3835338784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e409daa0 msgr2=0x7f72e409ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f72ebd91640 1 --2- 172.21.15.89:0/3835338784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e409daa0 0x7f72e409ca60 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f5e0f0ac640 1 -- 172.21.15.89:0/1123024289 shutdown_connections 2024-09-16T16:46:51.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7efdbe991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f5e0f0ac640 1 --2- 172.21.15.89:0/1123024289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e081317f0 0x7f5e08131c00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f5e0f0ac640 1 -- 172.21.15.89:0/1123024289 >> 172.21.15.89:0/1123024289 conn(0x7f5e08069d60 msgr2=0x7f5e0809e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f72ebd91640 1 -- 172.21.15.89:0/3835338784 shutdown_connections 2024-09-16T16:46:51.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f72ebd91640 1 --2- 172.21.15.89:0/3835338784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e409daa0 0x7f72e409ca60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f72ebd91640 1 -- 172.21.15.89:0/3835338784 >> 172.21.15.89:0/3835338784 conn(0x7f72e4069d60 msgr2=0x7f72e409e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f5e0f0ac640 1 -- 172.21.15.89:0/1123024289 shutdown_connections 2024-09-16T16:46:51.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f5e0f0ac640 1 -- 172.21.15.89:0/1123024289 wait complete. 2024-09-16T16:46:51.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f72ebd91640 1 -- 172.21.15.89:0/3835338784 shutdown_connections 2024-09-16T16:46:51.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f72ebd91640 1 -- 172.21.15.89:0/3835338784 wait complete. 2024-09-16T16:46:51.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f5e0f0ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.697+0000 7f37df991640 1 -- 172.21.15.89:0/1060256550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37d8138720 msgr2=0x7f37d813ab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.698+0000 7f37df991640 1 --2- 172.21.15.89:0/1060256550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37d8138720 0x7f37d813ab40 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.698+0000 7f72ebd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.698+0000 7f37df991640 1 -- 172.21.15.89:0/1060256550 shutdown_connections 2024-09-16T16:46:51.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.698+0000 7f37df991640 1 --2- 172.21.15.89:0/1060256550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37d8138720 0x7f37d813ab40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.698+0000 7f37df991640 1 -- 172.21.15.89:0/1060256550 >> 172.21.15.89:0/1060256550 conn(0x7f37d806e490 msgr2=0x7f37d806e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.698+0000 7f37df991640 1 -- 172.21.15.89:0/1060256550 shutdown_connections 2024-09-16T16:46:51.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.698+0000 7f37df991640 1 -- 172.21.15.89:0/1060256550 wait complete. 2024-09-16T16:46:51.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.698+0000 7f37df991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.699+0000 7efdbe991640 1 Processor -- start 2024-09-16T16:46:51.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.699+0000 7efdbe991640 1 -- start start 2024-09-16T16:46:51.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.699+0000 7f5e0f0ac640 1 Processor -- start 2024-09-16T16:46:51.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.699+0000 7f5e0f0ac640 1 -- start start 2024-09-16T16:46:51.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.699+0000 7f37df991640 1 Processor -- start 2024-09-16T16:46:51.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.699+0000 7f72ebd91640 1 Processor -- start 2024-09-16T16:46:51.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.699+0000 7f72ebd91640 1 -- start start 2024-09-16T16:46:51.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.700+0000 7f37df991640 1 -- start start 2024-09-16T16:46:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.700+0000 7efdbe991640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb8131300 0x7efdb811e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.700+0000 7efdbe991640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efdb811f310 con 0x7efdb8131300 2024-09-16T16:46:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.700+0000 7efdb7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb8131300 0x7efdb811e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.700+0000 7efdb7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb8131300 0x7efdb811e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36200/0 (socket says 172.21.15.89:36200) 2024-09-16T16:46:51.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.700+0000 7efdb7fff640 1 -- 172.21.15.89:0/3055618088 learned_addr learned my addr 172.21.15.89:0/3055618088 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.700+0000 7f5e0f0ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0809ba50 0x7f5e08134530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.700+0000 7f5e0f0ac640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0811a9e0 con 0x7f5e0809ba50 2024-09-16T16:46:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f5e0ce48640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0809ba50 0x7f5e08134530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f5e0ce48640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0809ba50 0x7f5e08134530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36202/0 (socket says 172.21.15.89:36202) 2024-09-16T16:46:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f5e0ce48640 1 -- 172.21.15.89:0/2028655872 learned_addr learned my addr 172.21.15.89:0/2028655872 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f72ebd91640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e409cfa0 0x7f72e411f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f72ebd91640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f72e4120790 con 0x7f72e409cfa0 2024-09-16T16:46:51.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7efdb7fff640 1 -- 172.21.15.89:0/3055618088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb811ddf0 con 0x7efdb8131300 2024-09-16T16:46:51.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f72e9b2d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e409cfa0 0x7f72e411f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f72e9b2d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e409cfa0 0x7f72e411f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36218/0 (socket says 172.21.15.89:36218) 2024-09-16T16:46:51.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f72e9b2d640 1 -- 172.21.15.89:0/1264880035 learned_addr learned my addr 172.21.15.89:0/1264880035 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:51.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f37df991640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37d8132520 0x7f37d812ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f37df991640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f37d811e2c0 con 0x7f37d8132520 2024-09-16T16:46:51.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7efdb7fff640 1 --2- 172.21.15.89:0/3055618088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb8131300 0x7efdb811e080 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.721 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f37dd72d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37d8132520 0x7f37d812ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f37dd72d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37d8132520 0x7f37d812ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36228/0 (socket says 172.21.15.89:36228) 2024-09-16T16:46:51.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f37dd72d640 1 -- 172.21.15.89:0/1633130857 learned_addr learned my addr 172.21.15.89:0/1633130857 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:51.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f5e0ce48640 1 -- 172.21.15.89:0/2028655872 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0811ac80 con 0x7f5e0809ba50 2024-09-16T16:46:51.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f5e0ce48640 1 --2- 172.21.15.89:0/2028655872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0809ba50 0x7f5e08134530 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7efdb4ff9640 1 -- 172.21.15.89:0/3055618088 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efda8004b80 con 0x7efdb8131300 2024-09-16T16:46:51.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7efdb4ff9640 1 -- 172.21.15.89:0/3055618088 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efda8004ce0 con 0x7efdb8131300 2024-09-16T16:46:51.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7efdb4ff9640 1 -- 172.21.15.89:0/3055618088 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efda8007120 con 0x7efdb8131300 2024-09-16T16:46:51.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7efdbe991640 1 -- 172.21.15.89:0/3055618088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb811d7f0 con 0x7efdb8131300 2024-09-16T16:46:51.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7efdbe991640 1 -- 172.21.15.89:0/3055618088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb811fae0 con 0x7efdb8131300 2024-09-16T16:46:51.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f5e057fa640 1 -- 172.21.15.89:0/2028655872 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5dfc014410 con 0x7f5e0809ba50 2024-09-16T16:46:51.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f5e057fa640 1 -- 172.21.15.89:0/2028655872 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5dfc014570 con 0x7f5e0809ba50 2024-09-16T16:46:51.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f5e0f0ac640 1 -- 172.21.15.89:0/2028655872 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e0812ca70 con 0x7f5e0809ba50 2024-09-16T16:46:51.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.702+0000 7f5e057fa640 1 -- 172.21.15.89:0/2028655872 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5dfc014810 con 0x7f5e0809ba50 2024-09-16T16:46:51.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.701+0000 7f72e9b2d640 1 -- 172.21.15.89:0/1264880035 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e41223b0 con 0x7f72e409cfa0 2024-09-16T16:46:51.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.702+0000 7f37dd72d640 1 -- 172.21.15.89:0/1633130857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d811e090 con 0x7f37d8132520 2024-09-16T16:46:51.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.702+0000 7f5e0f0ac640 1 -- 172.21.15.89:0/2028655872 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e08135f20 con 0x7f5e0809ba50 2024-09-16T16:46:51.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.702+0000 7f37dd72d640 1 --2- 172.21.15.89:0/1633130857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37d8132520 0x7f37d812ece0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.702+0000 7f72e9b2d640 1 --2- 172.21.15.89:0/1264880035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e409cfa0 0x7f72e411f300 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.703+0000 7efdbe991640 1 -- 172.21.15.89:0/3055618088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efdb811dbf0 con 0x7efdb8131300 2024-09-16T16:46:51.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.703+0000 7f5e0f0ac640 1 -- 172.21.15.89:0/2028655872 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e08074cf0 con 0x7f5e0809ba50 2024-09-16T16:46:51.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.703+0000 7f72da7fc640 1 -- 172.21.15.89:0/1264880035 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f72e0014040 con 0x7f72e409cfa0 2024-09-16T16:46:51.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.703+0000 7f37cdffb640 1 -- 172.21.15.89:0/1633130857 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f37d4005930 con 0x7f37d8132520 2024-09-16T16:46:51.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.703+0000 7f72ebd91640 1 -- 172.21.15.89:0/1264880035 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e4120bc0 con 0x7f72e409cfa0 2024-09-16T16:46:51.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.703+0000 7f72da7fc640 1 -- 172.21.15.89:0/1264880035 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f72e000e440 con 0x7f72e409cfa0 2024-09-16T16:46:51.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.703+0000 7f37df991640 1 -- 172.21.15.89:0/1633130857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d80a0f40 con 0x7f37d8132520 2024-09-16T16:46:51.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.703+0000 7f72da7fc640 1 -- 172.21.15.89:0/1264880035 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f72e000e6e0 con 0x7f72e409cfa0 2024-09-16T16:46:51.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.703+0000 7f72ebd91640 1 -- 172.21.15.89:0/1264880035 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e4121470 con 0x7f72e409cfa0 2024-09-16T16:46:51.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.703+0000 7f37cdffb640 1 -- 172.21.15.89:0/1633130857 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f37d4005a90 con 0x7f37d8132520 2024-09-16T16:46:51.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.703+0000 7f37df991640 1 -- 172.21.15.89:0/1633130857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d811e8e0 con 0x7f37d8132520 2024-09-16T16:46:51.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.703+0000 7f37cdffb640 1 -- 172.21.15.89:0/1633130857 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f37d4005d30 con 0x7f37d8132520 2024-09-16T16:46:51.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.703+0000 7f5e057fa640 1 -- 172.21.15.89:0/2028655872 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f5dfc014a10 con 0x7f5e0809ba50 2024-09-16T16:46:51.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.704+0000 7f37df991640 1 -- 172.21.15.89:0/1633130857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f37b8000f80 con 0x7f37d8132520 2024-09-16T16:46:51.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.703+0000 7efdb4ff9640 1 -- 172.21.15.89:0/3055618088 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7efda8007280 con 0x7efdb8131300 2024-09-16T16:46:51.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.703+0000 7efdb4ff9640 1 --2- 172.21.15.89:0/3055618088 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7efda403e9d0 0x7efda4040ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.703+0000 7efdb4ff9640 1 -- 172.21.15.89:0/3055618088 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7efda804f7e0 con 0x7efdb8131300 2024-09-16T16:46:51.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.704+0000 7f72ebd91640 1 -- 172.21.15.89:0/1264880035 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f72e4122240 con 0x7f72e409cfa0 2024-09-16T16:46:51.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.704+0000 7efdb4ff9640 1 --2- 172.21.15.89:0/3055618088 >> v2:172.21.15.89:6803/245700216 conn(0x7efda40439d0 0x7efda4045ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.704+0000 7efdb4ff9640 1 -- 172.21.15.89:0/3055618088 --> v2:172.21.15.89:6803/245700216 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efda4046530 con 0x7efda40439d0 2024-09-16T16:46:51.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.704+0000 7efdb4ff9640 1 -- 172.21.15.89:0/3055618088 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7efda800f420 con 0x7efdb8131300 2024-09-16T16:46:51.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.705+0000 7efdb77fe640 1 --2- 172.21.15.89:0/3055618088 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7efda403e9d0 0x7efda4040ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.705+0000 7f5e057fa640 1 --2- 172.21.15.89:0/2028655872 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f5dec042d40 0x7f5dec045250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.705+0000 7f5e057fa640 1 -- 172.21.15.89:0/2028655872 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f5dfc019040 con 0x7f5e0809ba50 2024-09-16T16:46:51.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.705+0000 7f5e057fa640 1 --2- 172.21.15.89:0/2028655872 >> v2:172.21.15.177:6807/75130198 conn(0x7f5dec047d40 0x7f5dec04a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.705+0000 7f72da7fc640 1 -- 172.21.15.89:0/1264880035 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f72e0017040 con 0x7f72e409cfa0 2024-09-16T16:46:51.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.705+0000 7f5e057fa640 1 -- 172.21.15.89:0/2028655872 --> v2:172.21.15.177:6807/75130198 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5dec04a8a0 con 0x7f5dec047d40 2024-09-16T16:46:51.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.705+0000 7f5e057fa640 1 -- 172.21.15.89:0/2028655872 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f5dfc053310 con 0x7f5e0809ba50 2024-09-16T16:46:51.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.705+0000 7efdbcf2e640 1 --2- 172.21.15.89:0/3055618088 >> v2:172.21.15.89:6803/245700216 conn(0x7efda40439d0 0x7efda4045ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T16:46:51.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.705+0000 7f5e07fff640 1 --2- 172.21.15.89:0/2028655872 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f5dec042d40 0x7f5dec045250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.705+0000 7efdb77fe640 1 --2- 172.21.15.89:0/3055618088 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7efda403e9d0 0x7efda4040ee0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.706+0000 7f5e07fff640 1 --2- 172.21.15.89:0/2028655872 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f5dec042d40 0x7f5dec045250 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.705+0000 7f37cdffb640 1 -- 172.21.15.89:0/1633130857 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f37d400c800 con 0x7f37d8132520 2024-09-16T16:46:51.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.706+0000 7f37cdffb640 1 --2- 172.21.15.89:0/1633130857 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f37bc03e980 0x7f37bc040e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.706+0000 7f72da7fc640 1 --2- 172.21.15.89:0/1264880035 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f72c803e8e0 0x7f72c8040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.706+0000 7f37cdffb640 1 -- 172.21.15.89:0/1633130857 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f37d404f5b0 con 0x7f37d8132520 2024-09-16T16:46:51.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.706+0000 7f72da7fc640 1 -- 172.21.15.89:0/1264880035 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f72e0050570 con 0x7f72e409cfa0 2024-09-16T16:46:51.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.706+0000 7f37cdffb640 1 --2- 172.21.15.89:0/1633130857 >> v2:172.21.15.177:6806/229775330 conn(0x7f37bc043980 0x7f37bc045e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.706+0000 7f37cdffb640 1 -- 172.21.15.89:0/1633130857 --> v2:172.21.15.177:6806/229775330 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37bc0464e0 con 0x7f37bc043980 2024-09-16T16:46:51.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.706+0000 7f37cdffb640 1 -- 172.21.15.89:0/1633130857 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f37d400f230 con 0x7f37d8132520 2024-09-16T16:46:51.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.706+0000 7f72da7fc640 1 --2- 172.21.15.89:0/1264880035 >> v2:172.21.15.89:6801/3499031688 conn(0x7f72c80438e0 0x7f72c8045db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.706+0000 7f72e932c640 1 --2- 172.21.15.89:0/1264880035 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f72c803e8e0 0x7f72c8040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.706+0000 7f5e0d649640 1 --2- 172.21.15.89:0/2028655872 >> v2:172.21.15.177:6807/75130198 conn(0x7f5dec047d40 0x7f5dec04a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T16:46:51.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.706+0000 7f37dcf2c640 1 --2- 172.21.15.89:0/1633130857 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f37bc03e980 0x7f37bc040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.706+0000 7f72da7fc640 1 -- 172.21.15.89:0/1264880035 --> v2:172.21.15.89:6801/3499031688 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72c8046440 con 0x7f72c80438e0 2024-09-16T16:46:51.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.706+0000 7f72da7fc640 1 -- 172.21.15.89:0/1264880035 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f72e0052ae0 con 0x7f72e409cfa0 2024-09-16T16:46:51.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.707+0000 7f37dcf2c640 1 --2- 172.21.15.89:0/1633130857 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f37bc03e980 0x7f37bc040e90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.707+0000 7f72ea32e640 1 --2- 172.21.15.89:0/1264880035 >> v2:172.21.15.89:6801/3499031688 conn(0x7f72c80438e0 0x7f72c8045db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T16:46:51.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.707+0000 7f72e932c640 1 --2- 172.21.15.89:0/1264880035 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f72c803e8e0 0x7f72c8040df0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.707+0000 7f37ddf2e640 1 --2- 172.21.15.89:0/1633130857 >> v2:172.21.15.177:6806/229775330 conn(0x7f37bc043980 0x7f37bc045e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T16:46:51.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.710+0000 7efdbcf2e640 1 --2- 172.21.15.89:0/3055618088 >> v2:172.21.15.89:6803/245700216 conn(0x7efda40439d0 0x7efda4045ea0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.710+0000 7f5e0d649640 1 --2- 172.21.15.89:0/2028655872 >> v2:172.21.15.177:6807/75130198 conn(0x7f5dec047d40 0x7f5dec04a210 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.711+0000 7f72ea32e640 1 --2- 172.21.15.89:0/1264880035 >> v2:172.21.15.89:6801/3499031688 conn(0x7f72c80438e0 0x7f72c8045db0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.711+0000 7f5e057fa640 1 -- 172.21.15.89:0/2028655872 <== osd.3 v2:172.21.15.177:6807/75130198 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f5dec04a8a0 con 0x7f5dec047d40 2024-09-16T16:46:51.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.711+0000 7f37ddf2e640 1 --2- 172.21.15.89:0/1633130857 >> v2:172.21.15.177:6806/229775330 conn(0x7f37bc043980 0x7f37bc045e50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.711+0000 7efdb4ff9640 1 -- 172.21.15.89:0/3055618088 <== osd.1 v2:172.21.15.89:6803/245700216 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7efda4046530 con 0x7efda40439d0 2024-09-16T16:46:51.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.713+0000 7f72da7fc640 1 -- 172.21.15.89:0/1264880035 <== osd.0 v2:172.21.15.89:6801/3499031688 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f72c8046440 con 0x7f72c80438e0 2024-09-16T16:46:51.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.714+0000 7f37cdffb640 1 -- 172.21.15.89:0/1633130857 <== osd.2 v2:172.21.15.177:6806/229775330 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f37bc0464e0 con 0x7f37bc043980 2024-09-16T16:46:51.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.715+0000 7f5e0f0ac640 1 -- 172.21.15.89:0/2028655872 --> v2:172.21.15.177:6807/75130198 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e0806f960 con 0x7f5dec047d40 2024-09-16T16:46:51.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.716+0000 7efdbe991640 1 -- 172.21.15.89:0/3055618088 --> v2:172.21.15.89:6803/245700216 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efdb8074b50 con 0x7efda40439d0 2024-09-16T16:46:51.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.716+0000 7f72ebd91640 1 -- 172.21.15.89:0/1264880035 --> v2:172.21.15.89:6801/3499031688 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f72e406f860 con 0x7f72c80438e0 2024-09-16T16:46:51.741 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.716+0000 7f5e057fa640 1 -- 172.21.15.89:0/2028655872 <== osd.3 v2:172.21.15.177:6807/75130198 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5e0000a820 con 0x7f5dec047d40 2024-09-16T16:46:51.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.717+0000 7f5e0f0ac640 1 -- 172.21.15.89:0/2028655872 >> v2:172.21.15.177:6807/75130198 conn(0x7f5dec047d40 msgr2=0x7f5dec04a210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.717+0000 7f5e0f0ac640 1 --2- 172.21.15.89:0/2028655872 >> v2:172.21.15.177:6807/75130198 conn(0x7f5dec047d40 0x7f5dec04a210 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.717+0000 7f5e0f0ac640 1 -- 172.21.15.89:0/2028655872 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f5dec042d40 msgr2=0x7f5dec045250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.717+0000 7f5e0f0ac640 1 --2- 172.21.15.89:0/2028655872 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f5dec042d40 0x7f5dec045250 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.717+0000 7f5e0f0ac640 1 -- 172.21.15.89:0/2028655872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0809ba50 msgr2=0x7f5e08134530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.717+0000 7f5e0f0ac640 1 --2- 172.21.15.89:0/2028655872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0809ba50 0x7f5e08134530 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.717+0000 7f5e0f0ac640 1 -- 172.21.15.89:0/2028655872 shutdown_connections 2024-09-16T16:46:51.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.717+0000 7f5e0f0ac640 1 --2- 172.21.15.89:0/2028655872 >> v2:172.21.15.177:6807/75130198 conn(0x7f5dec047d40 0x7f5dec04a210 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.717+0000 7f5e0f0ac640 1 --2- 172.21.15.89:0/2028655872 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f5dec042d40 0x7f5dec045250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.717+0000 7f5e0f0ac640 1 --2- 172.21.15.89:0/2028655872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e0809ba50 0x7f5e08134530 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.717+0000 7f5e0f0ac640 1 -- 172.21.15.89:0/2028655872 >> 172.21.15.89:0/2028655872 conn(0x7f5e08069d60 msgr2=0x7f5e0812f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.717+0000 7f5e0f0ac640 1 -- 172.21.15.89:0/2028655872 shutdown_connections 2024-09-16T16:46:51.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.717+0000 7f5e0f0ac640 1 -- 172.21.15.89:0/2028655872 wait complete. 2024-09-16T16:46:51.743 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.718+0000 7f72da7fc640 1 -- 172.21.15.89:0/1264880035 <== osd.0 v2:172.21.15.89:6801/3499031688 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f72dc00a820 con 0x7f72c80438e0 2024-09-16T16:46:51.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.718+0000 7efdb4ff9640 1 -- 172.21.15.89:0/3055618088 <== osd.1 v2:172.21.15.89:6803/245700216 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efdb000a820 con 0x7efda40439d0 2024-09-16T16:46:51.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7f72ebd91640 1 -- 172.21.15.89:0/1264880035 >> v2:172.21.15.89:6801/3499031688 conn(0x7f72c80438e0 msgr2=0x7f72c8045db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7f72ebd91640 1 --2- 172.21.15.89:0/1264880035 >> v2:172.21.15.89:6801/3499031688 conn(0x7f72c80438e0 0x7f72c8045db0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7efdbe991640 1 -- 172.21.15.89:0/3055618088 >> v2:172.21.15.89:6803/245700216 conn(0x7efda40439d0 msgr2=0x7efda4045ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7efdbe991640 1 --2- 172.21.15.89:0/3055618088 >> v2:172.21.15.89:6803/245700216 conn(0x7efda40439d0 0x7efda4045ea0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7f72ebd91640 1 -- 172.21.15.89:0/1264880035 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f72c803e8e0 msgr2=0x7f72c8040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7f72ebd91640 1 --2- 172.21.15.89:0/1264880035 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f72c803e8e0 0x7f72c8040df0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7f72ebd91640 1 -- 172.21.15.89:0/1264880035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e409cfa0 msgr2=0x7f72e411f300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7f72ebd91640 1 --2- 172.21.15.89:0/1264880035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e409cfa0 0x7f72e411f300 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7efdbe991640 1 -- 172.21.15.89:0/3055618088 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7efda403e9d0 msgr2=0x7efda4040ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7efdbe991640 1 --2- 172.21.15.89:0/3055618088 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7efda403e9d0 0x7efda4040ee0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7efdbe991640 1 -- 172.21.15.89:0/3055618088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb8131300 msgr2=0x7efdb811e080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7efdbe991640 1 --2- 172.21.15.89:0/3055618088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb8131300 0x7efdb811e080 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7efdbe991640 1 -- 172.21.15.89:0/3055618088 shutdown_connections 2024-09-16T16:46:51.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7efdbe991640 1 --2- 172.21.15.89:0/3055618088 >> v2:172.21.15.89:6803/245700216 conn(0x7efda40439d0 0x7efda4045ea0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7efdbe991640 1 --2- 172.21.15.89:0/3055618088 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7efda403e9d0 0x7efda4040ee0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7efdbe991640 1 --2- 172.21.15.89:0/3055618088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb8131300 0x7efdb811e080 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7efdbe991640 1 -- 172.21.15.89:0/3055618088 >> 172.21.15.89:0/3055618088 conn(0x7efdb8069d10 msgr2=0x7efdb8070600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7efdbe991640 1 -- 172.21.15.89:0/3055618088 shutdown_connections 2024-09-16T16:46:51.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.719+0000 7efdbe991640 1 -- 172.21.15.89:0/3055618088 wait complete. 2024-09-16T16:46:51.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.720+0000 7f72ebd91640 1 -- 172.21.15.89:0/1264880035 shutdown_connections 2024-09-16T16:46:51.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.720+0000 7f72ebd91640 1 --2- 172.21.15.89:0/1264880035 >> v2:172.21.15.89:6801/3499031688 conn(0x7f72c80438e0 0x7f72c8045db0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.720+0000 7f72ebd91640 1 --2- 172.21.15.89:0/1264880035 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f72c803e8e0 0x7f72c8040df0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.720+0000 7f72ebd91640 1 --2- 172.21.15.89:0/1264880035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72e409cfa0 0x7f72e411f300 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.720+0000 7f72ebd91640 1 -- 172.21.15.89:0/1264880035 >> 172.21.15.89:0/1264880035 conn(0x7f72e4069d60 msgr2=0x7f72e409eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.720+0000 7f72ebd91640 1 -- 172.21.15.89:0/1264880035 shutdown_connections 2024-09-16T16:46:51.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.720+0000 7f72ebd91640 1 -- 172.21.15.89:0/1264880035 wait complete. 2024-09-16T16:46:51.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.721+0000 7f37df991640 1 -- 172.21.15.89:0/1633130857 --> v2:172.21.15.177:6806/229775330 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f37b8002c30 con 0x7f37bc043980 2024-09-16T16:46:51.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.723+0000 7f37cdffb640 1 -- 172.21.15.89:0/1633130857 <== osd.2 v2:172.21.15.177:6806/229775330 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f37b8002c30 con 0x7f37bc043980 2024-09-16T16:46:51.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.723+0000 7f37df991640 1 -- 172.21.15.89:0/1633130857 >> v2:172.21.15.177:6806/229775330 conn(0x7f37bc043980 msgr2=0x7f37bc045e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.723+0000 7f37df991640 1 --2- 172.21.15.89:0/1633130857 >> v2:172.21.15.177:6806/229775330 conn(0x7f37bc043980 0x7f37bc045e50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.723+0000 7f37df991640 1 -- 172.21.15.89:0/1633130857 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f37bc03e980 msgr2=0x7f37bc040e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.723+0000 7f37df991640 1 --2- 172.21.15.89:0/1633130857 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f37bc03e980 0x7f37bc040e90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.723+0000 7f37df991640 1 -- 172.21.15.89:0/1633130857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37d8132520 msgr2=0x7f37d812ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.723+0000 7f37df991640 1 --2- 172.21.15.89:0/1633130857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37d8132520 0x7f37d812ece0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.724+0000 7f37df991640 1 -- 172.21.15.89:0/1633130857 shutdown_connections 2024-09-16T16:46:51.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.724+0000 7f37df991640 1 --2- 172.21.15.89:0/1633130857 >> v2:172.21.15.177:6806/229775330 conn(0x7f37bc043980 0x7f37bc045e50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.724+0000 7f37df991640 1 --2- 172.21.15.89:0/1633130857 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f37bc03e980 0x7f37bc040e90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.724+0000 7f37df991640 1 --2- 172.21.15.89:0/1633130857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37d8132520 0x7f37d812ece0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.724+0000 7f37df991640 1 -- 172.21.15.89:0/1633130857 >> 172.21.15.89:0/1633130857 conn(0x7f37d806e490 msgr2=0x7f37d81bd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.724+0000 7f37df991640 1 -- 172.21.15.89:0/1633130857 shutdown_connections 2024-09-16T16:46:51.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.724+0000 7f37df991640 1 -- 172.21.15.89:0/1633130857 wait complete. 2024-09-16T16:46:51.751 INFO:teuthology.orchestra.run.smithi089.stdout:38654705672 2024-09-16T16:46:51.752 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T16:46:51.752 INFO:teuthology.orchestra.run.smithi089.stdout:38654705672 2024-09-16T16:46:51.753 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T16:46:51.753 INFO:teuthology.orchestra.run.smithi089.stdout:38654705672 2024-09-16T16:46:51.754 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T16:46:51.754 INFO:teuthology.orchestra.run.smithi089.stdout:38654705672 2024-09-16T16:46:51.755 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T16:46:51.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.906+0000 7f8919d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.906+0000 7ff092b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.906+0000 7f7a0566c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.906+0000 7f20d2c9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.912+0000 7f7a0566c640 1 Processor -- start 2024-09-16T16:46:51.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.912+0000 7ff092b11640 1 Processor -- start 2024-09-16T16:46:51.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.912+0000 7f8919d51640 1 Processor -- start 2024-09-16T16:46:51.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.912+0000 7f7a0566c640 1 -- start start 2024-09-16T16:46:51.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.912+0000 7ff092b11640 1 -- start start 2024-09-16T16:46:51.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.912+0000 7f8919d51640 1 -- start start 2024-09-16T16:46:51.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.912+0000 7f20d2c9c640 1 Processor -- start 2024-09-16T16:46:51.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.912+0000 7f20d2c9c640 1 -- start start 2024-09-16T16:46:51.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f7a0566c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7a00132520 0x7f7a00132930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7ff092b11640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff08c06fb20 0x7ff08c136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f7a0566c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a0006f6d0 con 0x7f7a000a3450 2024-09-16T16:46:51.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f8919d51640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8914132520 0x7f8914132930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7ff092b11640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff08c09dd50 con 0x7ff08c070240 2024-09-16T16:46:51.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7ff092b11640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7ff08c131bc0 con 0x7ff08c06fb20 2024-09-16T16:46:51.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f7a0566c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f7a0006f3d0 con 0x7f7a00132520 2024-09-16T16:46:51.916 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f20d2c9c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f20cc0717b0 0x7f20cc071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f8919d51640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f891406f6d0 con 0x7f89140a3450 2024-09-16T16:46:51.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7ff08bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff08c06fb20 0x7ff08c136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f20d2c9c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20cc072860 con 0x7f20cc072100 2024-09-16T16:46:51.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f20d2c9c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f20cc0a1f50 con 0x7f20cc0717b0 2024-09-16T16:46:51.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7ff08bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff08c06fb20 0x7ff08c136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36238/0 (socket says 172.21.15.89:36238) 2024-09-16T16:46:51.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7ff08bfff640 1 -- 172.21.15.89:0/1406653125 learned_addr learned my addr 172.21.15.89:0/1406653125 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:51.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f20cbfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f20cc072100 0x7f20cc130040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51798/0 (socket says 172.21.15.89:51798) 2024-09-16T16:46:51.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f20cbfff640 1 -- 172.21.15.89:0/2417330364 learned_addr learned my addr 172.21.15.89:0/2417330364 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T16:46:51.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f20d0a38640 1 --2- 172.21.15.89:0/2417330364 >> v2:172.21.15.89:3300/0 conn(0x7f20cc0717b0 0x7f20cc071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.918 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f8919d51640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f891406f3d0 con 0x7f8914132520 2024-09-16T16:46:51.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f89137fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8914132520 0x7f8914132930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f79fe7fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7a000a3450 0x7f7a000a3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51784/0 (socket says 172.21.15.89:51784) 2024-09-16T16:46:51.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f79fe7fc640 1 -- 172.21.15.89:0/1668130262 learned_addr learned my addr 172.21.15.89:0/1668130262 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T16:46:51.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f79feffd640 1 --2- 172.21.15.89:0/1668130262 >> v2:172.21.15.89:3300/0 conn(0x7f7a00132520 0x7f7a00132930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f8912ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f89140a3450 0x7f89140a3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51794/0 (socket says 172.21.15.89:51794) 2024-09-16T16:46:51.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.913+0000 7f8912ffd640 1 -- 172.21.15.89:0/1696854964 learned_addr learned my addr 172.21.15.89:0/1696854964 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T16:46:51.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7ff08bfff640 1 -- 172.21.15.89:0/1406653125 >> v1:172.21.15.89:6789/0 conn(0x7ff08c070240 legacy=0x7ff08c131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7ff08bfff640 1 -- 172.21.15.89:0/1406653125 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08c06f860 con 0x7ff08c06fb20 2024-09-16T16:46:51.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7f89127fc640 1 -- 172.21.15.89:0/1696854964 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 787127246 0 0) 0x7f891406f6d0 con 0x7f89140a3450 2024-09-16T16:46:51.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7ff08bfff640 1 --2- 172.21.15.89:0/1406653125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08c06fb20 0x7ff08c136ac0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de65eb0ff0c2973d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7f89127fc640 1 -- 172.21.15.89:0/1696854964 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88fc003580 con 0x7f89140a3450 2024-09-16T16:46:51.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7f20d0a38640 1 -- 172.21.15.89:0/2417330364 >> v1:172.21.15.89:6789/0 conn(0x7f20cc072100 legacy=0x7f20cc130040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7f20cb7fe640 1 -- 172.21.15.89:0/2417330364 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 281816715 0 0) 0x7f20cc072860 con 0x7f20cc072100 2024-09-16T16:46:51.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7f79feffd640 1 -- 172.21.15.89:0/1668130262 >> v1:172.21.15.89:6789/0 conn(0x7f7a000a3450 legacy=0x7f7a000a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7f89137fe640 1 -- 172.21.15.89:0/1696854964 >> v1:172.21.15.89:6789/0 conn(0x7f89140a3450 legacy=0x7f89140a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7f20d0a38640 1 -- 172.21.15.89:0/2417330364 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20cc074760 con 0x7f20cc0717b0 2024-09-16T16:46:51.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7f89137fe640 1 -- 172.21.15.89:0/1696854964 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891406f0c0 con 0x7f8914132520 2024-09-16T16:46:51.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7ff08b7fe640 1 -- 172.21.15.89:0/1406653125 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff078009e50 con 0x7ff08c06fb20 2024-09-16T16:46:51.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7f79feffd640 1 -- 172.21.15.89:0/1668130262 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0006f0c0 con 0x7f7a00132520 2024-09-16T16:46:51.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7ff08b7fe640 1 -- 172.21.15.89:0/1406653125 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff07800e230 con 0x7ff08c06fb20 2024-09-16T16:46:51.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7ff08b7fe640 1 -- 172.21.15.89:0/1406653125 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff078009e50 con 0x7ff08c06fb20 2024-09-16T16:46:51.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7f89137fe640 1 --2- 172.21.15.89:0/1696854964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8914132520 0x7f8914132930 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0303ab41c3a9ca server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7f20d0a38640 1 --2- 172.21.15.89:0/2417330364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20cc0717b0 0x7f20cc071bc0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0472a651f475653 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7f79feffd640 1 --2- 172.21.15.89:0/1668130262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a00132520 0x7f7a00132930 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7f7ae5c2bd9865 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7f89127fc640 1 -- 172.21.15.89:0/1696854964 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8904009d90 con 0x7f8914132520 2024-09-16T16:46:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7f89127fc640 1 -- 172.21.15.89:0/1696854964 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f890400e230 con 0x7f8914132520 2024-09-16T16:46:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7f20cb7fe640 1 -- 172.21.15.89:0/2417330364 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f20c0009d90 con 0x7f20cc0717b0 2024-09-16T16:46:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7f79fdffb640 1 -- 172.21.15.89:0/1668130262 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f79f0009d90 con 0x7f7a00132520 2024-09-16T16:46:51.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7f20cb7fe640 1 -- 172.21.15.89:0/2417330364 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f20c000e230 con 0x7f20cc0717b0 2024-09-16T16:46:51.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.914+0000 7f89127fc640 1 -- 172.21.15.89:0/1696854964 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f890400e4d0 con 0x7f8914132520 2024-09-16T16:46:51.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7f20cb7fe640 1 -- 172.21.15.89:0/2417330364 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f20c000e4d0 con 0x7f20cc0717b0 2024-09-16T16:46:51.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7f79fdffb640 1 -- 172.21.15.89:0/1668130262 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f79f000e230 con 0x7f7a00132520 2024-09-16T16:46:51.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7f79fdffb640 1 -- 172.21.15.89:0/1668130262 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f79f0009d90 con 0x7f7a00132520 2024-09-16T16:46:51.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7ff092b11640 1 -- 172.21.15.89:0/1406653125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08c06fb20 msgr2=0x7ff08c136ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7ff092b11640 1 --2- 172.21.15.89:0/1406653125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08c06fb20 0x7ff08c136ac0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7ff092b11640 1 -- 172.21.15.89:0/1406653125 shutdown_connections 2024-09-16T16:46:51.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7ff092b11640 1 --2- 172.21.15.89:0/1406653125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08c06fb20 0x7ff08c136ac0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7f8919d51640 1 -- 172.21.15.89:0/1696854964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8914132520 msgr2=0x7f8914132930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7f8919d51640 1 --2- 172.21.15.89:0/1696854964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8914132520 0x7f8914132930 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7ff092b11640 1 -- 172.21.15.89:0/1406653125 >> 172.21.15.89:0/1406653125 conn(0x7ff08c069d60 msgr2=0x7ff08c09e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7f8919d51640 1 -- 172.21.15.89:0/1696854964 shutdown_connections 2024-09-16T16:46:51.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7ff092b11640 1 -- 172.21.15.89:0/1406653125 shutdown_connections 2024-09-16T16:46:51.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7ff092b11640 1 -- 172.21.15.89:0/1406653125 wait complete. 2024-09-16T16:46:51.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.915+0000 7f8919d51640 1 --2- 172.21.15.89:0/1696854964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8914132520 0x7f8914132930 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f8919d51640 1 -- 172.21.15.89:0/1696854964 >> 172.21.15.89:0/1696854964 conn(0x7f891406e490 msgr2=0x7f891406e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f8919d51640 1 -- 172.21.15.89:0/1696854964 shutdown_connections 2024-09-16T16:46:51.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f8919d51640 1 -- 172.21.15.89:0/1696854964 wait complete. 2024-09-16T16:46:51.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7ff092b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f8919d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f7a0566c640 1 -- 172.21.15.89:0/1668130262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a00132520 msgr2=0x7f7a00132930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f7a0566c640 1 --2- 172.21.15.89:0/1668130262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a00132520 0x7f7a00132930 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f20d2c9c640 1 -- 172.21.15.89:0/2417330364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20cc0717b0 msgr2=0x7f20cc071bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:51.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f20d2c9c640 1 --2- 172.21.15.89:0/2417330364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20cc0717b0 0x7f20cc071bc0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f20d2c9c640 1 -- 172.21.15.89:0/2417330364 shutdown_connections 2024-09-16T16:46:51.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f20d2c9c640 1 --2- 172.21.15.89:0/2417330364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20cc0717b0 0x7f20cc071bc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f20d2c9c640 1 -- 172.21.15.89:0/2417330364 >> 172.21.15.89:0/2417330364 conn(0x7f20cc0a0320 msgr2=0x7f20cc0a0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f7a0566c640 1 -- 172.21.15.89:0/1668130262 shutdown_connections 2024-09-16T16:46:51.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f7a0566c640 1 --2- 172.21.15.89:0/1668130262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a00132520 0x7f7a00132930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:51.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f20d2c9c640 1 -- 172.21.15.89:0/2417330364 shutdown_connections 2024-09-16T16:46:51.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f7a0566c640 1 -- 172.21.15.89:0/1668130262 >> 172.21.15.89:0/1668130262 conn(0x7f7a0006e490 msgr2=0x7f7a0006e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:51.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f20d2c9c640 1 -- 172.21.15.89:0/2417330364 wait complete. 2024-09-16T16:46:51.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f7a0566c640 1 -- 172.21.15.89:0/1668130262 shutdown_connections 2024-09-16T16:46:51.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f7a0566c640 1 -- 172.21.15.89:0/1668130262 wait complete. 2024-09-16T16:46:51.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.916+0000 7f20d2c9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.917+0000 7f7a0566c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.917+0000 7ff092b11640 1 Processor -- start 2024-09-16T16:46:51.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.917+0000 7f8919d51640 1 Processor -- start 2024-09-16T16:46:51.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.917+0000 7ff092b11640 1 -- start start 2024-09-16T16:46:51.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.917+0000 7f8919d51640 1 -- start start 2024-09-16T16:46:51.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.918+0000 7ff092b11640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08c06fb20 0x7ff08c11c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7ff092b11640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c11fc70 con 0x7ff08c06fb20 2024-09-16T16:46:51.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7ff0908ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08c06fb20 0x7ff08c11c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7ff0908ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08c06fb20 0x7ff08c11c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36278/0 (socket says 172.21.15.89:36278) 2024-09-16T16:46:51.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7ff0908ad640 1 -- 172.21.15.89:0/2525917797 learned_addr learned my addr 172.21.15.89:0/2525917797 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:51.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7f8919d51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89140a3450 0x7f89141c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7f8919d51640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8914121c60 con 0x7f89140a3450 2024-09-16T16:46:51.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7f89137fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89140a3450 0x7f89141c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7f89137fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89140a3450 0x7f89141c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36282/0 (socket says 172.21.15.89:36282) 2024-09-16T16:46:51.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7f89137fe640 1 -- 172.21.15.89:0/2653019097 learned_addr learned my addr 172.21.15.89:0/2653019097 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:51.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7f20d2c9c640 1 Processor -- start 2024-09-16T16:46:51.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7f7a0566c640 1 Processor -- start 2024-09-16T16:46:51.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7ff0908ad640 1 -- 172.21.15.89:0/2525917797 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08c11c220 con 0x7ff08c06fb20 2024-09-16T16:46:51.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7f7a0566c640 1 -- start start 2024-09-16T16:46:51.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7ff0908ad640 1 --2- 172.21.15.89:0/2525917797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08c06fb20 0x7ff08c11c5e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7f89137fe640 1 -- 172.21.15.89:0/2653019097 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891411e090 con 0x7f89140a3450 2024-09-16T16:46:51.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7f20d2c9c640 1 -- start start 2024-09-16T16:46:51.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.919+0000 7ff0897fa640 1 -- 172.21.15.89:0/2525917797 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff08000c920 con 0x7ff08c06fb20 2024-09-16T16:46:51.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.920+0000 7f89137fe640 1 --2- 172.21.15.89:0/2653019097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89140a3450 0x7f89141c9dc0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.920+0000 7ff0897fa640 1 -- 172.21.15.89:0/2525917797 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff08000ca80 con 0x7ff08c06fb20 2024-09-16T16:46:51.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.920+0000 7ff092b11640 1 -- 172.21.15.89:0/2525917797 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08c11d7f0 con 0x7ff08c06fb20 2024-09-16T16:46:51.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.920+0000 7ff0897fa640 1 -- 172.21.15.89:0/2525917797 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff08000cd20 con 0x7ff08c06fb20 2024-09-16T16:46:51.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.920+0000 7ff092b11640 1 -- 172.21.15.89:0/2525917797 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff08c11f120 con 0x7ff08c06fb20 2024-09-16T16:46:51.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.920+0000 7f88fbfff640 1 -- 172.21.15.89:0/2653019097 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8904013400 con 0x7f89140a3450 2024-09-16T16:46:51.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.920+0000 7f88fbfff640 1 -- 172.21.15.89:0/2653019097 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8904013560 con 0x7f89140a3450 2024-09-16T16:46:51.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.920+0000 7f8919d51640 1 -- 172.21.15.89:0/2653019097 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891411e350 con 0x7f89140a3450 2024-09-16T16:46:51.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.920+0000 7f88fbfff640 1 -- 172.21.15.89:0/2653019097 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8904013400 con 0x7f89140a3450 2024-09-16T16:46:51.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.920+0000 7f8919d51640 1 -- 172.21.15.89:0/2653019097 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8914121010 con 0x7f89140a3450 2024-09-16T16:46:51.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.921+0000 7ff092b11640 1 -- 172.21.15.89:0/2525917797 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff08c11dff0 con 0x7ff08c06fb20 2024-09-16T16:46:51.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.921+0000 7f7a0566c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a000a3450 0x7f7a001213a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.921+0000 7ff0897fa640 1 -- 172.21.15.89:0/2525917797 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff080011310 con 0x7ff08c06fb20 2024-09-16T16:46:51.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.921+0000 7f7a0566c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7a001252e0 con 0x7f7a000a3450 2024-09-16T16:46:51.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.921+0000 7f88fbfff640 1 -- 172.21.15.89:0/2653019097 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8904013770 con 0x7f89140a3450 2024-09-16T16:46:51.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.922+0000 7f8919d51640 1 -- 172.21.15.89:0/2653019097 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f891406a300 con 0x7f89140a3450 2024-09-16T16:46:51.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.922+0000 7f79feffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a000a3450 0x7f7a001213a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.922+0000 7ff0897fa640 1 --2- 172.21.15.89:0/2525917797 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff070042d40 0x7ff070045250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.922+0000 7f79feffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a000a3450 0x7f7a001213a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36292/0 (socket says 172.21.15.89:36292) 2024-09-16T16:46:51.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.922+0000 7f79feffd640 1 -- 172.21.15.89:0/1080872947 learned_addr learned my addr 172.21.15.89:0/1080872947 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:51.943 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.922+0000 7ff0897fa640 1 -- 172.21.15.89:0/2525917797 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7ff08004fe80 con 0x7ff08c06fb20 2024-09-16T16:46:51.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.922+0000 7f88fbfff640 1 --2- 172.21.15.89:0/2653019097 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f890003e920 0x7f8900040e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.922+0000 7f79feffd640 1 -- 172.21.15.89:0/1080872947 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a001359e0 con 0x7f7a000a3450 2024-09-16T16:46:51.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.922+0000 7f88fbfff640 1 -- 172.21.15.89:0/2653019097 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f8904018040 con 0x7f89140a3450 2024-09-16T16:46:51.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.922+0000 7ff08bfff640 1 --2- 172.21.15.89:0/2525917797 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff070042d40 0x7ff070045250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.922+0000 7f8912ffd640 1 --2- 172.21.15.89:0/2653019097 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f890003e920 0x7f8900040e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.922+0000 7f79feffd640 1 --2- 172.21.15.89:0/1080872947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a000a3450 0x7f7a001213a0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.923+0000 7f20d2c9c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20cc0717b0 0x7f20cc11dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.923+0000 7f20d2c9c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc1219e0 con 0x7f20cc0717b0 2024-09-16T16:46:51.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.923+0000 7ff08bfff640 1 --2- 172.21.15.89:0/2525917797 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff070042d40 0x7ff070045250 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.923+0000 7f20d0a38640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20cc0717b0 0x7f20cc11dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.946 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.923+0000 7f20d0a38640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20cc0717b0 0x7f20cc11dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36306/0 (socket says 172.21.15.89:36306) 2024-09-16T16:46:51.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.923+0000 7f20d0a38640 1 -- 172.21.15.89:0/2690409814 learned_addr learned my addr 172.21.15.89:0/2690409814 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:51.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.923+0000 7f8912ffd640 1 --2- 172.21.15.89:0/2653019097 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f890003e920 0x7f8900040e30 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.923+0000 7f20d0a38640 1 -- 172.21.15.89:0/2690409814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20cc11f6f0 con 0x7f20cc0717b0 2024-09-16T16:46:51.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.923+0000 7f20d0a38640 1 --2- 172.21.15.89:0/2690409814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20cc0717b0 0x7f20cc11dd00 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.927+0000 7ff0897fa640 1 -- 172.21.15.89:0/2525917797 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7ff08000a9b0 con 0x7ff08c06fb20 2024-09-16T16:46:51.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.933+0000 7f79e77fe640 1 -- 172.21.15.89:0/1080872947 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f79f0014620 con 0x7f7a000a3450 2024-09-16T16:46:51.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.933+0000 7f20c97fa640 1 -- 172.21.15.89:0/2690409814 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f20c0014620 con 0x7f20cc0717b0 2024-09-16T16:46:51.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.933+0000 7f20d2c9c640 1 -- 172.21.15.89:0/2690409814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20cc11ee90 con 0x7f20cc0717b0 2024-09-16T16:46:51.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.933+0000 7f79e77fe640 1 -- 172.21.15.89:0/1080872947 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f79f0014780 con 0x7f7a000a3450 2024-09-16T16:46:51.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.933+0000 7f79e77fe640 1 -- 172.21.15.89:0/1080872947 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f79f0014620 con 0x7f7a000a3450 2024-09-16T16:46:51.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.933+0000 7f20c97fa640 1 -- 172.21.15.89:0/2690409814 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f20c0014780 con 0x7f20cc0717b0 2024-09-16T16:46:51.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.933+0000 7f20c97fa640 1 -- 172.21.15.89:0/2690409814 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f20c0014a20 con 0x7f20cc0717b0 2024-09-16T16:46:51.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.933+0000 7f20d2c9c640 1 -- 172.21.15.89:0/2690409814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20cc120510 con 0x7f20cc0717b0 2024-09-16T16:46:51.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.933+0000 7f7a0566c640 1 -- 172.21.15.89:0/1080872947 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a00122cf0 con 0x7f7a000a3450 2024-09-16T16:46:51.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.933+0000 7f7a0566c640 1 -- 172.21.15.89:0/1080872947 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a00124190 con 0x7f7a000a3450 2024-09-16T16:46:51.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.933+0000 7f88fbfff640 1 -- 172.21.15.89:0/2653019097 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f8904012e40 con 0x7f89140a3450 2024-09-16T16:46:51.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.934+0000 7f7a0566c640 1 -- 172.21.15.89:0/1080872947 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a001235d0 con 0x7f7a000a3450 2024-09-16T16:46:51.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.934+0000 7f20c97fa640 1 -- 172.21.15.89:0/2690409814 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f20c0014bd0 con 0x7f20cc0717b0 2024-09-16T16:46:51.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.934+0000 7f79e77fe640 1 -- 172.21.15.89:0/1080872947 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f79f0014940 con 0x7f7a000a3450 2024-09-16T16:46:51.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.935+0000 7f20c97fa640 1 --2- 172.21.15.89:0/2690409814 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f20b003e930 0x7f20b0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.935+0000 7f20c97fa640 1 -- 172.21.15.89:0/2690409814 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f20c0019040 con 0x7f20cc0717b0 2024-09-16T16:46:51.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.935+0000 7f79e77fe640 1 --2- 172.21.15.89:0/1080872947 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f79ec03e920 0x7f79ec040e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:51.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.935+0000 7f79e77fe640 1 -- 172.21.15.89:0/1080872947 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f79f0050bd0 con 0x7f7a000a3450 2024-09-16T16:46:51.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.935+0000 7f20d2c9c640 1 -- 172.21.15.89:0/2690409814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20cc06a300 con 0x7f20cc0717b0 2024-09-16T16:46:51.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.935+0000 7f20cbfff640 1 --2- 172.21.15.89:0/2690409814 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f20b003e930 0x7f20b0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.935+0000 7f79fe7fc640 1 --2- 172.21.15.89:0/1080872947 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f79ec03e920 0x7f79ec040e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:51.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.936+0000 7f79fe7fc640 1 --2- 172.21.15.89:0/1080872947 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f79ec03e920 0x7f79ec040e30 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.936+0000 7f20cbfff640 1 --2- 172.21.15.89:0/2690409814 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f20b003e930 0x7f20b0040e40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:51.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.940+0000 7f79e77fe640 1 -- 172.21.15.89:0/1080872947 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f79f000d1c0 con 0x7f7a000a3450 2024-09-16T16:46:51.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:51.945+0000 7f20c97fa640 1 -- 172.21.15.89:0/2690409814 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f20c0011570 con 0x7f20cc0717b0 2024-09-16T16:46:52.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.124+0000 7f7a0566c640 1 -- 172.21.15.89:0/1080872947 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7a0006c410 con 0x7f7a000a3450 2024-09-16T16:46:52.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.125+0000 7f79e77fe640 1 -- 172.21.15.89:0/1080872947 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f79f000f950 con 0x7f7a000a3450 2024-09-16T16:46:52.125 INFO:teuthology.orchestra.run.smithi089.stdout:38654705672 2024-09-16T16:46:52.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.128+0000 7f7a0566c640 1 -- 172.21.15.89:0/1080872947 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f79ec03e920 msgr2=0x7f79ec040e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.128+0000 7f7a0566c640 1 --2- 172.21.15.89:0/1080872947 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f79ec03e920 0x7f79ec040e30 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.128+0000 7f7a0566c640 1 -- 172.21.15.89:0/1080872947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a000a3450 msgr2=0x7f7a001213a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.128+0000 7f7a0566c640 1 --2- 172.21.15.89:0/1080872947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a000a3450 0x7f7a001213a0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.128+0000 7f7a0566c640 1 -- 172.21.15.89:0/1080872947 shutdown_connections 2024-09-16T16:46:52.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.128+0000 7f7a0566c640 1 --2- 172.21.15.89:0/1080872947 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f79ec03e920 0x7f79ec040e30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.128+0000 7f7a0566c640 1 --2- 172.21.15.89:0/1080872947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a000a3450 0x7f7a001213a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.128+0000 7f7a0566c640 1 -- 172.21.15.89:0/1080872947 >> 172.21.15.89:0/1080872947 conn(0x7f7a0006e490 msgr2=0x7f7a00135b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:52.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.128+0000 7f7a0566c640 1 -- 172.21.15.89:0/1080872947 shutdown_connections 2024-09-16T16:46:52.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.128+0000 7f7a0566c640 1 -- 172.21.15.89:0/1080872947 wait complete. 2024-09-16T16:46:52.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.132+0000 7ff092b11640 1 -- 172.21.15.89:0/2525917797 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff08c09fcd0 con 0x7ff08c06fb20 2024-09-16T16:46:52.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.133+0000 7ff0897fa640 1 -- 172.21.15.89:0/2525917797 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7ff08000a9b0 con 0x7ff08c06fb20 2024-09-16T16:46:52.133 INFO:teuthology.orchestra.run.smithi089.stdout:38654705672 2024-09-16T16:46:52.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.135+0000 7ff092b11640 1 -- 172.21.15.89:0/2525917797 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff070042d40 msgr2=0x7ff070045250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.135+0000 7ff092b11640 1 --2- 172.21.15.89:0/2525917797 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff070042d40 0x7ff070045250 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.135+0000 7ff092b11640 1 -- 172.21.15.89:0/2525917797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08c06fb20 msgr2=0x7ff08c11c5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.135+0000 7ff092b11640 1 --2- 172.21.15.89:0/2525917797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08c06fb20 0x7ff08c11c5e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.135+0000 7ff092b11640 1 -- 172.21.15.89:0/2525917797 shutdown_connections 2024-09-16T16:46:52.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.135+0000 7ff092b11640 1 --2- 172.21.15.89:0/2525917797 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff070042d40 0x7ff070045250 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.135+0000 7ff092b11640 1 --2- 172.21.15.89:0/2525917797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08c06fb20 0x7ff08c11c5e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.135+0000 7ff092b11640 1 -- 172.21.15.89:0/2525917797 >> 172.21.15.89:0/2525917797 conn(0x7ff08c069d60 msgr2=0x7ff08c0a2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:52.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.135+0000 7ff092b11640 1 -- 172.21.15.89:0/2525917797 shutdown_connections 2024-09-16T16:46:52.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.135+0000 7ff092b11640 1 -- 172.21.15.89:0/2525917797 wait complete. 2024-09-16T16:46:52.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.136+0000 7f20d2c9c640 1 -- 172.21.15.89:0/2690409814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f20cc071bc0 con 0x7f20cc0717b0 2024-09-16T16:46:52.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.136+0000 7f20c97fa640 1 -- 172.21.15.89:0/2690409814 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f20c0008f20 con 0x7f20cc0717b0 2024-09-16T16:46:52.137 INFO:teuthology.orchestra.run.smithi089.stdout:38654705672 2024-09-16T16:46:52.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.140+0000 7f20d2c9c640 1 -- 172.21.15.89:0/2690409814 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f20b003e930 msgr2=0x7f20b0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.140+0000 7f20d2c9c640 1 --2- 172.21.15.89:0/2690409814 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f20b003e930 0x7f20b0040e40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.140+0000 7f20d2c9c640 1 -- 172.21.15.89:0/2690409814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20cc0717b0 msgr2=0x7f20cc11dd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.140+0000 7f20d2c9c640 1 --2- 172.21.15.89:0/2690409814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20cc0717b0 0x7f20cc11dd00 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.140+0000 7f20d2c9c640 1 -- 172.21.15.89:0/2690409814 shutdown_connections 2024-09-16T16:46:52.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.140+0000 7f20d2c9c640 1 --2- 172.21.15.89:0/2690409814 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f20b003e930 0x7f20b0040e40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.140+0000 7f20d2c9c640 1 --2- 172.21.15.89:0/2690409814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20cc0717b0 0x7f20cc11dd00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.140+0000 7f20d2c9c640 1 -- 172.21.15.89:0/2690409814 >> 172.21.15.89:0/2690409814 conn(0x7f20cc0a0320 msgr2=0x7f20cc0a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:52.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.140+0000 7f20d2c9c640 1 -- 172.21.15.89:0/2690409814 shutdown_connections 2024-09-16T16:46:52.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.140+0000 7f20d2c9c640 1 -- 172.21.15.89:0/2690409814 wait complete. 2024-09-16T16:46:52.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.141+0000 7f8919d51640 1 -- 172.21.15.89:0/2653019097 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f89140a1b00 con 0x7f89140a3450 2024-09-16T16:46:52.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.142+0000 7f88fbfff640 1 -- 172.21.15.89:0/2653019097 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f8904011380 con 0x7f89140a3450 2024-09-16T16:46:52.142 INFO:teuthology.orchestra.run.smithi089.stdout:38654705672 2024-09-16T16:46:52.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.0 2024-09-16T16:46:52.144 DEBUG:teuthology.parallel:result is None 2024-09-16T16:46:52.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.144+0000 7f8919d51640 1 -- 172.21.15.89:0/2653019097 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f890003e920 msgr2=0x7f8900040e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.144+0000 7f8919d51640 1 --2- 172.21.15.89:0/2653019097 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f890003e920 0x7f8900040e30 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.144+0000 7f8919d51640 1 -- 172.21.15.89:0/2653019097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89140a3450 msgr2=0x7f89141c9dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.144+0000 7f8919d51640 1 --2- 172.21.15.89:0/2653019097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89140a3450 0x7f89141c9dc0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.144+0000 7f8919d51640 1 -- 172.21.15.89:0/2653019097 shutdown_connections 2024-09-16T16:46:52.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.144+0000 7f8919d51640 1 --2- 172.21.15.89:0/2653019097 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f890003e920 0x7f8900040e30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.144+0000 7f8919d51640 1 --2- 172.21.15.89:0/2653019097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89140a3450 0x7f89141c9dc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.144+0000 7f8919d51640 1 -- 172.21.15.89:0/2653019097 >> 172.21.15.89:0/2653019097 conn(0x7f891406e490 msgr2=0x7f89140a5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:52.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.144+0000 7f8919d51640 1 -- 172.21.15.89:0/2653019097 shutdown_connections 2024-09-16T16:46:52.146 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.144+0000 7f8919d51640 1 -- 172.21.15.89:0/2653019097 wait complete. 2024-09-16T16:46:52.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.1 2024-09-16T16:46:52.149 DEBUG:teuthology.parallel:result is None 2024-09-16T16:46:52.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.2 2024-09-16T16:46:52.154 DEBUG:teuthology.parallel:result is None 2024-09-16T16:46:52.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.3 2024-09-16T16:46:52.156 DEBUG:teuthology.parallel:result is None 2024-09-16T16:46:52.156 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T16:46:52.156 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:46:52.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.301+0000 7ff9494bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.306+0000 7ff9494bd640 1 Processor -- start 2024-09-16T16:46:52.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.306+0000 7ff9494bd640 1 -- start start 2024-09-16T16:46:52.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.307+0000 7ff9494bd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff9441365a0 0x7ff9441389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:52.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.307+0000 7ff9494bd640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff944074a00 con 0x7ff944130420 2024-09-16T16:46:52.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.307+0000 7ff9494bd640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7ff944074c30 con 0x7ff9441365a0 2024-09-16T16:46:52.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.308+0000 7ff942ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff944130420 0x7ff944130830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51812/0 (socket says 172.21.15.89:51812) 2024-09-16T16:46:52.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.308+0000 7ff942ffd640 1 -- 172.21.15.89:0/1651072546 learned_addr learned my addr 172.21.15.89:0/1651072546 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T16:46:52.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.308+0000 7ff9427fc640 1 --2- 172.21.15.89:0/1651072546 >> v2:172.21.15.89:3300/0 conn(0x7ff9441365a0 0x7ff9441389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:52.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.308+0000 7ff9427fc640 1 -- 172.21.15.89:0/1651072546 >> v1:172.21.15.89:6789/0 conn(0x7ff944130420 legacy=0x7ff944130830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.308+0000 7ff9427fc640 1 -- 172.21.15.89:0/1651072546 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff944071930 con 0x7ff9441365a0 2024-09-16T16:46:52.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.308+0000 7ff941ffb640 1 -- 172.21.15.89:0/1651072546 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1007437162 0 0) 0x7ff944074a00 con 0x7ff944130420 2024-09-16T16:46:52.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.308+0000 7ff9427fc640 1 --2- 172.21.15.89:0/1651072546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9441365a0 0x7ff9441389c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c1299816222b53 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:52.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.308+0000 7ff941ffb640 1 -- 172.21.15.89:0/1651072546 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff938009d90 con 0x7ff9441365a0 2024-09-16T16:46:52.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.308+0000 7ff941ffb640 1 -- 172.21.15.89:0/1651072546 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff93800e230 con 0x7ff9441365a0 2024-09-16T16:46:52.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.308+0000 7ff941ffb640 1 -- 172.21.15.89:0/1651072546 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff93800e4d0 con 0x7ff9441365a0 2024-09-16T16:46:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.309+0000 7ff9494bd640 1 -- 172.21.15.89:0/1651072546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9441365a0 msgr2=0x7ff9441389c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.309+0000 7ff9494bd640 1 --2- 172.21.15.89:0/1651072546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9441365a0 0x7ff9441389c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.309+0000 7ff9494bd640 1 -- 172.21.15.89:0/1651072546 shutdown_connections 2024-09-16T16:46:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.309+0000 7ff9494bd640 1 --2- 172.21.15.89:0/1651072546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9441365a0 0x7ff9441389c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.309+0000 7ff9494bd640 1 -- 172.21.15.89:0/1651072546 >> 172.21.15.89:0/1651072546 conn(0x7ff9440a0320 msgr2=0x7ff9440a0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.309+0000 7ff9494bd640 1 -- 172.21.15.89:0/1651072546 shutdown_connections 2024-09-16T16:46:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.309+0000 7ff9494bd640 1 -- 172.21.15.89:0/1651072546 wait complete. 2024-09-16T16:46:52.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.309+0000 7ff9494bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.311+0000 7ff9494bd640 1 Processor -- start 2024-09-16T16:46:52.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.311+0000 7ff9494bd640 1 -- start start 2024-09-16T16:46:52.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.312+0000 7ff9494bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff944130420 0x7ff94412fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:52.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.312+0000 7ff9494bd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff944120b10 con 0x7ff944130420 2024-09-16T16:46:52.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.312+0000 7ff942ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff944130420 0x7ff94412fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:52.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.312+0000 7ff942ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff944130420 0x7ff94412fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36322/0 (socket says 172.21.15.89:36322) 2024-09-16T16:46:52.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.312+0000 7ff942ffd640 1 -- 172.21.15.89:0/2220416943 learned_addr learned my addr 172.21.15.89:0/2220416943 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:52.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.312+0000 7ff942ffd640 1 -- 172.21.15.89:0/2220416943 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94411de70 con 0x7ff944130420 2024-09-16T16:46:52.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.313+0000 7ff942ffd640 1 --2- 172.21.15.89:0/2220416943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff944130420 0x7ff94412fa40 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:52.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.313+0000 7ff92b7fe640 1 -- 172.21.15.89:0/2220416943 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff934004b80 con 0x7ff944130420 2024-09-16T16:46:52.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.313+0000 7ff92b7fe640 1 -- 172.21.15.89:0/2220416943 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff934004ce0 con 0x7ff944130420 2024-09-16T16:46:52.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.313+0000 7ff9494bd640 1 -- 172.21.15.89:0/2220416943 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94411ed90 con 0x7ff944130420 2024-09-16T16:46:52.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.313+0000 7ff92b7fe640 1 -- 172.21.15.89:0/2220416943 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff934007120 con 0x7ff944130420 2024-09-16T16:46:52.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.313+0000 7ff9494bd640 1 -- 172.21.15.89:0/2220416943 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9440a48f0 con 0x7ff944130420 2024-09-16T16:46:52.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.314+0000 7ff9494bd640 1 -- 172.21.15.89:0/2220416943 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff94406a300 con 0x7ff944130420 2024-09-16T16:46:52.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.314+0000 7ff92b7fe640 1 -- 172.21.15.89:0/2220416943 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff934007320 con 0x7ff944130420 2024-09-16T16:46:52.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.314+0000 7ff92b7fe640 1 --2- 172.21.15.89:0/2220416943 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff93003e8e0 0x7ff930040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:52.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.314+0000 7ff92b7fe640 1 -- 172.21.15.89:0/2220416943 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7ff93404f840 con 0x7ff944130420 2024-09-16T16:46:52.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.315+0000 7ff9427fc640 1 --2- 172.21.15.89:0/2220416943 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff93003e8e0 0x7ff930040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:52.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.315+0000 7ff9427fc640 1 --2- 172.21.15.89:0/2220416943 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff93003e8e0 0x7ff930040df0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:52.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.319+0000 7ff92b7fe640 1 -- 172.21.15.89:0/2220416943 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7ff93400f230 con 0x7ff944130420 2024-09-16T16:46:52.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.492+0000 7ff9494bd640 1 -- 172.21.15.89:0/2220416943 --> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9440a1f00 con 0x7ff93003e8e0 2024-09-16T16:46:52.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.494+0000 7ff92b7fe640 1 -- 172.21.15.89:0/2220416943 <== mgr.4099 v2:172.21.15.177:6800/1212166405 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31201 (crc 0 0 0) 0x7ff938009e80 con 0x7ff93003e8e0 2024-09-16T16:46:52.495 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:52.495 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-16T16:46:52.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.496+0000 7ff9494bd640 1 -- 172.21.15.89:0/2220416943 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff93003e8e0 msgr2=0x7ff930040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.496+0000 7ff9494bd640 1 --2- 172.21.15.89:0/2220416943 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff93003e8e0 0x7ff930040df0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.496+0000 7ff9494bd640 1 -- 172.21.15.89:0/2220416943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff944130420 msgr2=0x7ff94412fa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.496+0000 7ff9494bd640 1 --2- 172.21.15.89:0/2220416943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff944130420 0x7ff94412fa40 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.496+0000 7ff9494bd640 1 -- 172.21.15.89:0/2220416943 shutdown_connections 2024-09-16T16:46:52.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.496+0000 7ff9494bd640 1 --2- 172.21.15.89:0/2220416943 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff93003e8e0 0x7ff930040df0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.496+0000 7ff9494bd640 1 --2- 172.21.15.89:0/2220416943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff944130420 0x7ff94412fa40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.496+0000 7ff9494bd640 1 -- 172.21.15.89:0/2220416943 >> 172.21.15.89:0/2220416943 conn(0x7ff9440a0320 msgr2=0x7ff944132b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:52.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.496+0000 7ff9494bd640 1 -- 172.21.15.89:0/2220416943 shutdown_connections 2024-09-16T16:46:52.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.496+0000 7ff9494bd640 1 -- 172.21.15.89:0/2220416943 wait complete. 2024-09-16T16:46:52.508 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-16T16:46:51.724766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3664,"kb_used_data":3664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209187248,"statfs":{"total":214211493888,"available":214207741952,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.251500+0000","last_change":"2024-09-16T16:46:50.254602+0000","last_active":"2024-09-16T16:46:50.251500+0000","last_peered":"2024-09-16T16:46:50.251500+0000","last_clean":"2024-09-16T16:46:50.251500+0000","last_became_active":"2024-09-16T16:46:48.301220+0000","last_became_peered":"2024-09-16T16:46:48.301220+0000","last_unstale":"2024-09-16T16:46:50.251500+0000","last_undegraded":"2024-09-16T16:46:50.251500+0000","last_fullsized":"2024-09-16T16:46:50.251500+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.249542+0000","last_change":"2024-09-16T16:46:50.252865+0000","last_active":"2024-09-16T16:46:50.249542+0000","last_peered":"2024-09-16T16:46:50.249542+0000","last_clean":"2024-09-16T16:46:50.249542+0000","last_became_active":"2024-09-16T16:46:48.285243+0000","last_became_peered":"2024-09-16T16:46:48.285243+0000","last_unstale":"2024-09-16T16:46:50.249542+0000","last_undegraded":"2024-09-16T16:46:50.249542+0000","last_fullsized":"2024-09-16T16:46:50.249542+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.245412+0000","last_change":"2024-09-16T16:46:50.249574+0000","last_active":"2024-09-16T16:46:50.245412+0000","last_peered":"2024-09-16T16:46:50.245412+0000","last_clean":"2024-09-16T16:46:50.245412+0000","last_became_active":"2024-09-16T16:46:48.295184+0000","last_became_peered":"2024-09-16T16:46:48.295184+0000","last_unstale":"2024-09-16T16:46:50.245412+0000","last_undegraded":"2024-09-16T16:46:50.245412+0000","last_fullsized":"2024-09-16T16:46:50.245412+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.242907+0000","last_change":"2024-09-16T16:46:50.249064+0000","last_active":"2024-09-16T16:46:50.242907+0000","last_peered":"2024-09-16T16:46:50.242907+0000","last_clean":"2024-09-16T16:46:50.242907+0000","last_became_active":"2024-09-16T16:46:48.280354+0000","last_became_peered":"2024-09-16T16:46:48.280354+0000","last_unstale":"2024-09-16T16:46:50.242907+0000","last_undegraded":"2024-09-16T16:46:50.242907+0000","last_fullsized":"2024-09-16T16:46:50.242907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.250531+0000","last_change":"2024-09-16T16:46:50.250531+0000","last_active":"2024-09-16T16:46:50.250531+0000","last_peered":"2024-09-16T16:46:50.250531+0000","last_clean":"2024-09-16T16:46:50.250531+0000","last_became_active":"2024-09-16T16:46:48.303026+0000","last_became_peered":"2024-09-16T16:46:48.303026+0000","last_unstale":"2024-09-16T16:46:50.250531+0000","last_undegraded":"2024-09-16T16:46:50.250531+0000","last_fullsized":"2024-09-16T16:46:50.250531+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.246138+0000","last_change":"2024-09-16T16:46:50.249648+0000","last_active":"2024-09-16T16:46:50.246138+0000","last_peered":"2024-09-16T16:46:50.246138+0000","last_clean":"2024-09-16T16:46:50.246138+0000","last_became_active":"2024-09-16T16:46:48.285463+0000","last_became_peered":"2024-09-16T16:46:48.285463+0000","last_unstale":"2024-09-16T16:46:50.246138+0000","last_undegraded":"2024-09-16T16:46:50.246138+0000","last_fullsized":"2024-09-16T16:46:50.246138+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.247677+0000","last_change":"2024-09-16T16:46:50.250997+0000","last_active":"2024-09-16T16:46:50.247677+0000","last_peered":"2024-09-16T16:46:50.247677+0000","last_clean":"2024-09-16T16:46:50.247677+0000","last_became_active":"2024-09-16T16:46:48.281970+0000","last_became_peered":"2024-09-16T16:46:48.281970+0000","last_unstale":"2024-09-16T16:46:50.247677+0000","last_undegraded":"2024-09-16T16:46:50.247677+0000","last_fullsized":"2024-09-16T16:46:50.247677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.250422+0000","last_change":"2024-09-16T16:46:50.254143+0000","last_active":"2024-09-16T16:46:50.250422+0000","last_peered":"2024-09-16T16:46:50.250422+0000","last_clean":"2024-09-16T16:46:50.250422+0000","last_became_active":"2024-09-16T16:46:48.282002+0000","last_became_peered":"2024-09-16T16:46:48.282002+0000","last_unstale":"2024-09-16T16:46:50.250422+0000","last_undegraded":"2024-09-16T16:46:50.250422+0000","last_fullsized":"2024-09-16T16:46:50.250422+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":87,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.242812+0000","last_change":"2024-09-16T16:46:46.272094+0000","last_active":"2024-09-16T16:46:50.242812+0000","last_peered":"2024-09-16T16:46:50.242812+0000","last_clean":"2024-09-16T16:46:50.242812+0000","last_became_active":"2024-09-16T16:46:46.253718+0000","last_became_peered":"2024-09-16T16:46:46.253718+0000","last_unstale":"2024-09-16T16:46:50.242812+0000","last_undegraded":"2024-09-16T16:46:50.242812+0000","last_fullsized":"2024-09-16T16:46:50.242812+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.198151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.198151+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.198151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214207741952,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1172,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296556,"statfs":{"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":532,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297196,"statfs":{"total":53552873472,"available":53552328704,"internally_reserved":0,"allocated":544768,"data_stored":544768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":528,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297200,"statfs":{"total":53552873472,"available":53552332800,"internally_reserved":0,"allocated":540672,"data_stored":540672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1432,"kb_used_data":1432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296296,"statfs":{"total":53552873472,"available":53551407104,"internally_reserved":0,"allocated":1466368,"data_stored":1466368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551407104,"internally_reserved":0,"allocated":1466368,"data_stored":1466368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552332800,"internally_reserved":0,"allocated":540672,"data_stored":540672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552328704,"internally_reserved":0,"allocated":544768,"data_stored":544768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:46:52.508 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:46:52.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.612+0000 7ffad8ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.616+0000 7ffad8ebd640 1 Processor -- start 2024-09-16T16:46:52.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.617+0000 7ffad8ebd640 1 -- start start 2024-09-16T16:46:52.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.618+0000 7ffad8ebd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffad4132520 0x7ffad4132930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:52.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.618+0000 7ffad8ebd640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad406f6d0 con 0x7ffad40a3450 2024-09-16T16:46:52.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.618+0000 7ffad8ebd640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7ffad406f3d0 con 0x7ffad4132520 2024-09-16T16:46:52.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.618+0000 7ffad259c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffad4132520 0x7ffad4132930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:52.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.618+0000 7ffad259c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffad4132520 0x7ffad4132930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36328/0 (socket says 172.21.15.89:36328) 2024-09-16T16:46:52.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.618+0000 7ffad259c640 1 -- 172.21.15.89:0/1045463625 learned_addr learned my addr 172.21.15.89:0/1045463625 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:52.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.618+0000 7ffad1d9b640 1 --1- 172.21.15.89:0/1045463625 >> v1:172.21.15.89:6789/0 conn(0x7ffad40a3450 0x7ffad40a3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51826/0 (socket says 172.21.15.89:51826) 2024-09-16T16:46:52.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.618+0000 7ffad259c640 1 -- 172.21.15.89:0/1045463625 >> v1:172.21.15.89:6789/0 conn(0x7ffad40a3450 legacy=0x7ffad40a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.618+0000 7ffad259c640 1 -- 172.21.15.89:0/1045463625 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad406f0c0 con 0x7ffad4132520 2024-09-16T16:46:52.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.618+0000 7ffad259c640 1 --2- 172.21.15.89:0/1045463625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad4132520 0x7ffad4132930 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0455692cf5bb607 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:52.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.618+0000 7ffad159a640 1 -- 172.21.15.89:0/1045463625 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffac400e040 con 0x7ffad4132520 2024-09-16T16:46:52.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.619+0000 7ffad159a640 1 -- 172.21.15.89:0/1045463625 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffac40091e0 con 0x7ffad4132520 2024-09-16T16:46:52.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.619+0000 7ffad159a640 1 -- 172.21.15.89:0/1045463625 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffac4007730 con 0x7ffad4132520 2024-09-16T16:46:52.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.619+0000 7ffad8ebd640 1 -- 172.21.15.89:0/1045463625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad4132520 msgr2=0x7ffad4132930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.619+0000 7ffad8ebd640 1 --2- 172.21.15.89:0/1045463625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad4132520 0x7ffad4132930 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.619+0000 7ffad8ebd640 1 -- 172.21.15.89:0/1045463625 shutdown_connections 2024-09-16T16:46:52.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.619+0000 7ffad8ebd640 1 --2- 172.21.15.89:0/1045463625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad4132520 0x7ffad4132930 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.619+0000 7ffad8ebd640 1 -- 172.21.15.89:0/1045463625 >> 172.21.15.89:0/1045463625 conn(0x7ffad406e490 msgr2=0x7ffad406e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:52.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.619+0000 7ffad8ebd640 1 -- 172.21.15.89:0/1045463625 shutdown_connections 2024-09-16T16:46:52.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.619+0000 7ffad8ebd640 1 -- 172.21.15.89:0/1045463625 wait complete. 2024-09-16T16:46:52.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.620+0000 7ffad8ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.621+0000 7ffad8ebd640 1 Processor -- start 2024-09-16T16:46:52.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.621+0000 7ffad8ebd640 1 -- start start 2024-09-16T16:46:52.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.622+0000 7ffad8ebd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad40a3450 0x7ffad411e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:52.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.622+0000 7ffad8ebd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ffad4121f40 con 0x7ffad40a3450 2024-09-16T16:46:52.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.622+0000 7ffad259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad40a3450 0x7ffad411e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:52.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.622+0000 7ffad259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad40a3450 0x7ffad411e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36342/0 (socket says 172.21.15.89:36342) 2024-09-16T16:46:52.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.622+0000 7ffad259c640 1 -- 172.21.15.89:0/1503457070 learned_addr learned my addr 172.21.15.89:0/1503457070 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:52.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.622+0000 7ffad259c640 1 -- 172.21.15.89:0/1503457070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad41320a0 con 0x7ffad40a3450 2024-09-16T16:46:52.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.623+0000 7ffad259c640 1 --2- 172.21.15.89:0/1503457070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad40a3450 0x7ffad411e090 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:52.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.623+0000 7ffac2ffd640 1 -- 172.21.15.89:0/1503457070 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffac400e040 con 0x7ffad40a3450 2024-09-16T16:46:52.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.623+0000 7ffac2ffd640 1 -- 172.21.15.89:0/1503457070 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffac40094d0 con 0x7ffad40a3450 2024-09-16T16:46:52.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.623+0000 7ffad8ebd640 1 -- 172.21.15.89:0/1503457070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad4135960 con 0x7ffad40a3450 2024-09-16T16:46:52.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.623+0000 7ffac2ffd640 1 -- 172.21.15.89:0/1503457070 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffac40119a0 con 0x7ffad40a3450 2024-09-16T16:46:52.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.623+0000 7ffad8ebd640 1 -- 172.21.15.89:0/1503457070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad41219f0 con 0x7ffad40a3450 2024-09-16T16:46:52.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.624+0000 7ffad8ebd640 1 -- 172.21.15.89:0/1503457070 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad4120a40 con 0x7ffad40a3450 2024-09-16T16:46:52.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.624+0000 7ffac2ffd640 1 -- 172.21.15.89:0/1503457070 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ffac4011b90 con 0x7ffad40a3450 2024-09-16T16:46:52.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.624+0000 7ffac2ffd640 1 --2- 172.21.15.89:0/1503457070 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ffab403e930 0x7ffab4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:52.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.624+0000 7ffac2ffd640 1 -- 172.21.15.89:0/1503457070 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7ffac4050b10 con 0x7ffad40a3450 2024-09-16T16:46:52.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.624+0000 7ffad1d9b640 1 --2- 172.21.15.89:0/1503457070 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ffab403e930 0x7ffab4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:52.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.625+0000 7ffad1d9b640 1 --2- 172.21.15.89:0/1503457070 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ffab403e930 0x7ffab4040e40 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:52.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.629+0000 7ffac2ffd640 1 -- 172.21.15.89:0/1503457070 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7ffac4015b60 con 0x7ffad40a3450 2024-09-16T16:46:52.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.798+0000 7ffad8ebd640 1 -- 172.21.15.89:0/1503457070 --> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffad409c830 con 0x7ffab403e930 2024-09-16T16:46:52.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.799+0000 7ffac2ffd640 1 -- 172.21.15.89:0/1503457070 <== mgr.4099 v2:172.21.15.177:6800/1212166405 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31201 (crc 0 0 0) 0x7ffac80070b0 con 0x7ffab403e930 2024-09-16T16:46:52.800 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:52.801 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-16T16:46:52.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.802+0000 7ffad8ebd640 1 -- 172.21.15.89:0/1503457070 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ffab403e930 msgr2=0x7ffab4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.802+0000 7ffad8ebd640 1 --2- 172.21.15.89:0/1503457070 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ffab403e930 0x7ffab4040e40 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.802+0000 7ffad8ebd640 1 -- 172.21.15.89:0/1503457070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad40a3450 msgr2=0x7ffad411e090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.802+0000 7ffad8ebd640 1 --2- 172.21.15.89:0/1503457070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad40a3450 0x7ffad411e090 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.802+0000 7ffad8ebd640 1 -- 172.21.15.89:0/1503457070 shutdown_connections 2024-09-16T16:46:52.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.802+0000 7ffad8ebd640 1 --2- 172.21.15.89:0/1503457070 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ffab403e930 0x7ffab4040e40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.802+0000 7ffad8ebd640 1 --2- 172.21.15.89:0/1503457070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffad40a3450 0x7ffad411e090 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.802+0000 7ffad8ebd640 1 -- 172.21.15.89:0/1503457070 >> 172.21.15.89:0/1503457070 conn(0x7ffad406e490 msgr2=0x7ffad41bd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:52.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.802+0000 7ffad8ebd640 1 -- 172.21.15.89:0/1503457070 shutdown_connections 2024-09-16T16:46:52.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.802+0000 7ffad8ebd640 1 -- 172.21.15.89:0/1503457070 wait complete. 2024-09-16T16:46:52.813 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-16T16:46:51.724766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3664,"kb_used_data":3664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209187248,"statfs":{"total":214211493888,"available":214207741952,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.251500+0000","last_change":"2024-09-16T16:46:50.254602+0000","last_active":"2024-09-16T16:46:50.251500+0000","last_peered":"2024-09-16T16:46:50.251500+0000","last_clean":"2024-09-16T16:46:50.251500+0000","last_became_active":"2024-09-16T16:46:48.301220+0000","last_became_peered":"2024-09-16T16:46:48.301220+0000","last_unstale":"2024-09-16T16:46:50.251500+0000","last_undegraded":"2024-09-16T16:46:50.251500+0000","last_fullsized":"2024-09-16T16:46:50.251500+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.249542+0000","last_change":"2024-09-16T16:46:50.252865+0000","last_active":"2024-09-16T16:46:50.249542+0000","last_peered":"2024-09-16T16:46:50.249542+0000","last_clean":"2024-09-16T16:46:50.249542+0000","last_became_active":"2024-09-16T16:46:48.285243+0000","last_became_peered":"2024-09-16T16:46:48.285243+0000","last_unstale":"2024-09-16T16:46:50.249542+0000","last_undegraded":"2024-09-16T16:46:50.249542+0000","last_fullsized":"2024-09-16T16:46:50.249542+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.245412+0000","last_change":"2024-09-16T16:46:50.249574+0000","last_active":"2024-09-16T16:46:50.245412+0000","last_peered":"2024-09-16T16:46:50.245412+0000","last_clean":"2024-09-16T16:46:50.245412+0000","last_became_active":"2024-09-16T16:46:48.295184+0000","last_became_peered":"2024-09-16T16:46:48.295184+0000","last_unstale":"2024-09-16T16:46:50.245412+0000","last_undegraded":"2024-09-16T16:46:50.245412+0000","last_fullsized":"2024-09-16T16:46:50.245412+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.242907+0000","last_change":"2024-09-16T16:46:50.249064+0000","last_active":"2024-09-16T16:46:50.242907+0000","last_peered":"2024-09-16T16:46:50.242907+0000","last_clean":"2024-09-16T16:46:50.242907+0000","last_became_active":"2024-09-16T16:46:48.280354+0000","last_became_peered":"2024-09-16T16:46:48.280354+0000","last_unstale":"2024-09-16T16:46:50.242907+0000","last_undegraded":"2024-09-16T16:46:50.242907+0000","last_fullsized":"2024-09-16T16:46:50.242907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.250531+0000","last_change":"2024-09-16T16:46:50.250531+0000","last_active":"2024-09-16T16:46:50.250531+0000","last_peered":"2024-09-16T16:46:50.250531+0000","last_clean":"2024-09-16T16:46:50.250531+0000","last_became_active":"2024-09-16T16:46:48.303026+0000","last_became_peered":"2024-09-16T16:46:48.303026+0000","last_unstale":"2024-09-16T16:46:50.250531+0000","last_undegraded":"2024-09-16T16:46:50.250531+0000","last_fullsized":"2024-09-16T16:46:50.250531+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.246138+0000","last_change":"2024-09-16T16:46:50.249648+0000","last_active":"2024-09-16T16:46:50.246138+0000","last_peered":"2024-09-16T16:46:50.246138+0000","last_clean":"2024-09-16T16:46:50.246138+0000","last_became_active":"2024-09-16T16:46:48.285463+0000","last_became_peered":"2024-09-16T16:46:48.285463+0000","last_unstale":"2024-09-16T16:46:50.246138+0000","last_undegraded":"2024-09-16T16:46:50.246138+0000","last_fullsized":"2024-09-16T16:46:50.246138+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.247677+0000","last_change":"2024-09-16T16:46:50.250997+0000","last_active":"2024-09-16T16:46:50.247677+0000","last_peered":"2024-09-16T16:46:50.247677+0000","last_clean":"2024-09-16T16:46:50.247677+0000","last_became_active":"2024-09-16T16:46:48.281970+0000","last_became_peered":"2024-09-16T16:46:48.281970+0000","last_unstale":"2024-09-16T16:46:50.247677+0000","last_undegraded":"2024-09-16T16:46:50.247677+0000","last_fullsized":"2024-09-16T16:46:50.247677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.250422+0000","last_change":"2024-09-16T16:46:50.254143+0000","last_active":"2024-09-16T16:46:50.250422+0000","last_peered":"2024-09-16T16:46:50.250422+0000","last_clean":"2024-09-16T16:46:50.250422+0000","last_became_active":"2024-09-16T16:46:48.282002+0000","last_became_peered":"2024-09-16T16:46:48.282002+0000","last_unstale":"2024-09-16T16:46:50.250422+0000","last_undegraded":"2024-09-16T16:46:50.250422+0000","last_fullsized":"2024-09-16T16:46:50.250422+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":87,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.242812+0000","last_change":"2024-09-16T16:46:46.272094+0000","last_active":"2024-09-16T16:46:50.242812+0000","last_peered":"2024-09-16T16:46:50.242812+0000","last_clean":"2024-09-16T16:46:50.242812+0000","last_became_active":"2024-09-16T16:46:46.253718+0000","last_became_peered":"2024-09-16T16:46:46.253718+0000","last_unstale":"2024-09-16T16:46:50.242812+0000","last_undegraded":"2024-09-16T16:46:50.242812+0000","last_fullsized":"2024-09-16T16:46:50.242812+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.198151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.198151+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.198151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214207741952,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1172,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296556,"statfs":{"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":532,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297196,"statfs":{"total":53552873472,"available":53552328704,"internally_reserved":0,"allocated":544768,"data_stored":544768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":528,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297200,"statfs":{"total":53552873472,"available":53552332800,"internally_reserved":0,"allocated":540672,"data_stored":540672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1432,"kb_used_data":1432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296296,"statfs":{"total":53552873472,"available":53551407104,"internally_reserved":0,"allocated":1466368,"data_stored":1466368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551407104,"internally_reserved":0,"allocated":1466368,"data_stored":1466368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552332800,"internally_reserved":0,"allocated":540672,"data_stored":540672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552328704,"internally_reserved":0,"allocated":544768,"data_stored":544768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:46:52.814 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T16:46:52.814 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T16:46:52.814 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T16:46:52.814 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T16:46:52.920 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.917+0000 7f8aae191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.920+0000 7f8aae191640 1 Processor -- start 2024-09-16T16:46:52.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.920+0000 7f8aae191640 1 -- start start 2024-09-16T16:46:52.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.921+0000 7f8aae191640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8aa8133ed0 0x7f8aa8138900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:52.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.921+0000 7f8aae191640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aa80693f0 con 0x7f8aa81333b0 2024-09-16T16:46:52.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.921+0000 7f8aae191640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f8aa80720d0 con 0x7f8aa8133ed0 2024-09-16T16:46:52.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.922+0000 7f8aa6ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8aa8133ed0 0x7f8aa8138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:52.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.922+0000 7f8aa77fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8aa81333b0 0x7f8aa81337c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51828/0 (socket says 172.21.15.89:51828) 2024-09-16T16:46:52.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.922+0000 7f8aa77fe640 1 -- 172.21.15.89:0/4090026769 learned_addr learned my addr 172.21.15.89:0/4090026769 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T16:46:52.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.922+0000 7f8aa6ffd640 1 -- 172.21.15.89:0/4090026769 >> v1:172.21.15.89:6789/0 conn(0x7f8aa81333b0 legacy=0x7f8aa81337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.922+0000 7f8aa6ffd640 1 -- 172.21.15.89:0/4090026769 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa8074b00 con 0x7f8aa8133ed0 2024-09-16T16:46:52.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.922+0000 7f8aa6ffd640 1 --2- 172.21.15.89:0/4090026769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa8133ed0 0x7f8aa8138900 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57ecb16b896f58b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:52.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.922+0000 7f8aa67fc640 1 -- 172.21.15.89:0/4090026769 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8a9c009d90 con 0x7f8aa8133ed0 2024-09-16T16:46:52.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.922+0000 7f8aa67fc640 1 -- 172.21.15.89:0/4090026769 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8a9c00e230 con 0x7f8aa8133ed0 2024-09-16T16:46:52.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.922+0000 7f8aa67fc640 1 -- 172.21.15.89:0/4090026769 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8a9c00e4d0 con 0x7f8aa8133ed0 2024-09-16T16:46:52.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.923+0000 7f8aae191640 1 -- 172.21.15.89:0/4090026769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa8133ed0 msgr2=0x7f8aa8138900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:52.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.923+0000 7f8aae191640 1 --2- 172.21.15.89:0/4090026769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa8133ed0 0x7f8aa8138900 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.923+0000 7f8aae191640 1 -- 172.21.15.89:0/4090026769 shutdown_connections 2024-09-16T16:46:52.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.923+0000 7f8aae191640 1 --2- 172.21.15.89:0/4090026769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa8133ed0 0x7f8aa8138900 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:52.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.923+0000 7f8aae191640 1 -- 172.21.15.89:0/4090026769 >> 172.21.15.89:0/4090026769 conn(0x7f8aa80a1dd0 msgr2=0x7f8aa80a21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:52.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.923+0000 7f8aae191640 1 -- 172.21.15.89:0/4090026769 shutdown_connections 2024-09-16T16:46:52.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.923+0000 7f8aae191640 1 -- 172.21.15.89:0/4090026769 wait complete. 2024-09-16T16:46:52.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.923+0000 7f8aae191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.924+0000 7f8aae191640 1 Processor -- start 2024-09-16T16:46:52.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.925+0000 7f8aae191640 1 -- start start 2024-09-16T16:46:52.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.926+0000 7f8aae191640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa81333b0 0x7f8aa812d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:52.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.926+0000 7f8aae191640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa812dcb0 con 0x7f8aa81333b0 2024-09-16T16:46:52.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.926+0000 7f8aa77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa81333b0 0x7f8aa812d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:52.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.926+0000 7f8aa77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa81333b0 0x7f8aa812d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36356/0 (socket says 172.21.15.89:36356) 2024-09-16T16:46:52.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.926+0000 7f8aa77fe640 1 -- 172.21.15.89:0/2716346049 learned_addr learned my addr 172.21.15.89:0/2716346049 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:46:52.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.926+0000 7f8aa77fe640 1 -- 172.21.15.89:0/2716346049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa8130bb0 con 0x7f8aa81333b0 2024-09-16T16:46:52.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.926+0000 7f8aa77fe640 1 --2- 172.21.15.89:0/2716346049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa81333b0 0x7f8aa812d0e0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:52.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.926+0000 7f8a8ffff640 1 -- 172.21.15.89:0/2716346049 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8a980070b0 con 0x7f8aa81333b0 2024-09-16T16:46:52.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.926+0000 7f8a8ffff640 1 -- 172.21.15.89:0/2716346049 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8a98007210 con 0x7f8aa81333b0 2024-09-16T16:46:52.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.926+0000 7f8aae191640 1 -- 172.21.15.89:0/2716346049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa8130e70 con 0x7f8aa81333b0 2024-09-16T16:46:52.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.926+0000 7f8a8ffff640 1 -- 172.21.15.89:0/2716346049 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8a980074b0 con 0x7f8aa81333b0 2024-09-16T16:46:52.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.926+0000 7f8aae191640 1 -- 172.21.15.89:0/2716346049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa812dee0 con 0x7f8aa81333b0 2024-09-16T16:46:52.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.927+0000 7f8aae191640 1 -- 172.21.15.89:0/2716346049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aa812c880 con 0x7f8aa81333b0 2024-09-16T16:46:52.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.927+0000 7f8a8ffff640 1 -- 172.21.15.89:0/2716346049 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8a98007660 con 0x7f8aa81333b0 2024-09-16T16:46:52.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.928+0000 7f8a8ffff640 1 --2- 172.21.15.89:0/2716346049 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f8a9403e930 0x7f8a94040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:46:52.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.928+0000 7f8a8ffff640 1 -- 172.21.15.89:0/2716346049 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f8a9804fe40 con 0x7f8aa81333b0 2024-09-16T16:46:52.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.928+0000 7f8aa6ffd640 1 --2- 172.21.15.89:0/2716346049 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f8a9403e930 0x7f8a94040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:46:52.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.929+0000 7f8aa6ffd640 1 --2- 172.21.15.89:0/2716346049 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f8a9403e930 0x7f8a94040e40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:46:52.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:52.933+0000 7f8a8ffff640 1 -- 172.21.15.89:0/2716346049 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f8a980096b0 con 0x7f8aa81333b0 2024-09-16T16:46:53.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:53.144+0000 7f8aae191640 1 -- 172.21.15.89:0/2716346049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8aa8130e50 con 0x7f8aa81333b0 2024-09-16T16:46:53.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:53.145+0000 7f8a8ffff640 1 -- 172.21.15.89:0/2716346049 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (crc 0 0 0) 0x7f8a980090b0 con 0x7f8aa81333b0 2024-09-16T16:46:53.146 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T16:46:53.146 INFO:teuthology.orchestra.run.smithi089.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T16:46:53.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:53.147+0000 7f8aae191640 1 -- 172.21.15.89:0/2716346049 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f8a9403e930 msgr2=0x7f8a94040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:53.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:53.147+0000 7f8aae191640 1 --2- 172.21.15.89:0/2716346049 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f8a9403e930 0x7f8a94040e40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:53.147+0000 7f8aae191640 1 -- 172.21.15.89:0/2716346049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa81333b0 msgr2=0x7f8aa812d0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:46:53.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:53.147+0000 7f8aae191640 1 --2- 172.21.15.89:0/2716346049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa81333b0 0x7f8aa812d0e0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:53.147+0000 7f8aae191640 1 -- 172.21.15.89:0/2716346049 shutdown_connections 2024-09-16T16:46:53.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:53.147+0000 7f8aae191640 1 --2- 172.21.15.89:0/2716346049 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f8a9403e930 0x7f8a94040e40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:53.147+0000 7f8aae191640 1 --2- 172.21.15.89:0/2716346049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa81333b0 0x7f8aa812d0e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:46:53.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:53.147+0000 7f8aae191640 1 -- 172.21.15.89:0/2716346049 >> 172.21.15.89:0/2716346049 conn(0x7f8aa80a1dd0 msgr2=0x7f8aa80a21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:46:53.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:53.147+0000 7f8aae191640 1 -- 172.21.15.89:0/2716346049 shutdown_connections 2024-09-16T16:46:53.149 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T16:46:53.147+0000 7f8aae191640 1 -- 172.21.15.89:0/2716346049 wait complete. 2024-09-16T16:46:53.159 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T16:46:53.159 INFO:teuthology.run_tasks:Running task workunit... 2024-09-16T16:46:53.172 INFO:tasks.workunit:Pulling workunits from ref 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-16T16:46:53.172 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T16:46:53.173 DEBUG:teuthology.orchestra.run.smithi089:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T16:46:53.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:46:53.188 INFO:teuthology.orchestra.run.smithi089.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-16T16:46:53.188 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T16:46:53.243 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-16T16:46:53.244 DEBUG:teuthology.orchestra.run.smithi089:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-16T16:46:53.298 INFO:tasks.workunit:timeout=3h 2024-09-16T16:46:53.298 INFO:tasks.workunit:cleanup=True 2024-09-16T16:46:53.298 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-16T16:46:53.354 INFO:tasks.workunit.client.0.smithi089.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T16:47:43.178 INFO:tasks.workunit.client.0.smithi089.stderr:Note: switching to '0325fd3c11a225c0fd9eb38fab88aad1370ad779'. 2024-09-16T16:47:43.178 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-16T16:47:43.178 INFO:tasks.workunit.client.0.smithi089.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T16:47:43.178 INFO:tasks.workunit.client.0.smithi089.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T16:47:43.178 INFO:tasks.workunit.client.0.smithi089.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T16:47:43.179 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-16T16:47:43.179 INFO:tasks.workunit.client.0.smithi089.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T16:47:43.179 INFO:tasks.workunit.client.0.smithi089.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T16:47:43.179 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-16T16:47:43.179 INFO:tasks.workunit.client.0.smithi089.stderr: git switch -c 2024-09-16T16:47:43.179 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-16T16:47:43.179 INFO:tasks.workunit.client.0.smithi089.stderr:Or undo this operation with: 2024-09-16T16:47:43.179 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-16T16:47:43.179 INFO:tasks.workunit.client.0.smithi089.stderr: git switch - 2024-09-16T16:47:43.179 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-16T16:47:43.179 INFO:tasks.workunit.client.0.smithi089.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T16:47:43.179 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-16T16:47:43.179 INFO:tasks.workunit.client.0.smithi089.stderr:HEAD is now at 0325fd3c11a Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication 2024-09-16T16:47:43.182 DEBUG:teuthology.orchestra.run.smithi089:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T16:47:43.282 INFO:tasks.workunit.client.0.smithi089.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T16:47:43.284 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T16:47:43.284 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T16:47:43.995 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T16:47:44.083 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T16:47:44.123 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T16:47:44.124 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T16:47:44.125 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T16:47:44.163 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T16:47:44.166 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-16T16:47:44.166 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T16:47:44.181 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-09-16T16:47:44.182 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-09-16T16:47:44.182 DEBUG:teuthology.orchestra.run.smithi089:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson 2024-09-16T16:47:44.241 INFO:tasks.workunit.client.0.smithi089.stderr:+ parallel=1 2024-09-16T16:47:44.242 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' --crimson = --serial ']' 2024-09-16T16:47:44.242 INFO:tasks.workunit.client.0.smithi089.stderr:+ crimson=0 2024-09-16T16:47:44.242 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' --crimson = --crimson ']' 2024-09-16T16:47:44.242 INFO:tasks.workunit.client.0.smithi089.stderr:+ parallel=0 2024-09-16T16:47:44.242 INFO:tasks.workunit.client.0.smithi089.stderr:+ crimson=1 2024-09-16T16:47:44.242 INFO:tasks.workunit.client.0.smithi089.stderr:+ color= 2024-09-16T16:47:44.242 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' -t 1 ']' 2024-09-16T16:47:44.242 INFO:tasks.workunit.client.0.smithi089.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-09-16T16:47:44.242 INFO:tasks.workunit.client.0.smithi089.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-16T16:47:44.242 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-16T16:47:44.243 INFO:tasks.workunit.client.0.smithi089.stderr:+ declare -A pids 2024-09-16T16:47:44.243 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:47:44.243 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:47:44.243 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_aio 2024-09-16T16:47:44.260 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:47:44.260 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 42 tests from 2 test suites. 2024-09-16T16:47:44.260 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:47:44.260 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 26 tests from LibRadosAio 2024-09-16T16:47:44.260 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.TooBig 2024-09-16T16:47:47.286 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.TooBig (3026 ms) 2024-09-16T16:47:47.286 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.SimpleWrite 2024-09-16T16:47:50.302 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.SimpleWrite (3016 ms) 2024-09-16T16:47:50.302 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.WaitForSafe 2024-09-16T16:47:53.320 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.WaitForSafe (3018 ms) 2024-09-16T16:47:53.320 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTrip 2024-09-16T16:47:56.332 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTrip (3013 ms) 2024-09-16T16:47:56.333 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTrip2 2024-09-16T16:47:59.345 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTrip2 (3013 ms) 2024-09-16T16:47:59.345 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTrip3 2024-09-16T16:48:02.356 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTrip3 (3011 ms) 2024-09-16T16:48:02.357 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTripAppend 2024-09-16T16:48:05.388 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTripAppend (3031 ms) 2024-09-16T16:48:05.388 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RemoveTest 2024-09-16T16:48:08.400 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RemoveTest (3013 ms) 2024-09-16T16:48:08.401 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.XattrsRoundTrip 2024-09-16T16:48:11.417 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.XattrsRoundTrip (3016 ms) 2024-09-16T16:48:11.417 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RmXattr 2024-09-16T16:48:14.426 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RmXattr (3010 ms) 2024-09-16T16:48:14.427 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.XattrIter 2024-09-16T16:48:17.445 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.XattrIter (3018 ms) 2024-09-16T16:48:17.445 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.IsComplete 2024-09-16T16:48:20.457 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.IsComplete (3012 ms) 2024-09-16T16:48:20.457 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.IsSafe 2024-09-16T16:48:23.474 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.IsSafe (3017 ms) 2024-09-16T16:48:23.474 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.ReturnValue 2024-09-16T16:48:26.486 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.ReturnValue (3012 ms) 2024-09-16T16:48:26.486 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.Flush 2024-09-16T16:48:29.498 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.Flush (3012 ms) 2024-09-16T16:48:29.498 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.FlushAsync 2024-09-16T16:48:32.509 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.FlushAsync (3011 ms) 2024-09-16T16:48:32.509 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTripWriteFull 2024-09-16T16:48:35.527 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTripWriteFull (3019 ms) 2024-09-16T16:48:35.527 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTripWriteSame 2024-09-16T16:48:37.769 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTripWriteSame (2242 ms) 2024-09-16T16:48:37.770 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.SimpleStat 2024-09-16T16:48:40.775 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.SimpleStat (3005 ms) 2024-09-16T16:48:40.775 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-16T16:48:43.798 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.OperateMtime (3023 ms) 2024-09-16T16:48:43.798 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.Operate2Mtime 2024-09-16T16:48:46.764 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.Operate2Mtime (2966 ms) 2024-09-16T16:48:46.764 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.SimpleStatNS 2024-09-16T16:48:49.821 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.SimpleStatNS (3058 ms) 2024-09-16T16:48:49.821 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.StatRemove 2024-09-16T16:48:52.842 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.StatRemove (3020 ms) 2024-09-16T16:48:52.842 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.ExecuteClass 2024-09-16T16:48:55.854 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.ExecuteClass (3013 ms) 2024-09-16T16:48:55.854 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.MultiWrite 2024-09-16T16:48:58.862 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.MultiWrite (3007 ms) 2024-09-16T16:48:58.862 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.AioUnlock 2024-09-16T16:49:01.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.AioUnlock (3024 ms) 2024-09-16T16:49:01.889 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 26 tests from LibRadosAio (77627 ms total) 2024-09-16T16:49:01.889 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:49:01.890 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 16 tests from LibRadosAioEC 2024-09-16T16:49:01.890 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.SimpleWrite 2024-09-16T16:49:01.890 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1100: Skipped 2024-09-16T16:49:01.890 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:01.890 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2024-09-16T16:49:01.890 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.WaitForComplete 2024-09-16T16:49:01.890 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1132: Skipped 2024-09-16T16:49:01.890 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:01.890 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2024-09-16T16:49:01.890 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.RoundTrip 2024-09-16T16:49:01.890 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1149: Skipped 2024-09-16T16:49:01.890 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:01.890 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2024-09-16T16:49:01.890 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.RoundTrip2 2024-09-16T16:49:01.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1182: Skipped 2024-09-16T16:49:01.891 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:01.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2024-09-16T16:49:01.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.RoundTripAppend 2024-09-16T16:49:01.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1215: Skipped 2024-09-16T16:49:01.891 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:01.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2024-09-16T16:49:01.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.IsComplete 2024-09-16T16:49:01.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1286: Skipped 2024-09-16T16:49:01.891 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:01.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2024-09-16T16:49:01.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.IsSafe 2024-09-16T16:49:01.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1326: Skipped 2024-09-16T16:49:01.891 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:01.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2024-09-16T16:49:01.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.ReturnValue 2024-09-16T16:49:01.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1366: Skipped 2024-09-16T16:49:01.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:01.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2024-09-16T16:49:01.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.Flush 2024-09-16T16:49:01.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1385: Skipped 2024-09-16T16:49:01.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:01.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2024-09-16T16:49:01.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.FlushAsync 2024-09-16T16:49:01.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1415: Skipped 2024-09-16T16:49:01.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:01.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2024-09-16T16:49:01.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-09-16T16:49:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1454: Skipped 2024-09-16T16:49:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2024-09-16T16:49:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.SimpleStat 2024-09-16T16:49:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1498: Skipped 2024-09-16T16:49:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2024-09-16T16:49:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.SimpleStatNS 2024-09-16T16:49:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1532: Skipped 2024-09-16T16:49:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2024-09-16T16:49:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.StatRemove 2024-09-16T16:49:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1593: Skipped 2024-09-16T16:49:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:01.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2024-09-16T16:49:01.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.ExecuteClass 2024-09-16T16:49:01.894 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1649: Skipped 2024-09-16T16:49:01.894 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:01.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2024-09-16T16:49:01.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.MultiWrite 2024-09-16T16:49:01.894 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1681: Skipped 2024-09-16T16:49:01.894 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:49:01.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2024-09-16T16:49:01.894 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 16 tests from LibRadosAioEC (0 ms total) 2024-09-16T16:49:01.894 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:49:01.894 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:49:01.894 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 42 tests from 2 test suites ran. (77627 ms total) 2024-09-16T16:49:01.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 26 tests. 2024-09-16T16:49:01.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-16T16:49:01.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite 2024-09-16T16:49:01.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete 2024-09-16T16:49:01.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip 2024-09-16T16:49:01.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 2024-09-16T16:49:01.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend 2024-09-16T16:49:01.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete 2024-09-16T16:49:01.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe 2024-09-16T16:49:01.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue 2024-09-16T16:49:01.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.Flush 2024-09-16T16:49:01.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync 2024-09-16T16:49:01.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2024-09-16T16:49:01.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat 2024-09-16T16:49:01.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS 2024-09-16T16:49:01.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove 2024-09-16T16:49:01.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass 2024-09-16T16:49:01.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite 2024-09-16T16:49:01.896 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:49:01.896 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:49:01.896 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_aio_pp 2024-09-16T16:49:01.909 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:49:01.910 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 57 tests from 4 test suites. 2024-09-16T16:49:01.910 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:49:01.910 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 32 tests from LibRadosAio 2024-09-16T16:49:01.910 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.TooBigPP 2024-09-16T16:49:04.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.TooBigPP (2982 ms) 2024-09-16T16:49:04.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.PoolQuotaPP 2024-09-16T16:49:23.772 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.PoolQuotaPP (18880 ms) 2024-09-16T16:49:23.772 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.SimpleWritePP 2024-09-16T16:49:29.794 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.SimpleWritePP (6022 ms) 2024-09-16T16:49:29.794 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.WaitForSafePP 2024-09-16T16:49:32.803 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.WaitForSafePP (3010 ms) 2024-09-16T16:49:32.803 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTripPP 2024-09-16T16:49:35.822 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTripPP (3019 ms) 2024-09-16T16:49:35.822 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTripPP2 2024-09-16T16:49:38.835 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTripPP2 (3012 ms) 2024-09-16T16:49:38.835 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTripPP3 2024-09-16T16:49:41.772 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTripPP3 (2938 ms) 2024-09-16T16:49:41.773 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-09-16T16:49:44.780 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTripSparseReadPP (3007 ms) 2024-09-16T16:49:44.780 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.IsCompletePP 2024-09-16T16:49:47.797 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.IsCompletePP (3017 ms) 2024-09-16T16:49:47.797 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.IsSafePP 2024-09-16T16:49:50.807 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.IsSafePP (3010 ms) 2024-09-16T16:49:50.807 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.ReturnValuePP 2024-09-16T16:49:53.819 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.ReturnValuePP (3012 ms) 2024-09-16T16:49:53.819 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.FlushPP 2024-09-16T16:49:56.838 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.FlushPP (3019 ms) 2024-09-16T16:49:56.838 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.FlushAsyncPP 2024-09-16T16:49:59.861 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.FlushAsyncPP (3023 ms) 2024-09-16T16:49:59.861 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-09-16T16:50:02.874 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP (3013 ms) 2024-09-16T16:50:02.875 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-09-16T16:50:05.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP2 (3013 ms) 2024-09-16T16:50:05.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-09-16T16:50:08.899 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP (3012 ms) 2024-09-16T16:50:08.899 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-09-16T16:50:11.780 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP2 (2881 ms) 2024-09-16T16:50:11.780 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.SimpleStatPPNS 2024-09-16T16:50:14.788 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.SimpleStatPPNS (3009 ms) 2024-09-16T16:50:14.789 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.SimpleStatPP 2024-09-16T16:50:17.811 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.SimpleStatPP (3023 ms) 2024-09-16T16:50:17.811 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-16T16:50:20.821 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.OperateMtime (3010 ms) 2024-09-16T16:50:20.821 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.OperateMtime2 2024-09-16T16:50:23.831 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.OperateMtime2 (3010 ms) 2024-09-16T16:50:23.832 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.StatRemovePP 2024-09-16T16:50:26.843 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.StatRemovePP (3011 ms) 2024-09-16T16:50:26.843 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.ExecuteClassPP 2024-09-16T16:50:29.854 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.ExecuteClassPP (3012 ms) 2024-09-16T16:50:29.855 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.OmapPP 2024-09-16T16:50:32.869 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.OmapPP (3014 ms) 2024-09-16T16:50:32.869 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.MultiWritePP 2024-09-16T16:50:35.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.MultiWritePP (3026 ms) 2024-09-16T16:50:35.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.AioUnlockPP 2024-09-16T16:50:38.915 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.AioUnlockPP (3021 ms) 2024-09-16T16:50:38.916 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTripAppendPP 2024-09-16T16:50:41.783 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTripAppendPP (2867 ms) 2024-09-16T16:50:41.783 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RacingRemovePP 2024-09-16T16:50:44.791 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RacingRemovePP (3009 ms) 2024-09-16T16:50:44.791 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-09-16T16:50:47.806 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP (3014 ms) 2024-09-16T16:50:47.806 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-09-16T16:50:50.828 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP2 (3022 ms) 2024-09-16T16:50:50.828 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.PoolEIOFlag 2024-09-16T16:50:53.285 INFO:tasks.workunit.client.0.smithi089.stdout:setting pool EIO 2024-09-16T16:51:02.941 INFO:tasks.workunit.client.0.smithi089.stdout:waiting for 635 2024-09-16T16:51:03.941 INFO:tasks.workunit.client.0.smithi089.stdout:waiting for 509 2024-09-16T16:51:04.941 INFO:tasks.workunit.client.0.smithi089.stdout:waiting for 385 2024-09-16T16:51:05.941 INFO:tasks.workunit.client.0.smithi089.stdout:waiting for 259 2024-09-16T16:51:06.941 INFO:tasks.workunit.client.0.smithi089.stdout:waiting for 135 2024-09-16T16:51:07.941 INFO:tasks.workunit.client.0.smithi089.stdout:waiting for 98 2024-09-16T16:51:08.941 INFO:tasks.workunit.client.0.smithi089.stdout:waiting for 98 2024-09-16T16:51:09.942 INFO:tasks.workunit.client.0.smithi089.stdout:waiting for 98 2024-09-16T16:51:10.942 INFO:tasks.workunit.client.0.smithi089.stdout:waiting for 98 2024-09-16T16:51:11.942 INFO:tasks.workunit.client.0.smithi089.stdout:waiting for 98 2024-09-16T16:51:12.942 INFO:tasks.workunit.client.0.smithi089.stdout:waiting for 98 2024-09-16T16:51:13.942 INFO:tasks.workunit.client.0.smithi089.stdout:waiting for 98 2024-09-16T16:51:14.942 INFO:tasks.workunit.client.0.smithi089.stdout:waiting for 98 2024-09-16T16:51:15.943 INFO:tasks.workunit.client.0.smithi089.stdout:max_success 902, min_failed 903 2024-09-16T16:51:16.259 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAio.PoolEIOFlag (25431 ms) 2024-09-16T16:51:16.260 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAio.MultiReads 2024-09-16T16:51:16.260 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2427: Skipped 2024-09-16T16:51:16.260 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:16.260 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAio.MultiReads (0 ms) 2024-09-16T16:51:16.260 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 32 tests from LibRadosAio (134350 ms total) 2024-09-16T16:51:16.260 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:51:16.260 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosAioPP 2024-09-16T16:51:16.260 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-09-16T16:51:18.794 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAioPP.ReadIntoBufferlist (2534 ms) 2024-09-16T16:51:18.794 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-09-16T16:51:27.798 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAioPP.XattrsRoundTripPP (9004 ms) 2024-09-16T16:51:27.799 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioPP.RmXattrPP 2024-09-16T16:51:42.810 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAioPP.RmXattrPP (15012 ms) 2024-09-16T16:51:42.810 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioPP.RemoveTestPP 2024-09-16T16:51:45.829 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosAioPP.RemoveTestPP (3019 ms) 2024-09-16T16:51:45.829 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosAioPP (29569 ms total) 2024-09-16T16:51:45.829 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:51:45.829 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibRadosIoPP 2024-09-16T16:51:45.829 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-16T16:51:48.837 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.XattrListPP (3006 ms) 2024-09-16T16:51:48.837 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibRadosIoPP (3006 ms total) 2024-09-16T16:51:48.837 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:51:48.837 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 20 tests from LibRadosAioEC 2024-09-16T16:51:48.837 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.SimpleWritePP 2024-09-16T16:51:48.837 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1384: Skipped 2024-09-16T16:51:48.838 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.838 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP (0 ms) 2024-09-16T16:51:48.838 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.WaitForSafePP 2024-09-16T16:51:48.838 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1419: Skipped 2024-09-16T16:51:48.838 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.838 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP (0 ms) 2024-09-16T16:51:48.839 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.RoundTripPP 2024-09-16T16:51:48.839 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1436: Skipped 2024-09-16T16:51:48.839 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.839 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP (0 ms) 2024-09-16T16:51:48.839 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.RoundTripPP2 2024-09-16T16:51:48.839 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1467: Skipped 2024-09-16T16:51:48.840 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.840 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 (0 ms) 2024-09-16T16:51:48.840 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.RoundTripPP3 2024-09-16T16:51:48.840 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1500: Skipped 2024-09-16T16:51:48.840 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.841 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 (0 ms) 2024-09-16T16:51:48.841 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-16T16:51:48.841 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1605: Skipped 2024-09-16T16:51:48.841 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.841 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP (0 ms) 2024-09-16T16:51:48.841 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-09-16T16:51:48.841 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1637: Skipped 2024-09-16T16:51:48.841 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.841 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP (0 ms) 2024-09-16T16:51:48.841 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.IsCompletePP 2024-09-16T16:51:48.841 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1705: Skipped 2024-09-16T16:51:48.842 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.842 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP (0 ms) 2024-09-16T16:51:48.842 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.IsSafePP 2024-09-16T16:51:48.842 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1742: Skipped 2024-09-16T16:51:48.842 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.842 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP (0 ms) 2024-09-16T16:51:48.842 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.ReturnValuePP 2024-09-16T16:51:48.842 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1780: Skipped 2024-09-16T16:51:48.842 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.842 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP (0 ms) 2024-09-16T16:51:48.842 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.FlushPP 2024-09-16T16:51:48.842 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1796: Skipped 2024-09-16T16:51:48.842 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.842 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP (0 ms) 2024-09-16T16:51:48.843 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.FlushAsyncPP 2024-09-16T16:51:48.843 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1824: Skipped 2024-09-16T16:51:48.843 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.843 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP (0 ms) 2024-09-16T16:51:48.843 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-16T16:51:48.843 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1859: Skipped 2024-09-16T16:51:48.843 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.843 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP (0 ms) 2024-09-16T16:51:48.843 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-16T16:51:48.843 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1904: Skipped 2024-09-16T16:51:48.843 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.844 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 (0 ms) 2024-09-16T16:51:48.844 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.SimpleStatPP 2024-09-16T16:51:48.844 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1946: Skipped 2024-09-16T16:51:48.844 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.844 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP (0 ms) 2024-09-16T16:51:48.844 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-09-16T16:51:48.844 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1977: Skipped 2024-09-16T16:51:48.844 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.844 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS (0 ms) 2024-09-16T16:51:48.844 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.StatRemovePP 2024-09-16T16:51:48.844 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2008: Skipped 2024-09-16T16:51:48.844 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.844 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP (0 ms) 2024-09-16T16:51:48.844 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.ExecuteClassPP 2024-09-16T16:51:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2059: Skipped 2024-09-16T16:51:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP (0 ms) 2024-09-16T16:51:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.OmapPP 2024-09-16T16:51:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2089: Skipped 2024-09-16T16:51:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP (0 ms) 2024-09-16T16:51:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosAioEC.MultiWritePP 2024-09-16T16:51:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2124: Skipped 2024-09-16T16:51:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP (0 ms) 2024-09-16T16:51:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 20 tests from LibRadosAioEC (0 ms total) 2024-09-16T16:51:48.845 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:51:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:51:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 57 tests from 4 test suites ran. (166925 ms total) 2024-09-16T16:51:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 36 tests. 2024-09-16T16:51:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] 21 tests, listed below: 2024-09-16T16:51:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAio.MultiReads 2024-09-16T16:51:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP 2024-09-16T16:51:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP 2024-09-16T16:51:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP 2024-09-16T16:51:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 2024-09-16T16:51:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 2024-09-16T16:51:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-16T16:51:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP 2024-09-16T16:51:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP 2024-09-16T16:51:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP 2024-09-16T16:51:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP 2024-09-16T16:51:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP 2024-09-16T16:51:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP 2024-09-16T16:51:48.847 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-16T16:51:48.847 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-16T16:51:48.847 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP 2024-09-16T16:51:48.847 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS 2024-09-16T16:51:48.847 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP 2024-09-16T16:51:48.847 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP 2024-09-16T16:51:48.847 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP 2024-09-16T16:51:48.847 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP 2024-09-16T16:51:48.848 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:51:48.848 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:51:48.848 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_io 2024-09-16T16:51:48.861 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:51:48.861 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 24 tests from 2 test suites. 2024-09-16T16:51:48.861 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:51:48.861 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 14 tests from LibRadosIo 2024-09-16T16:51:50.842 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIo.SimpleWrite 2024-09-16T16:51:51.173 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIo.SimpleWrite (331 ms) 2024-09-16T16:51:51.173 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIo.TooBig 2024-09-16T16:51:51.173 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIo.TooBig (0 ms) 2024-09-16T16:51:51.173 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIo.ReadTimeout 2024-09-16T16:51:51.258 INFO:tasks.workunit.client.0.smithi089.stdout:no timeout :/ 2024-09-16T16:51:51.258 INFO:tasks.workunit.client.0.smithi089.stdout:no timeout :/ 2024-09-16T16:51:51.258 INFO:tasks.workunit.client.0.smithi089.stdout:no timeout :/ 2024-09-16T16:51:51.259 INFO:tasks.workunit.client.0.smithi089.stdout:no timeout :/ 2024-09-16T16:51:51.259 INFO:tasks.workunit.client.0.smithi089.stdout:no timeout :/ 2024-09-16T16:51:51.259 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIo.ReadTimeout (85 ms) 2024-09-16T16:51:51.259 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIo.RoundTrip 2024-09-16T16:51:51.309 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIo.RoundTrip (52 ms) 2024-09-16T16:51:51.310 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIo.Checksum 2024-09-16T16:51:51.334 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIo.Checksum (24 ms) 2024-09-16T16:51:51.334 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-09-16T16:51:51.374 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIo.OverlappingWriteRoundTrip (40 ms) 2024-09-16T16:51:51.374 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIo.WriteFullRoundTrip 2024-09-16T16:51:51.423 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIo.WriteFullRoundTrip (49 ms) 2024-09-16T16:51:51.423 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIo.AppendRoundTrip 2024-09-16T16:51:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIo.AppendRoundTrip (44 ms) 2024-09-16T16:51:51.466 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIo.ZeroLenZero 2024-09-16T16:51:51.472 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIo.ZeroLenZero (5 ms) 2024-09-16T16:51:51.472 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIo.TruncTest 2024-09-16T16:51:51.512 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIo.TruncTest (40 ms) 2024-09-16T16:51:51.512 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIo.RemoveTest 2024-09-16T16:51:51.551 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIo.RemoveTest (39 ms) 2024-09-16T16:51:51.551 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIo.XattrsRoundTrip 2024-09-16T16:51:51.594 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIo.XattrsRoundTrip (43 ms) 2024-09-16T16:51:51.594 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIo.RmXattr 2024-09-16T16:51:51.703 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIo.RmXattr (109 ms) 2024-09-16T16:51:51.703 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIo.XattrIter 2024-09-16T16:51:51.761 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIo.XattrIter (59 ms) 2024-09-16T16:51:51.854 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 14 tests from LibRadosIo (920 ms total) 2024-09-16T16:51:51.854 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:51:51.854 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 10 tests from LibRadosIoEC 2024-09-16T16:51:51.854 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T16:51:51.854 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.855 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoEC.SimpleWrite 2024-09-16T16:51:51.855 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:51.855 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.855 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:51.855 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.855 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2024-09-16T16:51:51.855 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoEC.RoundTrip 2024-09-16T16:51:51.855 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:51.855 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.855 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:51.855 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.855 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2024-09-16T16:51:51.855 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-16T16:51:51.856 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:51.856 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.856 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:51.856 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.856 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2024-09-16T16:51:51.856 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-09-16T16:51:51.856 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:51.856 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.856 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:51.856 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.856 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2024-09-16T16:51:51.856 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoEC.AppendRoundTrip 2024-09-16T16:51:51.857 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:51.857 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.857 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:51.857 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.857 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2024-09-16T16:51:51.857 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoEC.TruncTest 2024-09-16T16:51:51.857 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:51.857 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.857 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:51.857 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.857 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2024-09-16T16:51:51.857 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoEC.RemoveTest 2024-09-16T16:51:51.857 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:51.858 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.858 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:51.858 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.858 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2024-09-16T16:51:51.858 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-09-16T16:51:51.858 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:51.858 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.858 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:51.858 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.858 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2024-09-16T16:51:51.858 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoEC.RmXattr 2024-09-16T16:51:51.858 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:51.858 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2024-09-16T16:51:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoEC.XattrIter 2024-09-16T16:51:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:51:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:51:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2024-09-16T16:51:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T16:51:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 10 tests from LibRadosIoEC (0 ms total) 2024-09-16T16:51:51.859 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:51:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:51:51.860 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 24 tests from 2 test suites ran. (2992 ms total) 2024-09-16T16:51:51.860 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 14 tests. 2024-09-16T16:51:51.860 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] 10 tests, listed below: 2024-09-16T16:51:51.860 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite 2024-09-16T16:51:51.860 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip 2024-09-16T16:51:51.860 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-16T16:51:51.860 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2024-09-16T16:51:51.860 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2024-09-16T16:51:51.860 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest 2024-09-16T16:51:51.860 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest 2024-09-16T16:51:51.860 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2024-09-16T16:51:51.860 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr 2024-09-16T16:51:51.860 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter 2024-09-16T16:51:51.861 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:51:51.861 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:51:51.861 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_io_pp 2024-09-16T16:51:51.874 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:51:51.874 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 40 tests from 2 test suites. 2024-09-16T16:51:51.875 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:51:51.875 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 22 tests from LibRadosIoPP 2024-09-16T16:51:51.875 INFO:tasks.workunit.client.0.smithi089.stdout:seed 30624 2024-09-16T16:51:53.861 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.TooBigPP 2024-09-16T16:51:53.861 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-09-16T16:51:53.862 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.SimpleWritePP 2024-09-16T16:51:54.201 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.SimpleWritePP (340 ms) 2024-09-16T16:51:54.201 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.ReadOpPP 2024-09-16T16:51:54.295 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.ReadOpPP (95 ms) 2024-09-16T16:51:54.295 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.SparseReadOpPP 2024-09-16T16:51:54.330 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.SparseReadOpPP (34 ms) 2024-09-16T16:51:54.330 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-09-16T16:51:57.963 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (3633 ms) 2024-09-16T16:51:57.963 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.RoundTripPP 2024-09-16T16:51:57.988 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.RoundTripPP (25 ms) 2024-09-16T16:51:57.988 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.RoundTripPP2 2024-09-16T16:51:58.012 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.RoundTripPP2 (24 ms) 2024-09-16T16:51:58.012 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.Checksum 2024-09-16T16:51:58.038 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.Checksum (26 ms) 2024-09-16T16:51:58.038 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-09-16T16:51:58.067 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.ReadIntoBufferlist (29 ms) 2024-09-16T16:51:58.067 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-09-16T16:51:58.106 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (39 ms) 2024-09-16T16:51:58.106 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-09-16T16:51:58.147 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP (42 ms) 2024-09-16T16:51:58.147 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-09-16T16:51:58.172 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (24 ms) 2024-09-16T16:51:58.172 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-09-16T16:51:58.214 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.AppendRoundTripPP (43 ms) 2024-09-16T16:51:58.215 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.TruncTestPP 2024-09-16T16:51:58.258 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.TruncTestPP (43 ms) 2024-09-16T16:51:58.258 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.RemoveTestPP 2024-09-16T16:51:58.299 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.RemoveTestPP (42 ms) 2024-09-16T16:51:58.299 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-09-16T16:51:58.342 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.XattrsRoundTripPP (42 ms) 2024-09-16T16:51:58.342 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.RmXattrPP 2024-09-16T16:51:58.452 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.RmXattrPP (111 ms) 2024-09-16T16:51:58.453 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-16T16:51:58.505 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.XattrListPP (53 ms) 2024-09-16T16:51:58.505 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.CrcZeroWrite 2024-09-16T16:51:58.539 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.CrcZeroWrite (34 ms) 2024-09-16T16:51:58.539 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.CmpExtPP 2024-09-16T16:51:58.581 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.CmpExtPP (41 ms) 2024-09-16T16:51:58.581 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-09-16T16:51:58.605 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.CmpExtDNEPP (24 ms) 2024-09-16T16:51:58.605 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-09-16T16:51:58.639 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosIoPP.CmpExtMismatchPP (34 ms) 2024-09-16T16:51:58.879 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 22 tests from LibRadosIoPP (4778 ms total) 2024-09-16T16:51:58.879 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:51:58.879 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 18 tests from LibRadosIoECPP 2024-09-16T16:51:58.879 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T16:51:58.879 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.880 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.SimpleWritePP 2024-09-16T16:51:58.880 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.880 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.880 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.880 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.880 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2024-09-16T16:51:58.880 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.ReadOpPP 2024-09-16T16:51:58.880 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.880 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.880 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.880 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.880 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP (0 ms) 2024-09-16T16:51:58.880 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-09-16T16:51:58.881 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.881 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.881 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.881 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.881 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2024-09-16T16:51:58.881 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP 2024-09-16T16:51:58.881 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.881 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.881 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.881 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.881 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2024-09-16T16:51:58.881 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP2 2024-09-16T16:51:58.881 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.881 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.882 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.882 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.882 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2024-09-16T16:51:58.882 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-16T16:51:58.882 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.882 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.882 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.882 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.882 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2024-09-16T16:51:58.882 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-16T16:51:58.882 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.882 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.882 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.882 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.883 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2024-09-16T16:51:58.883 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-16T16:51:58.883 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.883 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.883 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.883 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.883 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2024-09-16T16:51:58.883 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-09-16T16:51:58.883 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.883 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.883 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.883 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.883 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2024-09-16T16:51:58.883 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.TruncTestPP 2024-09-16T16:51:58.884 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.884 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.884 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.884 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.884 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2024-09-16T16:51:58.884 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.RemoveTestPP 2024-09-16T16:51:58.884 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.884 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.884 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.884 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.884 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2024-09-16T16:51:58.884 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-16T16:51:58.884 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.885 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.885 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.885 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.885 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2024-09-16T16:51:58.885 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.RmXattrPP 2024-09-16T16:51:58.885 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.885 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.885 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.885 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.885 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2024-09-16T16:51:58.885 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.CrcZeroWrite 2024-09-16T16:51:58.885 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.885 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.885 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.886 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite (0 ms) 2024-09-16T16:51:58.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.XattrListPP 2024-09-16T16:51:58.886 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.886 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.886 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.886 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2024-09-16T16:51:58.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.CmpExtPP 2024-09-16T16:51:58.886 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.886 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.886 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.886 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2024-09-16T16:51:58.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-09-16T16:51:58.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2024-09-16T16:51:58.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-16T16:51:58.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:51:58.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:51:58.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2024-09-16T16:51:58.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T16:51:58.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:51:58.887 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 18 tests from LibRadosIoECPP (0 ms total) 2024-09-16T16:51:58.887 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:51:58.888 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:51:58.888 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 40 tests from 2 test suites ran. (7003 ms total) 2024-09-16T16:51:58.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 22 tests. 2024-09-16T16:51:58.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] 18 tests, listed below: 2024-09-16T16:51:58.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2024-09-16T16:51:58.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP 2024-09-16T16:51:58.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2024-09-16T16:51:58.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP 2024-09-16T16:51:58.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2024-09-16T16:51:58.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-16T16:51:58.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-16T16:51:58.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-16T16:51:58.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2024-09-16T16:51:58.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP 2024-09-16T16:51:58.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2024-09-16T16:51:58.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-16T16:51:58.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP 2024-09-16T16:51:58.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite 2024-09-16T16:51:58.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP 2024-09-16T16:51:58.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP 2024-09-16T16:51:58.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2024-09-16T16:51:58.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-16T16:51:58.889 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:51:58.890 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:51:58.890 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_asio 2024-09-16T16:51:58.913 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.912+0000 7f4bc10d86c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:58.920 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.919+0000 7f4bc10d86c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:58.920 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.920+0000 7f4bc10d86c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:58.921 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-16T16:51:58.921 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:51:58.921 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 12 tests from AsioRados 2024-09-16T16:51:58.921 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.921+0000 7f4bc10d86c0 1 Processor -- start 2024-09-16T16:51:58.922 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.921+0000 7f4bc10d86c0 1 -- start start 2024-09-16T16:51:58.924 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.923+0000 7f4bc10d86c0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x25cee80 0x2665650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:51:58.924 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.923+0000 7f4bc10d86c0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x2534520 con 0x25cee80 2024-09-16T16:51:58.924 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.923+0000 7f4bb9a3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x25cee80 0x2665650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:51:58.924 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.923+0000 7f4bb9a3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x25cee80 0x2665650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41800/0 (socket says 172.21.15.89:41800) 2024-09-16T16:51:58.924 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.923+0000 7f4bb9a3f640 1 -- 172.21.15.89:0/1930708095 learned_addr learned my addr 172.21.15.89:0/1930708095 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:51:58.925 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.923+0000 7f4bb9a3f640 1 -- 172.21.15.89:0/1930708095 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x24d0e10 con 0x25cee80 2024-09-16T16:51:58.925 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.924+0000 7f4bb9a3f640 1 --2- 172.21.15.89:0/1930708095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x25cee80 0x2665650 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84504af355c4580 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:51:58.925 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.924+0000 7f4bb37fe640 1 -- 172.21.15.89:0/1930708095 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4ba402dc20 con 0x25cee80 2024-09-16T16:51:58.925 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.924+0000 7f4bb37fe640 1 -- 172.21.15.89:0/1930708095 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4ba4037370 con 0x25cee80 2024-09-16T16:51:58.925 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.924+0000 7f4bb37fe640 1 -- 172.21.15.89:0/1930708095 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4ba4037610 con 0x25cee80 2024-09-16T16:51:58.926 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.925+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/1930708095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x25cee80 msgr2=0x2665650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:51:58.926 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.925+0000 7f4bc10d86c0 1 --2- 172.21.15.89:0/1930708095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x25cee80 0x2665650 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:51:58.926 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.925+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/1930708095 shutdown_connections 2024-09-16T16:51:58.926 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.925+0000 7f4bc10d86c0 1 --2- 172.21.15.89:0/1930708095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x25cee80 0x2665650 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:51:58.926 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.925+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/1930708095 >> 172.21.15.89:0/1930708095 conn(0x24f4770 msgr2=0x25cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:51:58.926 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.925+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/1930708095 shutdown_connections 2024-09-16T16:51:58.927 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.925+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/1930708095 wait complete. 2024-09-16T16:51:58.927 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.927+0000 7f4bc10d86c0 1 Processor -- start 2024-09-16T16:51:58.927 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.927+0000 7f4bc10d86c0 1 -- start start 2024-09-16T16:51:58.930 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.929+0000 7f4bc10d86c0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x25cee80 0x2664910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:51:58.930 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.929+0000 7f4bc10d86c0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x2532280 con 0x25cee80 2024-09-16T16:51:58.930 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.929+0000 7f4bb9a3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x25cee80 0x2664910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:51:58.930 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.929+0000 7f4bb9a3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x25cee80 0x2664910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41806/0 (socket says 172.21.15.89:41806) 2024-09-16T16:51:58.930 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.929+0000 7f4bb9a3f640 1 -- 172.21.15.89:0/3550653529 learned_addr learned my addr 172.21.15.89:0/3550653529 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T16:51:58.930 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.930+0000 7f4bb9a3f640 1 -- 172.21.15.89:0/3550653529 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x24c2920 con 0x25cee80 2024-09-16T16:51:58.930 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.930+0000 7f4bb9a3f640 1 --2- 172.21.15.89:0/3550653529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x25cee80 0x2664910 crc :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:51:58.931 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.930+0000 7f4bb27fc640 1 -- 172.21.15.89:0/3550653529 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4ba403e040 con 0x25cee80 2024-09-16T16:51:58.931 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.930+0000 7f4bb27fc640 1 -- 172.21.15.89:0/3550653529 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4ba40374e0 con 0x25cee80 2024-09-16T16:51:58.931 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.930+0000 7f4bb27fc640 1 -- 172.21.15.89:0/3550653529 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4ba402dc20 con 0x25cee80 2024-09-16T16:51:58.947 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.947+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x24c2380 con 0x25cee80 2024-09-16T16:51:58.951 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.951+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2663000 con 0x25cee80 2024-09-16T16:51:58.952 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.951+0000 7f4bb27fc640 1 -- 172.21.15.89:0/3550653529 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4ba4041040 con 0x25cee80 2024-09-16T16:51:58.953 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.952+0000 7f4bb27fc640 1 --2- 172.21.15.89:0/3550653529 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f4ba003d1c0 0x7f4ba003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:51:58.953 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.952+0000 7f4bb27fc640 1 -- 172.21.15.89:0/3550653529 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(237..237 src has 1..237) ==== 2700+0+0 (crc 0 0 0) 0x7f4ba4032040 con 0x25cee80 2024-09-16T16:51:58.953 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.953+0000 7f4bb923e640 1 --2- 172.21.15.89:0/3550653529 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f4ba003d1c0 0x7f4ba003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T16:51:58.954 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.953+0000 7f4bb923e640 1 --2- 172.21.15.89:0/3550653529 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f4ba003d1c0 0x7f4ba003f6d0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:51:58.956 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.956+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x252adf0 con 0x25cee80 2024-09-16T16:51:58.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.956+0000 7f4bb27fc640 1 -- 172.21.15.89:0/3550653529 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=237) ==== 24+0+0 (crc 0 0 0) 0x7f4ba4040ea0 con 0x25cee80 2024-09-16T16:51:58.960 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:58.960+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x253dbf0 con 0x25cee80 2024-09-16T16:51:59.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:59.881+0000 7f4bb27fc640 1 -- 172.21.15.89:0/3550653529 <== mon.0 v2:172.21.15.89:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v238) ==== 43+0+0 (crc 0 0 0) 0x7f4ba4038770 con 0x25cee80 2024-09-16T16:51:59.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:59.881+0000 7f4bb27fc640 1 -- 172.21.15.89:0/3550653529 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=238}) -- 0x7f4ba0041b40 con 0x25cee80 2024-09-16T16:51:59.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:59.881+0000 7f4bb27fc640 1 -- 172.21.15.89:0/3550653529 <== mon.0 v2:172.21.15.89:3300/0 8 ==== osd_map(238..238 src has 1..238) ==== 651+0+0 (crc 0 0 0) 0x7f4ba403d130 con 0x25cee80 2024-09-16T16:51:59.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:59.882+0000 7f4bc10d86c0 1 --2- 172.21.15.89:0/3550653529 >> v2:172.21.15.89:6803/245700216 conn(0x25cf7d0 0x26ff3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T16:51:59.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:59.882+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:2 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0x264cde0 con 0x25cf7d0 2024-09-16T16:51:59.886 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:59.885+0000 7f4bba240640 1 --2- 172.21.15.89:0/3550653529 >> v2:172.21.15.89:6803/245700216 conn(0x25cf7d0 0x26ff3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T16:51:59.900 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:51:59.899+0000 7f4bba240640 1 --2- 172.21.15.89:0/3550653529 >> v2:172.21.15.89:6803/245700216 conn(0x25cf7d0 0x26ff3c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T16:52:01.203 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] AsioRados.AsyncReadCallback 2024-09-16T16:52:01.203 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.202+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 1 ==== osd_op_reply(2 exist [writefull 0~5] v239'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.203 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.202+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:3 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x26f9b90 con 0x25cf7d0 2024-09-16T16:52:01.203 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.202+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:4 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x26fa3f0 con 0x25cf7d0 2024-09-16T16:52:01.209 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.209+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 2 ==== osd_op_reply(3 exist [read 0~5 out=5b] v239'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.210 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.210+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.211 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] AsioRados.AsyncReadCallback (8 ms) 2024-09-16T16:52:01.211 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] AsioRados.AsyncReadFuture 2024-09-16T16:52:01.211 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.210+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:5 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x26fa7d0 con 0x25cf7d0 2024-09-16T16:52:01.211 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.210+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:6 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x26ff900 con 0x25cf7d0 2024-09-16T16:52:01.218 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.217+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 4 ==== osd_op_reply(5 exist [read 0~5 out=5b] v239'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.218 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.217+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 5 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.218 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] AsioRados.AsyncReadFuture (7 ms) 2024-09-16T16:52:01.218 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] AsioRados.AsyncReadYield 2024-09-16T16:52:01.219 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.217+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:7 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x2664e50 con 0x25cf7d0 2024-09-16T16:52:01.219 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.217+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:8 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x2740130 con 0x25cf7d0 2024-09-16T16:52:01.225 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.224+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 6 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.225 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.225+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v239'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.226 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] AsioRados.AsyncReadYield (8 ms) 2024-09-16T16:52:01.226 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] AsioRados.AsyncWriteCallback 2024-09-16T16:52:01.226 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.225+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:9 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0x2700c70 con 0x25cf7d0 2024-09-16T16:52:01.242 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.241+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 8 ==== osd_op_reply(9 exist [write 0~5] v239'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.242 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] AsioRados.AsyncWriteCallback (16 ms) 2024-09-16T16:52:01.242 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] AsioRados.AsyncWriteFuture 2024-09-16T16:52:01.242 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.241+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:10 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0x2700c70 con 0x25cf7d0 2024-09-16T16:52:01.257 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.256+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 9 ==== osd_op_reply(10 exist [write 0~5] v239'3 uv3 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.257 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] AsioRados.AsyncWriteFuture (15 ms) 2024-09-16T16:52:01.257 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] AsioRados.AsyncWriteYield 2024-09-16T16:52:01.258 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.257+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:11 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0x2722ba0 con 0x25cf7d0 2024-09-16T16:52:01.273 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.272+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 10 ==== osd_op_reply(11 exist [write 0~5] v239'4 uv4 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.273 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] AsioRados.AsyncWriteYield (16 ms) 2024-09-16T16:52:01.273 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] AsioRados.AsyncReadOperationCallback 2024-09-16T16:52:01.273 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.272+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:12 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x26ffc60 con 0x25cf7d0 2024-09-16T16:52:01.273 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.272+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:13 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x27005c0 con 0x25cf7d0 2024-09-16T16:52:01.280 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.280+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 11 ==== osd_op_reply(12 exist [read 0~5 out=5b] v239'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.281 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.280+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 12 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.281 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] AsioRados.AsyncReadOperationCallback (8 ms) 2024-09-16T16:52:01.281 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] AsioRados.AsyncReadOperationFuture 2024-09-16T16:52:01.281 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.280+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:14 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x26ffc60 con 0x25cf7d0 2024-09-16T16:52:01.281 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.280+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:15 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x2723130 con 0x25cf7d0 2024-09-16T16:52:01.288 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.287+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 13 ==== osd_op_reply(14 exist [read 0~5 out=5b] v239'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.288 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.287+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 14 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.288 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] AsioRados.AsyncReadOperationFuture (7 ms) 2024-09-16T16:52:01.288 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] AsioRados.AsyncReadOperationYield 2024-09-16T16:52:01.289 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.287+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:16 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x2723130 con 0x25cf7d0 2024-09-16T16:52:01.289 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.287+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:17 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0x27005c0 con 0x25cf7d0 2024-09-16T16:52:01.294 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.294+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 15 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.295 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.295+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 16 ==== osd_op_reply(16 exist [read 0~5 out=5b] v239'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.296 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] AsioRados.AsyncReadOperationYield (8 ms) 2024-09-16T16:52:01.296 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] AsioRados.AsyncWriteOperationCallback 2024-09-16T16:52:01.296 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.295+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:18 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0x2723130 con 0x25cf7d0 2024-09-16T16:52:01.312 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.311+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 17 ==== osd_op_reply(18 exist [writefull 0~5] v239'5 uv5 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.312 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] AsioRados.AsyncWriteOperationCallback (16 ms) 2024-09-16T16:52:01.312 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] AsioRados.AsyncWriteOperationFuture 2024-09-16T16:52:01.312 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.311+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:19 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0x2700110 con 0x25cf7d0 2024-09-16T16:52:01.327 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.327+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 18 ==== osd_op_reply(19 exist [writefull 0~5] v239'6 uv6 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.328 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] AsioRados.AsyncWriteOperationFuture (16 ms) 2024-09-16T16:52:01.328 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] AsioRados.AsyncWriteOperationYield 2024-09-16T16:52:01.328 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.327+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:20 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0x2700110 con 0x25cf7d0 2024-09-16T16:52:01.343 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.342+0000 7f4bba240640 1 -- 172.21.15.89:0/3550653529 <== osd.1 v2:172.21.15.89:6803/245700216 19 ==== osd_op_reply(20 exist [writefull 0~5] v239'7 uv7 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4bac00a430 con 0x25cf7d0 2024-09-16T16:52:01.343 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] AsioRados.AsyncWriteOperationYield (15 ms) 2024-09-16T16:52:01.344 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.343+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 >> v2:172.21.15.89:6803/245700216 conn(0x25cf7d0 msgr2=0x26ff3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:52:01.344 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.343+0000 7f4bc10d86c0 1 --2- 172.21.15.89:0/3550653529 >> v2:172.21.15.89:6803/245700216 conn(0x25cf7d0 0x26ff3c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:52:01.345 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.343+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f4ba003d1c0 msgr2=0x7f4ba003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:52:01.345 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.343+0000 7f4bc10d86c0 1 --2- 172.21.15.89:0/3550653529 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f4ba003d1c0 0x7f4ba003f6d0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:52:01.345 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.343+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x25cee80 msgr2=0x2664910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T16:52:01.345 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.343+0000 7f4bc10d86c0 1 --2- 172.21.15.89:0/3550653529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x25cee80 0x2664910 crc :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:52:01.345 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.343+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 shutdown_connections 2024-09-16T16:52:01.345 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.343+0000 7f4bc10d86c0 1 --2- 172.21.15.89:0/3550653529 >> v2:172.21.15.89:6803/245700216 conn(0x25cf7d0 0x26ff3c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:52:01.345 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.343+0000 7f4bc10d86c0 1 --2- 172.21.15.89:0/3550653529 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f4ba003d1c0 0x7f4ba003f6d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:52:01.345 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.343+0000 7f4bc10d86c0 1 --2- 172.21.15.89:0/3550653529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x25cee80 0x2664910 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T16:52:01.345 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.343+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 >> 172.21.15.89:0/3550653529 conn(0x24f4770 msgr2=0x25cb490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T16:52:01.345 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.343+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 shutdown_connections 2024-09-16T16:52:01.345 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.343+0000 7f4bc10d86c0 1 -- 172.21.15.89:0/3550653529 wait complete. 2024-09-16T16:52:01.346 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 12 tests from AsioRados (140 ms total) 2024-09-16T16:52:01.346 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:52:01.346 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:52:01.346 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 12 tests from 1 test suite ran. (2423 ms total) 2024-09-16T16:52:01.346 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 12 tests. 2024-09-16T16:52:01.346 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:52:01.347 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:52:01.347 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_list 2024-09-16T16:52:01.376 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.375+0000 7f0b295529c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:01.376 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.375+0000 7f0b295529c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:01.376 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:01.375+0000 7f0b295529c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:01.376 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 11 tests from 3 test suites. 2024-09-16T16:52:01.376 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:52:01.376 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 7 tests from LibRadosList 2024-09-16T16:52:02.801 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosList.ListObjects 2024-09-16T16:52:03.486 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosList.ListObjects (685 ms) 2024-09-16T16:52:03.486 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosList.ListObjectsZeroInName 2024-09-16T16:52:03.784 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosList.ListObjectsZeroInName (299 ms) 2024-09-16T16:52:03.785 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosList.ListObjectsNS 2024-09-16T16:52:03.963 INFO:tasks.workunit.client.0.smithi089.stdout:myset foo1,foo2,foo3 2024-09-16T16:52:04.098 INFO:tasks.workunit.client.0.smithi089.stdout:foo1 2024-09-16T16:52:04.098 INFO:tasks.workunit.client.0.smithi089.stdout:foo2 2024-09-16T16:52:04.098 INFO:tasks.workunit.client.0.smithi089.stdout:foo3 2024-09-16T16:52:04.099 INFO:tasks.workunit.client.0.smithi089.stdout:myset foo1,foo4,foo5 2024-09-16T16:52:04.234 INFO:tasks.workunit.client.0.smithi089.stdout:foo4 2024-09-16T16:52:04.235 INFO:tasks.workunit.client.0.smithi089.stdout:foo5 2024-09-16T16:52:04.235 INFO:tasks.workunit.client.0.smithi089.stdout:foo1 2024-09-16T16:52:04.235 INFO:tasks.workunit.client.0.smithi089.stdout:myset foo6,foo7 2024-09-16T16:52:04.370 INFO:tasks.workunit.client.0.smithi089.stdout:foo7 2024-09-16T16:52:04.371 INFO:tasks.workunit.client.0.smithi089.stdout:foo6 2024-09-16T16:52:04.371 INFO:tasks.workunit.client.0.smithi089.stdout:myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-16T16:52:04.506 INFO:tasks.workunit.client.0.smithi089.stdout:ns1:foo4 2024-09-16T16:52:04.506 INFO:tasks.workunit.client.0.smithi089.stdout:ns1:foo5 2024-09-16T16:52:04.507 INFO:tasks.workunit.client.0.smithi089.stdout:ns2:foo7 2024-09-16T16:52:04.507 INFO:tasks.workunit.client.0.smithi089.stdout:ns2:foo6 2024-09-16T16:52:04.507 INFO:tasks.workunit.client.0.smithi089.stdout:ns1:foo1 2024-09-16T16:52:04.507 INFO:tasks.workunit.client.0.smithi089.stdout::foo1 2024-09-16T16:52:04.507 INFO:tasks.workunit.client.0.smithi089.stdout::foo2 2024-09-16T16:52:04.507 INFO:tasks.workunit.client.0.smithi089.stdout::foo3 2024-09-16T16:52:04.765 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosList.ListObjectsNS (981 ms) 2024-09-16T16:52:04.766 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosList.ListObjectsStart 2024-09-16T16:52:05.213 INFO:tasks.workunit.client.0.smithi089.stdout:1 0 2024-09-16T16:52:05.213 INFO:tasks.workunit.client.0.smithi089.stdout:10 0 2024-09-16T16:52:05.213 INFO:tasks.workunit.client.0.smithi089.stdout:13 0 2024-09-16T16:52:05.213 INFO:tasks.workunit.client.0.smithi089.stdout:7 0 2024-09-16T16:52:05.213 INFO:tasks.workunit.client.0.smithi089.stdout:14 0 2024-09-16T16:52:05.213 INFO:tasks.workunit.client.0.smithi089.stdout:0 0 2024-09-16T16:52:05.214 INFO:tasks.workunit.client.0.smithi089.stdout:15 0 2024-09-16T16:52:05.214 INFO:tasks.workunit.client.0.smithi089.stdout:11 0 2024-09-16T16:52:05.214 INFO:tasks.workunit.client.0.smithi089.stdout:5 0 2024-09-16T16:52:05.214 INFO:tasks.workunit.client.0.smithi089.stdout:8 0 2024-09-16T16:52:05.214 INFO:tasks.workunit.client.0.smithi089.stdout:6 0 2024-09-16T16:52:05.214 INFO:tasks.workunit.client.0.smithi089.stdout:3 0 2024-09-16T16:52:05.214 INFO:tasks.workunit.client.0.smithi089.stdout:4 0 2024-09-16T16:52:05.214 INFO:tasks.workunit.client.0.smithi089.stdout:12 0 2024-09-16T16:52:05.214 INFO:tasks.workunit.client.0.smithi089.stdout:9 0 2024-09-16T16:52:05.214 INFO:tasks.workunit.client.0.smithi089.stdout:2 0 2024-09-16T16:52:05.347 INFO:tasks.workunit.client.0.smithi089.stdout:have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-16T16:52:05.721 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosList.ListObjectsStart (955 ms) 2024-09-16T16:52:05.721 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosList.ListObjectsCursor 2024-09-16T16:52:05.998 INFO:tasks.workunit.client.0.smithi089.stdout:x cursor=MIN 2024-09-16T16:52:06.134 INFO:tasks.workunit.client.0.smithi089.stdout:> oid=1 cursor=76:02547ec2:::1:head 2024-09-16T16:52:06.134 INFO:tasks.workunit.client.0.smithi089.stdout:> oid=10 cursor=76:52ea6a34:::10:head 2024-09-16T16:52:06.134 INFO:tasks.workunit.client.0.smithi089.stdout:> oid=13 cursor=76:566253c9:::13:head 2024-09-16T16:52:06.134 INFO:tasks.workunit.client.0.smithi089.stdout:> oid=7 cursor=76:5c6b0b28:::7:head 2024-09-16T16:52:06.134 INFO:tasks.workunit.client.0.smithi089.stdout:> oid=14 cursor=76:62a1935d:::14:head 2024-09-16T16:52:06.134 INFO:tasks.workunit.client.0.smithi089.stdout:> oid=0 cursor=76:6cac518f:::0:head 2024-09-16T16:52:06.134 INFO:tasks.workunit.client.0.smithi089.stdout:> oid=15 cursor=76:863748b0:::15:head 2024-09-16T16:52:06.135 INFO:tasks.workunit.client.0.smithi089.stdout:> oid=11 cursor=76:89d3ae78:::11:head 2024-09-16T16:52:06.135 INFO:tasks.workunit.client.0.smithi089.stdout:> oid=5 cursor=76:b29083e3:::5:head 2024-09-16T16:52:06.135 INFO:tasks.workunit.client.0.smithi089.stdout:> oid=8 cursor=76:bd63b0f1:::8:head 2024-09-16T16:52:06.135 INFO:tasks.workunit.client.0.smithi089.stdout:> oid=6 cursor=76:c4fdafeb:::6:head 2024-09-16T16:52:06.135 INFO:tasks.workunit.client.0.smithi089.stdout:> oid=3 cursor=76:cfc208b3:::3:head 2024-09-16T16:52:06.135 INFO:tasks.workunit.client.0.smithi089.stdout:> oid=4 cursor=76:d83876eb:::4:head 2024-09-16T16:52:06.135 INFO:tasks.workunit.client.0.smithi089.stdout:> oid=12 cursor=76:de5d7c5f:::12:head 2024-09-16T16:52:06.135 INFO:tasks.workunit.client.0.smithi089.stdout:> oid=9 cursor=76:e960b815:::9:head 2024-09-16T16:52:06.135 INFO:tasks.workunit.client.0.smithi089.stdout:> oid=2 cursor=76:f905c69b:::2:head 2024-09-16T16:52:06.274 INFO:tasks.workunit.client.0.smithi089.stdout:FIRST> seek to MIN oid=1 2024-09-16T16:52:06.412 INFO:tasks.workunit.client.0.smithi089.stdout:: oid=1 cursor=76:02547ec2:::1:head 2024-09-16T16:52:06.412 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:02547ec2:::1:head 2024-09-16T16:52:06.547 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:02547ec2:::1:head -> 1 2024-09-16T16:52:06.547 INFO:tasks.workunit.client.0.smithi089.stdout:: oid=10 cursor=76:52ea6a34:::10:head 2024-09-16T16:52:06.547 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:52ea6a34:::10:head 2024-09-16T16:52:06.640 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-16T16:52:06.641 INFO:tasks.workunit.client.0.smithi089.stdout:: oid=13 cursor=76:566253c9:::13:head 2024-09-16T16:52:06.641 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:566253c9:::13:head 2024-09-16T16:52:06.736 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:566253c9:::13:head -> 13 2024-09-16T16:52:06.736 INFO:tasks.workunit.client.0.smithi089.stdout:: oid=7 cursor=76:5c6b0b28:::7:head 2024-09-16T16:52:06.736 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-16T16:52:06.827 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-16T16:52:06.827 INFO:tasks.workunit.client.0.smithi089.stdout:: oid=14 cursor=76:62a1935d:::14:head 2024-09-16T16:52:06.827 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:62a1935d:::14:head 2024-09-16T16:52:06.913 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:62a1935d:::14:head -> 14 2024-09-16T16:52:06.913 INFO:tasks.workunit.client.0.smithi089.stdout:: oid=0 cursor=76:6cac518f:::0:head 2024-09-16T16:52:06.913 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:6cac518f:::0:head 2024-09-16T16:52:06.994 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:6cac518f:::0:head -> 0 2024-09-16T16:52:06.994 INFO:tasks.workunit.client.0.smithi089.stdout:: oid=15 cursor=76:863748b0:::15:head 2024-09-16T16:52:06.994 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:863748b0:::15:head 2024-09-16T16:52:07.062 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:863748b0:::15:head -> 15 2024-09-16T16:52:07.062 INFO:tasks.workunit.client.0.smithi089.stdout:: oid=11 cursor=76:89d3ae78:::11:head 2024-09-16T16:52:07.062 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:89d3ae78:::11:head 2024-09-16T16:52:07.132 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-16T16:52:07.132 INFO:tasks.workunit.client.0.smithi089.stdout:: oid=5 cursor=76:b29083e3:::5:head 2024-09-16T16:52:07.132 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:b29083e3:::5:head 2024-09-16T16:52:07.176 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:b29083e3:::5:head -> 5 2024-09-16T16:52:07.176 INFO:tasks.workunit.client.0.smithi089.stdout:: oid=8 cursor=76:bd63b0f1:::8:head 2024-09-16T16:52:07.176 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-16T16:52:07.214 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-16T16:52:07.214 INFO:tasks.workunit.client.0.smithi089.stdout:: oid=6 cursor=76:c4fdafeb:::6:head 2024-09-16T16:52:07.214 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-16T16:52:07.248 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-16T16:52:07.248 INFO:tasks.workunit.client.0.smithi089.stdout:: oid=3 cursor=76:cfc208b3:::3:head 2024-09-16T16:52:07.248 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:cfc208b3:::3:head 2024-09-16T16:52:07.278 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-16T16:52:07.278 INFO:tasks.workunit.client.0.smithi089.stdout:: oid=4 cursor=76:d83876eb:::4:head 2024-09-16T16:52:07.278 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:d83876eb:::4:head 2024-09-16T16:52:07.300 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:d83876eb:::4:head -> 4 2024-09-16T16:52:07.300 INFO:tasks.workunit.client.0.smithi089.stdout:: oid=12 cursor=76:de5d7c5f:::12:head 2024-09-16T16:52:07.300 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-16T16:52:07.321 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-16T16:52:07.321 INFO:tasks.workunit.client.0.smithi089.stdout:: oid=9 cursor=76:e960b815:::9:head 2024-09-16T16:52:07.321 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:e960b815:::9:head 2024-09-16T16:52:07.335 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:e960b815:::9:head -> 9 2024-09-16T16:52:07.335 INFO:tasks.workunit.client.0.smithi089.stdout:: oid=2 cursor=76:f905c69b:::2:head 2024-09-16T16:52:07.335 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:f905c69b:::2:head 2024-09-16T16:52:07.339 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:f905c69b:::2:head -> 2 2024-09-16T16:52:07.339 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-16T16:52:07.339 INFO:tasks.workunit.client.0.smithi089.stdout:: cursor()=76:c4fdafeb:::6:head expected=76:c4fdafeb:::6:head 2024-09-16T16:52:07.373 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-16T16:52:07.373 INFO:tasks.workunit.client.0.smithi089.stdout:: entry=6 expected=6 2024-09-16T16:52:07.373 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:52ea6a34:::10:head 2024-09-16T16:52:07.373 INFO:tasks.workunit.client.0.smithi089.stdout:: cursor()=76:52ea6a34:::10:head expected=76:52ea6a34:::10:head 2024-09-16T16:52:07.478 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-16T16:52:07.478 INFO:tasks.workunit.client.0.smithi089.stdout:: entry=10 expected=10 2024-09-16T16:52:07.478 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-16T16:52:07.478 INFO:tasks.workunit.client.0.smithi089.stdout:: cursor()=76:bd63b0f1:::8:head expected=76:bd63b0f1:::8:head 2024-09-16T16:52:07.516 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-16T16:52:07.516 INFO:tasks.workunit.client.0.smithi089.stdout:: entry=8 expected=8 2024-09-16T16:52:07.516 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:b29083e3:::5:head 2024-09-16T16:52:07.517 INFO:tasks.workunit.client.0.smithi089.stdout:: cursor()=76:b29083e3:::5:head expected=76:b29083e3:::5:head 2024-09-16T16:52:07.559 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:b29083e3:::5:head -> 5 2024-09-16T16:52:07.559 INFO:tasks.workunit.client.0.smithi089.stdout:: entry=5 expected=5 2024-09-16T16:52:07.559 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:89d3ae78:::11:head 2024-09-16T16:52:07.559 INFO:tasks.workunit.client.0.smithi089.stdout:: cursor()=76:89d3ae78:::11:head expected=76:89d3ae78:::11:head 2024-09-16T16:52:07.622 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-16T16:52:07.622 INFO:tasks.workunit.client.0.smithi089.stdout:: entry=11 expected=11 2024-09-16T16:52:07.622 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:863748b0:::15:head 2024-09-16T16:52:07.622 INFO:tasks.workunit.client.0.smithi089.stdout:: cursor()=76:863748b0:::15:head expected=76:863748b0:::15:head 2024-09-16T16:52:07.690 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:863748b0:::15:head -> 15 2024-09-16T16:52:07.690 INFO:tasks.workunit.client.0.smithi089.stdout:: entry=15 expected=15 2024-09-16T16:52:07.690 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:6cac518f:::0:head 2024-09-16T16:52:07.690 INFO:tasks.workunit.client.0.smithi089.stdout:: cursor()=76:6cac518f:::0:head expected=76:6cac518f:::0:head 2024-09-16T16:52:07.771 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:6cac518f:::0:head -> 0 2024-09-16T16:52:07.771 INFO:tasks.workunit.client.0.smithi089.stdout:: entry=0 expected=0 2024-09-16T16:52:07.771 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:566253c9:::13:head 2024-09-16T16:52:07.771 INFO:tasks.workunit.client.0.smithi089.stdout:: cursor()=76:566253c9:::13:head expected=76:566253c9:::13:head 2024-09-16T16:52:07.865 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:566253c9:::13:head -> 13 2024-09-16T16:52:07.865 INFO:tasks.workunit.client.0.smithi089.stdout:: entry=13 expected=13 2024-09-16T16:52:07.865 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:62a1935d:::14:head 2024-09-16T16:52:07.866 INFO:tasks.workunit.client.0.smithi089.stdout:: cursor()=76:62a1935d:::14:head expected=76:62a1935d:::14:head 2024-09-16T16:52:07.951 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:62a1935d:::14:head -> 14 2024-09-16T16:52:07.951 INFO:tasks.workunit.client.0.smithi089.stdout:: entry=14 expected=14 2024-09-16T16:52:07.951 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-16T16:52:07.951 INFO:tasks.workunit.client.0.smithi089.stdout:: cursor()=76:5c6b0b28:::7:head expected=76:5c6b0b28:::7:head 2024-09-16T16:52:08.041 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-16T16:52:08.041 INFO:tasks.workunit.client.0.smithi089.stdout:: entry=7 expected=7 2024-09-16T16:52:08.041 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:f905c69b:::2:head 2024-09-16T16:52:08.041 INFO:tasks.workunit.client.0.smithi089.stdout:: cursor()=76:f905c69b:::2:head expected=76:f905c69b:::2:head 2024-09-16T16:52:08.045 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:f905c69b:::2:head -> 2 2024-09-16T16:52:08.045 INFO:tasks.workunit.client.0.smithi089.stdout:: entry=2 expected=2 2024-09-16T16:52:08.045 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:e960b815:::9:head 2024-09-16T16:52:08.045 INFO:tasks.workunit.client.0.smithi089.stdout:: cursor()=76:e960b815:::9:head expected=76:e960b815:::9:head 2024-09-16T16:52:08.059 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:e960b815:::9:head -> 9 2024-09-16T16:52:08.059 INFO:tasks.workunit.client.0.smithi089.stdout:: entry=9 expected=9 2024-09-16T16:52:08.059 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-16T16:52:08.059 INFO:tasks.workunit.client.0.smithi089.stdout:: cursor()=76:de5d7c5f:::12:head expected=76:de5d7c5f:::12:head 2024-09-16T16:52:08.081 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-16T16:52:08.081 INFO:tasks.workunit.client.0.smithi089.stdout:: entry=12 expected=12 2024-09-16T16:52:08.082 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:d83876eb:::4:head 2024-09-16T16:52:08.082 INFO:tasks.workunit.client.0.smithi089.stdout:: cursor()=76:d83876eb:::4:head expected=76:d83876eb:::4:head 2024-09-16T16:52:08.103 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:d83876eb:::4:head -> 4 2024-09-16T16:52:08.103 INFO:tasks.workunit.client.0.smithi089.stdout:: entry=4 expected=4 2024-09-16T16:52:08.103 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:cfc208b3:::3:head 2024-09-16T16:52:08.103 INFO:tasks.workunit.client.0.smithi089.stdout:: cursor()=76:cfc208b3:::3:head expected=76:cfc208b3:::3:head 2024-09-16T16:52:08.133 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-16T16:52:08.133 INFO:tasks.workunit.client.0.smithi089.stdout:: entry=3 expected=3 2024-09-16T16:52:08.133 INFO:tasks.workunit.client.0.smithi089.stdout:: seek to 76:02547ec2:::1:head 2024-09-16T16:52:08.133 INFO:tasks.workunit.client.0.smithi089.stdout:: cursor()=76:02547ec2:::1:head expected=76:02547ec2:::1:head 2024-09-16T16:52:08.267 INFO:tasks.workunit.client.0.smithi089.stdout:> 76:02547ec2:::1:head -> 1 2024-09-16T16:52:08.268 INFO:tasks.workunit.client.0.smithi089.stdout:: entry=1 expected=1 2024-09-16T16:52:08.653 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosList.ListObjectsCursor (2933 ms) 2024-09-16T16:52:08.654 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosList.EnumerateObjects 2024-09-16T16:52:09.503 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosList.EnumerateObjects (849 ms) 2024-09-16T16:52:09.503 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosList.EnumerateObjectsSplit 2024-09-16T16:52:09.771 INFO:tasks.workunit.client.0.smithi089.stdout:split 0/5 -> MIN 76:33333333::::head 2024-09-16T16:52:09.801 INFO:tasks.workunit.client.0.smithi089.stdout:split 1/5 -> 76:33333333::::head 76:66666666::::head 2024-09-16T16:52:09.831 INFO:tasks.workunit.client.0.smithi089.stdout:split 2/5 -> 76:66666666::::head 76:99999999::::head 2024-09-16T16:52:09.865 INFO:tasks.workunit.client.0.smithi089.stdout:split 3/5 -> 76:99999999::::head 76:cccccccc::::head 2024-09-16T16:52:09.895 INFO:tasks.workunit.client.0.smithi089.stdout:split 4/5 -> 76:cccccccc::::head MAX 2024-09-16T16:52:10.302 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosList.EnumerateObjectsSplit (799 ms) 2024-09-16T16:52:11.268 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 7 tests from LibRadosList (7501 ms total) 2024-09-16T16:52:11.268 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:52:11.268 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 3 tests from LibRadosListEC 2024-09-16T16:52:11.268 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:70: Skipped 2024-09-16T16:52:11.269 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:11.269 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosListEC.ListObjects 2024-09-16T16:52:11.269 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:84: Skipped 2024-09-16T16:52:11.269 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:11.269 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:96: Skipped 2024-09-16T16:52:11.269 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:11.269 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosListEC.ListObjects (0 ms) 2024-09-16T16:52:11.269 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosListEC.ListObjectsNS 2024-09-16T16:52:11.269 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:84: Skipped 2024-09-16T16:52:11.269 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:11.269 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:96: Skipped 2024-09-16T16:52:11.269 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:11.269 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS (0 ms) 2024-09-16T16:52:11.269 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosListEC.ListObjectsStart 2024-09-16T16:52:11.270 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:84: Skipped 2024-09-16T16:52:11.270 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:11.270 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:96: Skipped 2024-09-16T16:52:11.270 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:11.270 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart (0 ms) 2024-09-16T16:52:11.270 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:78: Skipped 2024-09-16T16:52:11.270 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:11.270 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 3 tests from LibRadosListEC (0 ms total) 2024-09-16T16:52:11.270 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:52:11.270 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibRadosListNP 2024-09-16T16:52:11.270 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosListNP.ListObjectsError 2024-09-16T16:52:13.813 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosListNP.ListObjectsError (2545 ms) 2024-09-16T16:52:13.813 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibRadosListNP (2545 ms total) 2024-09-16T16:52:13.813 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:52:13.813 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:52:13.813 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 11 tests from 3 test suites ran. (12437 ms total) 2024-09-16T16:52:13.814 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 8 tests. 2024-09-16T16:52:13.814 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] 3 tests, listed below: 2024-09-16T16:52:13.814 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosListEC.ListObjects 2024-09-16T16:52:13.814 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS 2024-09-16T16:52:13.814 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart 2024-09-16T16:52:13.815 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:52:13.816 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:52:13.816 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_lock 2024-09-16T16:52:13.836 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:52:13.836 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-16T16:52:13.836 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:52:13.836 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 8 tests from LibRadosLock 2024-09-16T16:52:15.824 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLock.LockExclusive 2024-09-16T16:52:16.170 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosLock.LockExclusive (346 ms) 2024-09-16T16:52:16.171 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLock.LockShared 2024-09-16T16:52:16.201 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosLock.LockShared (30 ms) 2024-09-16T16:52:16.201 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLock.LockExclusiveDur 2024-09-16T16:52:17.249 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosLock.LockExclusiveDur (1048 ms) 2024-09-16T16:52:17.249 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLock.LockSharedDur 2024-09-16T16:52:18.309 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosLock.LockSharedDur (1060 ms) 2024-09-16T16:52:18.309 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLock.LockMayRenew 2024-09-16T16:52:18.362 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosLock.LockMayRenew (53 ms) 2024-09-16T16:52:18.362 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLock.Unlock 2024-09-16T16:52:18.415 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosLock.Unlock (53 ms) 2024-09-16T16:52:18.415 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLock.ListLockers 2024-09-16T16:52:18.492 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosLock.ListLockers (77 ms) 2024-09-16T16:52:18.492 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLock.BreakLock 2024-09-16T16:52:18.535 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosLock.BreakLock (44 ms) 2024-09-16T16:52:18.834 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 8 tests from LibRadosLock (2711 ms total) 2024-09-16T16:52:18.834 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:52:18.834 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 8 tests from LibRadosLockEC 2024-09-16T16:52:18.834 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T16:52:18.834 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.834 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockEC.LockExclusive 2024-09-16T16:52:18.834 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:52:18.834 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.834 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:52:18.835 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.835 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive (0 ms) 2024-09-16T16:52:18.835 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockEC.LockShared 2024-09-16T16:52:18.835 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:52:18.835 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.835 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:52:18.835 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.835 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2024-09-16T16:52:18.835 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockEC.LockExclusiveDur 2024-09-16T16:52:18.835 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:52:18.835 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.835 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:52:18.835 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.835 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2024-09-16T16:52:18.836 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockEC.LockSharedDur 2024-09-16T16:52:18.836 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:52:18.836 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.836 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:52:18.836 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.836 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2024-09-16T16:52:18.836 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockEC.LockMayRenew 2024-09-16T16:52:18.836 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:52:18.836 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.836 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:52:18.836 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.836 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2024-09-16T16:52:18.836 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockEC.Unlock 2024-09-16T16:52:18.837 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:52:18.837 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.837 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:52:18.837 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.837 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2024-09-16T16:52:18.837 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockEC.ListLockers 2024-09-16T16:52:18.837 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:52:18.837 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.837 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:52:18.837 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.837 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2024-09-16T16:52:18.837 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockEC.BreakLock 2024-09-16T16:52:18.837 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:52:18.837 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.838 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:52:18.838 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.838 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2024-09-16T16:52:18.838 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T16:52:18.838 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:18.838 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 8 tests from LibRadosLockEC (0 ms total) 2024-09-16T16:52:18.838 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:52:18.838 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:52:18.838 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 16 tests from 2 test suites ran. (4997 ms total) 2024-09-16T16:52:18.838 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 8 tests. 2024-09-16T16:52:18.838 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-16T16:52:18.838 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive 2024-09-16T16:52:18.838 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockEC.LockShared 2024-09-16T16:52:18.838 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2024-09-16T16:52:18.839 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur 2024-09-16T16:52:18.839 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew 2024-09-16T16:52:18.839 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockEC.Unlock 2024-09-16T16:52:18.839 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers 2024-09-16T16:52:18.839 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock 2024-09-16T16:52:18.839 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:52:18.839 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:52:18.839 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_lock_pp 2024-09-16T16:52:18.863 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:52:18.863 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-16T16:52:18.863 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:52:18.863 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 8 tests from LibRadosLockPP 2024-09-16T16:52:18.863 INFO:tasks.workunit.client.0.smithi089.stdout:seed 30739 2024-09-16T16:52:20.837 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockPP.LockExclusivePP 2024-09-16T16:52:21.162 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosLockPP.LockExclusivePP (324 ms) 2024-09-16T16:52:21.162 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockPP.LockSharedPP 2024-09-16T16:52:21.197 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosLockPP.LockSharedPP (36 ms) 2024-09-16T16:52:21.197 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-09-16T16:52:22.252 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosLockPP.LockExclusiveDurPP (1054 ms) 2024-09-16T16:52:22.252 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockPP.LockSharedDurPP 2024-09-16T16:52:23.317 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosLockPP.LockSharedDurPP (1065 ms) 2024-09-16T16:52:23.317 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockPP.LockMayRenewPP 2024-09-16T16:52:23.371 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosLockPP.LockMayRenewPP (54 ms) 2024-09-16T16:52:23.371 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockPP.UnlockPP 2024-09-16T16:52:23.439 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosLockPP.UnlockPP (68 ms) 2024-09-16T16:52:23.439 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockPP.ListLockersPP 2024-09-16T16:52:23.509 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosLockPP.ListLockersPP (70 ms) 2024-09-16T16:52:23.509 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockPP.BreakLockPP 2024-09-16T16:52:23.551 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosLockPP.BreakLockPP (42 ms) 2024-09-16T16:52:23.858 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 8 tests from LibRadosLockPP (2713 ms total) 2024-09-16T16:52:23.858 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:52:23.859 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 8 tests from LibRadosLockECPP 2024-09-16T16:52:23.859 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T16:52:23.859 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.859 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockECPP.LockExclusivePP 2024-09-16T16:52:23.859 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:23.859 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.859 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:23.859 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.859 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2024-09-16T16:52:23.859 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockECPP.LockSharedPP 2024-09-16T16:52:23.859 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:23.859 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.860 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:23.860 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.860 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2024-09-16T16:52:23.860 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-16T16:52:23.860 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:23.860 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.860 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:23.860 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.860 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2024-09-16T16:52:23.860 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-09-16T16:52:23.860 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:23.860 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.860 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:23.861 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.861 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2024-09-16T16:52:23.861 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-09-16T16:52:23.861 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:23.861 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.861 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:23.861 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.861 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2024-09-16T16:52:23.861 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockECPP.UnlockPP 2024-09-16T16:52:23.861 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:23.861 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.861 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:23.861 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.862 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2024-09-16T16:52:23.862 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockECPP.ListLockersPP 2024-09-16T16:52:23.862 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:23.862 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.862 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:23.862 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.862 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2024-09-16T16:52:23.862 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosLockECPP.BreakLockPP 2024-09-16T16:52:23.862 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:52:23.862 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.862 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:52:23.862 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.862 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2024-09-16T16:52:23.862 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T16:52:23.863 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:52:23.863 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 8 tests from LibRadosLockECPP (0 ms total) 2024-09-16T16:52:23.863 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:52:23.863 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:52:23.863 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 16 tests from 2 test suites ran. (4998 ms total) 2024-09-16T16:52:23.863 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 8 tests. 2024-09-16T16:52:23.863 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-16T16:52:23.863 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2024-09-16T16:52:23.863 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP 2024-09-16T16:52:23.863 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-16T16:52:23.863 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2024-09-16T16:52:23.863 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2024-09-16T16:52:23.863 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP 2024-09-16T16:52:23.863 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP 2024-09-16T16:52:23.863 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP 2024-09-16T16:52:23.864 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:52:23.864 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:52:23.864 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_misc 2024-09-16T16:52:23.900 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:23.898+0000 7f565602b6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:23.900 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:23.898+0000 7f565602b6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:23.900 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:23.899+0000 7f565602b6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:23.901 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 12 tests from 4 test suites. 2024-09-16T16:52:23.901 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:52:23.901 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-16T16:52:23.901 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscVersion.Version 2024-09-16T16:52:23.901 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscVersion.Version (0 ms) 2024-09-16T16:52:23.901 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-16T16:52:23.901 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:52:23.901 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 2 tests from LibRadosMiscConnectFailure 2024-09-16T16:52:23.902 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-09-16T16:52:23.963 INFO:tasks.workunit.client.0.smithi089.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2024-09-16T16:52:23.964 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:23.962+0000 7f565602b6c0 -1 failed for service _ceph-mon._tcp 2024-09-16T16:52:23.964 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:52:23.962+0000 7f565602b6c0 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-09-16T16:52:23.964 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectFailure (63 ms) 2024-09-16T16:52:23.964 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-09-16T16:52:28.977 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5013 ms) 2024-09-16T16:52:28.977 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 2 tests from LibRadosMiscConnectFailure (5076 ms total) 2024-09-16T16:52:28.977 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:52:28.977 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibRadosMiscPool 2024-09-16T16:52:28.977 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPool.PoolCreationRace 2024-09-16T16:52:31.087 INFO:tasks.workunit.client.0.smithi089.stdout:started 0x7f5618005d20 2024-09-16T16:52:32.087 INFO:tasks.workunit.client.0.smithi089.stdout:started 0x7f5638005d20 2024-09-16T16:52:32.087 INFO:tasks.workunit.client.0.smithi089.stdout: started 2 aios 2024-09-16T16:52:32.087 INFO:tasks.workunit.client.0.smithi089.stdout:waiting 0x7f5618005d20 2024-09-16T16:52:32.087 INFO:tasks.workunit.client.0.smithi089.stdout:waiting 0x7f5638005d20 2024-09-16T16:52:32.091 INFO:tasks.workunit.client.0.smithi089.stdout:done. 2024-09-16T16:52:34.098 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPool.PoolCreationRace (5121 ms) 2024-09-16T16:52:34.098 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibRadosMiscPool (5121 ms total) 2024-09-16T16:52:34.098 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:52:34.098 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 8 tests from LibRadosMisc 2024-09-16T16:52:36.109 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMisc.ClusterFSID 2024-09-16T16:52:36.110 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-09-16T16:52:36.110 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMisc.Exec 2024-09-16T16:52:36.426 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMisc.Exec (317 ms) 2024-09-16T16:52:36.427 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMisc.WriteSame 2024-09-16T16:52:36.486 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMisc.WriteSame (59 ms) 2024-09-16T16:52:36.486 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMisc.CmpExt 2024-09-16T16:52:36.523 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMisc.CmpExt (37 ms) 2024-09-16T16:52:36.523 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMisc.Applications 2024-09-16T16:52:41.129 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMisc.Applications (4606 ms) 2024-09-16T16:52:41.129 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMisc.MinCompatOSD 2024-09-16T16:52:41.129 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-09-16T16:52:41.129 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMisc.MinCompatClient 2024-09-16T16:52:41.129 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-09-16T16:52:41.129 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMisc.ShutdownRace 2024-09-16T16:53:07.252 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMisc.ShutdownRace (26123 ms) 2024-09-16T16:53:07.818 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 8 tests from LibRadosMisc (31143 ms total) 2024-09-16T16:53:07.818 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:53:07.818 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:53:07.818 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 12 tests from 4 test suites ran. (43917 ms total) 2024-09-16T16:53:07.818 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 12 tests. 2024-09-16T16:53:07.832 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:53:07.832 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:53:07.833 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_misc_pp 2024-09-16T16:53:07.883 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:53:07.881+0000 7f17ab46b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:07.883 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:53:07.881+0000 7f17ab46b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:07.883 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:53:07.882+0000 7f17ab46b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:07.884 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 31 tests from 7 test suites. 2024-09-16T16:53:07.884 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:53:07.884 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-16T16:53:07.884 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscVersion.VersionPP 2024-09-16T16:53:07.884 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-09-16T16:53:07.884 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-16T16:53:07.884 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:53:07.884 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 22 tests from LibRadosMiscPP 2024-09-16T16:53:07.884 INFO:tasks.workunit.client.0.smithi089.stdout:seed 92405 2024-09-16T16:53:09.826 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-09-16T16:53:09.826 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2024-09-16T16:53:09.826 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.LongNamePP 2024-09-16T16:53:10.281 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.LongNamePP (455 ms) 2024-09-16T16:53:10.281 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.LongLocatorPP 2024-09-16T16:53:10.281 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:53: Skipped 2024-09-16T16:53:10.281 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:10.282 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP (0 ms) 2024-09-16T16:53:10.282 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.LongNSpacePP 2024-09-16T16:53:10.360 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.LongNSpacePP (79 ms) 2024-09-16T16:53:10.360 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-09-16T16:53:10.424 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.LongAttrNamePP (64 ms) 2024-09-16T16:53:10.424 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.ExecPP 2024-09-16T16:53:10.445 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.ExecPP (21 ms) 2024-09-16T16:53:10.445 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.BadFlagsPP 2024-09-16T16:53:10.467 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.BadFlagsPP (23 ms) 2024-09-16T16:53:10.467 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.Operate1PP 2024-09-16T16:53:10.505 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.Operate1PP (37 ms) 2024-09-16T16:53:10.505 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.Operate2PP 2024-09-16T16:53:10.529 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.Operate2PP (24 ms) 2024-09-16T16:53:10.529 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.BigObjectPP 2024-09-16T16:53:10.592 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.BigObjectPP (62 ms) 2024-09-16T16:53:10.592 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.AioOperatePP 2024-09-16T16:53:10.618 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.AioOperatePP (26 ms) 2024-09-16T16:53:10.618 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.AssertExistsPP 2024-09-16T16:53:10.652 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.AssertExistsPP (34 ms) 2024-09-16T16:53:10.652 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.AssertVersionPP 2024-09-16T16:53:10.719 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.AssertVersionPP (68 ms) 2024-09-16T16:53:10.720 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.BigAttrPP 2024-09-16T16:53:10.735 INFO:tasks.workunit.client.0.smithi089.stdout:osd_max_attr_size = 0 2024-09-16T16:53:10.735 INFO:tasks.workunit.client.0.smithi089.stdout:osd_max_attr_size == 0; skipping test 2024-09-16T16:53:34.613 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.BigAttrPP (23893 ms) 2024-09-16T16:53:34.614 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.CopyPP 2024-09-16T16:53:34.614 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:387: Skipped 2024-09-16T16:53:34.614 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:34.614 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP (0 ms) 2024-09-16T16:53:34.614 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.CopyScrubPP 2024-09-16T16:53:34.614 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:550: Skipped 2024-09-16T16:53:34.614 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:34.614 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2024-09-16T16:53:34.614 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.WriteSamePP 2024-09-16T16:53:34.667 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.WriteSamePP (54 ms) 2024-09-16T16:53:34.667 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.CmpExtPP 2024-09-16T16:53:34.698 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.CmpExtPP (31 ms) 2024-09-16T16:53:34.698 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.Applications 2024-09-16T16:53:39.308 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.Applications (4610 ms) 2024-09-16T16:53:39.309 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.MinCompatOSD 2024-09-16T16:53:39.309 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-09-16T16:53:39.309 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.MinCompatClient 2024-09-16T16:53:39.309 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-09-16T16:53:39.309 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscPP.Conf 2024-09-16T16:53:39.309 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosMiscPP.Conf (0 ms) 2024-09-16T16:53:40.311 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 22 tests from LibRadosMiscPP (29482 ms total) 2024-09-16T16:53:40.311 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:53:40.311 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibRadosTwoPoolsECPP 2024-09-16T16:53:40.311 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:477: Skipped 2024-09-16T16:53:40.311 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:40.312 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-16T16:53:40.312 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:499: Skipped 2024-09-16T16:53:40.312 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:40.312 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:505: Skipped 2024-09-16T16:53:40.312 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:40.312 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (0 ms) 2024-09-16T16:53:40.312 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:492: Skipped 2024-09-16T16:53:40.312 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:40.312 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibRadosTwoPoolsECPP (0 ms total) 2024-09-16T16:53:40.312 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:53:40.312 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-09-16T16:53:41.815 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosChecksum/0.Subset 2024-09-16T16:53:42.134 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosChecksum/0.Subset (320 ms) 2024-09-16T16:53:42.135 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosChecksum/0.Chunked 2024-09-16T16:53:42.187 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosChecksum/0.Chunked (53 ms) 2024-09-16T16:53:42.817 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 2 tests from LibRadosChecksum/0 (373 ms total) 2024-09-16T16:53:42.817 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:53:42.817 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-09-16T16:53:44.824 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosChecksum/1.Subset 2024-09-16T16:53:45.115 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosChecksum/1.Subset (291 ms) 2024-09-16T16:53:45.115 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosChecksum/1.Chunked 2024-09-16T16:53:45.158 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosChecksum/1.Chunked (43 ms) 2024-09-16T16:53:45.836 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 2 tests from LibRadosChecksum/1 (334 ms total) 2024-09-16T16:53:45.836 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:53:45.836 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-09-16T16:53:47.843 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosChecksum/2.Subset 2024-09-16T16:53:48.090 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosChecksum/2.Subset (247 ms) 2024-09-16T16:53:48.090 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosChecksum/2.Chunked 2024-09-16T16:53:48.136 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosChecksum/2.Chunked (46 ms) 2024-09-16T16:53:48.844 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 2 tests from LibRadosChecksum/2 (293 ms total) 2024-09-16T16:53:48.845 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:53:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibRadosMiscECPP 2024-09-16T16:53:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T16:53:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-09-16T16:53:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:53:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:53:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (0 ms) 2024-09-16T16:53:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T16:53:48.845 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibRadosMiscECPP (0 ms total) 2024-09-16T16:53:48.846 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:53:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:53:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 31 tests from 7 test suites ran. (40960 ms total) 2024-09-16T16:53:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 26 tests. 2024-09-16T16:53:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] 5 tests, listed below: 2024-09-16T16:53:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP 2024-09-16T16:53:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP 2024-09-16T16:53:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2024-09-16T16:53:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-16T16:53:48.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2024-09-16T16:53:48.847 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:53:48.847 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:53:48.847 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_tier_pp 2024-09-16T16:53:48.885 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:53:48.883+0000 7fd5302869c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:48.886 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:53:48.883+0000 7fd5302869c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:48.886 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:53:48.883+0000 7fd5302869c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:48.886 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 77 tests from 4 test suites. 2024-09-16T16:53:48.886 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:53:48.886 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 3 tests from LibRadosTierPP 2024-09-16T16:53:48.886 INFO:tasks.workunit.client.0.smithi089.stdout:seed 92477 2024-09-16T16:53:50.856 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTierPP.Dirty 2024-09-16T16:53:50.857 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:287: Skipped 2024-09-16T16:53:50.857 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:50.857 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2024-09-16T16:53:50.857 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTierPP.FlushWriteRaces 2024-09-16T16:53:50.857 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:2182: Skipped 2024-09-16T16:53:50.857 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:50.857 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2024-09-16T16:53:50.857 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTierPP.HitSetNone 2024-09-16T16:53:50.857 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:2561: Skipped 2024-09-16T16:53:50.857 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:50.857 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2024-09-16T16:53:51.821 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 3 tests from LibRadosTierPP (0 ms total) 2024-09-16T16:53:51.821 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:53:51.821 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 48 tests from LibRadosTwoPoolsPP 2024-09-16T16:53:53.884 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.Overlay 2024-09-16T16:53:53.884 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.884 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.884 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.884 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.884 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2024-09-16T16:53:53.884 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.Promote 2024-09-16T16:53:53.884 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.885 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.885 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.885 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.885 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2024-09-16T16:53:53.885 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-16T16:53:53.885 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.885 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.885 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.885 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.885 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2024-09-16T16:53:53.885 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-16T16:53:53.885 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.885 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.885 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.885 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2024-09-16T16:53:53.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-16T16:53:53.886 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.886 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.886 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.886 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2024-09-16T16:53:53.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-09-16T16:53:53.886 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.886 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.886 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.886 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2024-09-16T16:53:53.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-16T16:53:53.886 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2024-09-16T16:53:53.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.Evict 2024-09-16T16:53:53.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2024-09-16T16:53:53.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-09-16T16:53:53.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2024-09-16T16:53:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-16T16:53:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2024-09-16T16:53:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-09-16T16:53:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2024-09-16T16:53:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-16T16:53:53.889 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.889 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.889 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.889 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2024-09-16T16:53:53.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-09-16T16:53:53.889 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.889 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.889 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.889 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2024-09-16T16:53:53.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.Flush 2024-09-16T16:53:53.889 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.889 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.890 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.890 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.890 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2024-09-16T16:53:53.890 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-09-16T16:53:53.890 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.890 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.890 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.890 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.890 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2024-09-16T16:53:53.890 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-16T16:53:53.890 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.890 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.890 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.890 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2024-09-16T16:53:53.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-16T16:53:53.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.891 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.891 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2024-09-16T16:53:53.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-09-16T16:53:53.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.891 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.891 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2024-09-16T16:53:53.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-16T16:53:53.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.891 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2024-09-16T16:53:53.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-16T16:53:53.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2024-09-16T16:53:53.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-16T16:53:53.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2024-09-16T16:53:53.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-09-16T16:53:53.893 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.893 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.893 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.893 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2024-09-16T16:53:53.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.CachePin 2024-09-16T16:53:53.893 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.893 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.893 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.893 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2024-09-16T16:53:53.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-16T16:53:53.893 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.894 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.894 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.894 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2024-09-16T16:53:53.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-16T16:53:53.894 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.894 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.894 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.894 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2024-09-16T16:53:53.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-16T16:53:53.894 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.894 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.894 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.894 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2024-09-16T16:53:53.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-16T16:53:53.895 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.895 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.895 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.895 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2024-09-16T16:53:53.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-16T16:53:53.895 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.895 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.895 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.895 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2024-09-16T16:53:53.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-16T16:53:53.895 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.895 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.896 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.896 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (1 ms) 2024-09-16T16:53:53.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-16T16:53:53.896 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.896 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.896 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.896 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2024-09-16T16:53:53.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-16T16:53:53.896 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.896 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.896 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.896 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2024-09-16T16:53:53.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-16T16:53:53.897 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.897 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.897 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.897 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2024-09-16T16:53:53.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-16T16:53:53.897 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.897 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.897 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.897 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2024-09-16T16:53:53.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-16T16:53:53.897 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.897 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.897 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.898 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2024-09-16T16:53:53.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-16T16:53:53.898 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.898 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.898 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.898 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2024-09-16T16:53:53.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-16T16:53:53.898 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.898 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.898 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.898 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2024-09-16T16:53:53.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-16T16:53:53.899 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.899 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.899 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.899 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.899 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2024-09-16T16:53:53.899 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-16T16:53:53.899 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.899 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.899 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.899 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.899 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2024-09-16T16:53:53.899 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-16T16:53:53.899 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.899 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.899 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.900 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.900 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2024-09-16T16:53:53.900 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-16T16:53:53.900 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.900 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.900 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.900 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.900 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2024-09-16T16:53:53.900 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-16T16:53:53.900 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.900 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.900 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.900 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.900 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2024-09-16T16:53:53.900 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-16T16:53:53.901 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.901 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.901 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.901 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.901 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2024-09-16T16:53:53.901 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-16T16:53:53.901 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.901 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.901 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.901 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.901 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2024-09-16T16:53:53.901 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-16T16:53:53.901 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.901 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.902 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.902 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.902 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2024-09-16T16:53:53.902 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-16T16:53:53.902 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.902 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.902 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.902 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.902 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2024-09-16T16:53:53.902 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-16T16:53:53.902 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.902 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.902 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.903 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.903 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2024-09-16T16:53:53.903 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-16T16:53:53.903 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.903 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.903 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.903 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.903 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2024-09-16T16:53:53.903 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-16T16:53:53.903 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T16:53:53.903 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.903 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T16:53:53.903 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:53.904 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2024-09-16T16:53:54.881 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 48 tests from LibRadosTwoPoolsPP (1 ms total) 2024-09-16T16:53:54.882 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:53:54.882 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosTierECPP 2024-09-16T16:53:54.882 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T16:53:54.882 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.882 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTierECPP.Dirty 2024-09-16T16:53:54.882 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:53:54.882 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.882 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:53:54.882 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.882 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2024-09-16T16:53:54.882 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-09-16T16:53:54.882 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:53:54.882 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.883 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:53:54.883 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.883 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2024-09-16T16:53:54.883 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTierECPP.CallForcesPromote 2024-09-16T16:53:54.883 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:53:54.883 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.883 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:53:54.883 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.883 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2024-09-16T16:53:54.883 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTierECPP.HitSetNone 2024-09-16T16:53:54.883 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:53:54.883 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.883 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:53:54.883 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.883 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2024-09-16T16:53:54.884 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T16:53:54.884 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.884 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosTierECPP (0 ms total) 2024-09-16T16:53:54.884 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:53:54.884 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP 2024-09-16T16:53:54.884 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6267: Skipped 2024-09-16T16:53:54.884 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.884 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-09-16T16:53:54.884 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.884 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.884 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.884 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.884 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2024-09-16T16:53:54.884 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.Promote 2024-09-16T16:53:54.885 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.885 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.885 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.885 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.885 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2024-09-16T16:53:54.885 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-16T16:53:54.885 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.885 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.885 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.885 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.885 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2024-09-16T16:53:54.885 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-16T16:53:54.885 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.885 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.885 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.886 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2024-09-16T16:53:54.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-09-16T16:53:54.886 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.886 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.886 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.886 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2024-09-16T16:53:54.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.Evict 2024-09-16T16:53:54.886 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.886 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.886 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.886 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2024-09-16T16:53:54.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-16T16:53:54.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2024-09-16T16:53:54.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-09-16T16:53:54.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2024-09-16T16:53:54.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-16T16:53:54.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.888 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2024-09-16T16:53:54.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.Flush 2024-09-16T16:53:54.888 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.888 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.888 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.888 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2024-09-16T16:53:54.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-16T16:53:54.888 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.888 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.888 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.888 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2024-09-16T16:53:54.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-16T16:53:54.889 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.889 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.889 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.889 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2024-09-16T16:53:54.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-16T16:53:54.889 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.889 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.889 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.889 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2024-09-16T16:53:54.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-16T16:53:54.889 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.890 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.890 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.890 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.890 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2024-09-16T16:53:54.890 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-16T16:53:54.890 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.890 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.890 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.890 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.890 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2024-09-16T16:53:54.890 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-16T16:53:54.890 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.890 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.890 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.890 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2024-09-16T16:53:54.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-16T16:53:54.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.891 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.891 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2024-09-16T16:53:54.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-09-16T16:53:54.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.891 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.891 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2024-09-16T16:53:54.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-16T16:53:54.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2024-09-16T16:53:54.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-16T16:53:54.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2024-09-16T16:53:54.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-16T16:53:54.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2024-09-16T16:53:54.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-16T16:53:54.893 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T16:53:54.893 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.893 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T16:53:54.893 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2024-09-16T16:53:54.893 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6272: Skipped 2024-09-16T16:53:54.893 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:53:54.893 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP (0 ms total) 2024-09-16T16:53:54.893 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:53:54.893 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:53:54.893 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 77 tests from 4 test suites ran. (5991 ms total) 2024-09-16T16:53:54.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 0 tests. 2024-09-16T16:53:54.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] 77 tests, listed below: 2024-09-16T16:53:54.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTierPP.Dirty 2024-09-16T16:53:54.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2024-09-16T16:53:54.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone 2024-09-16T16:53:54.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2024-09-16T16:53:54.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote 2024-09-16T16:53:54.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-16T16:53:54.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-16T16:53:54.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-16T16:53:54.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2024-09-16T16:53:54.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-16T16:53:54.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict 2024-09-16T16:53:54.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2024-09-16T16:53:54.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-16T16:53:54.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2024-09-16T16:53:54.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-16T16:53:54.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2024-09-16T16:53:54.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush 2024-09-16T16:53:54.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2024-09-16T16:53:54.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-16T16:53:54.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-16T16:53:54.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2024-09-16T16:53:54.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-16T16:53:54.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-16T16:53:54.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-16T16:53:54.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2024-09-16T16:53:54.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2024-09-16T16:53:54.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-16T16:53:54.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-16T16:53:54.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-16T16:53:54.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-16T16:53:54.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-16T16:53:54.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-16T16:53:54.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-16T16:53:54.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-16T16:53:54.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-16T16:53:54.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-16T16:53:54.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-16T16:53:54.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-16T16:53:54.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-16T16:53:54.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-16T16:53:54.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-16T16:53:54.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-16T16:53:54.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-16T16:53:54.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-16T16:53:54.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-16T16:53:54.896 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-16T16:53:54.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-16T16:53:54.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-16T16:53:54.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-16T16:53:54.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-16T16:53:54.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-16T16:53:54.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty 2024-09-16T16:53:54.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2024-09-16T16:53:54.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2024-09-16T16:53:54.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone 2024-09-16T16:53:54.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2024-09-16T16:53:54.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2024-09-16T16:53:54.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-16T16:53:54.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-16T16:53:54.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2024-09-16T16:53:54.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2024-09-16T16:53:54.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-16T16:53:54.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2024-09-16T16:53:54.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-16T16:53:54.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2024-09-16T16:53:54.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-16T16:53:54.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-16T16:53:54.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-16T16:53:54.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-16T16:53:54.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-16T16:53:54.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-16T16:53:54.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-16T16:53:54.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2024-09-16T16:53:54.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-16T16:53:54.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-16T16:53:54.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-16T16:53:54.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-16T16:53:54.899 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:53:54.899 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:53:54.899 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_pool 2024-09-16T16:53:54.902 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:53:54.902 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-16T16:53:54.902 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:53:54.902 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 9 tests from LibRadosPools 2024-09-16T16:53:54.902 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosPools.PoolList 2024-09-16T16:53:57.906 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosPools.PoolList (3004 ms) 2024-09-16T16:53:57.906 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosPools.PoolLookup 2024-09-16T16:54:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosPools.PoolLookup (3009 ms) 2024-09-16T16:54:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosPools.PoolLookup2 2024-09-16T16:54:03.833 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosPools.PoolLookup2 (2918 ms) 2024-09-16T16:54:03.833 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-09-16T16:54:06.840 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosPools.PoolLookupOtherInstance (3007 ms) 2024-09-16T16:54:06.840 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-09-16T16:54:09.848 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3008 ms) 2024-09-16T16:54:09.848 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosPools.PoolDelete 2024-09-16T16:54:14.832 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosPools.PoolDelete (4984 ms) 2024-09-16T16:54:14.832 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosPools.PoolCreateDelete 2024-09-16T16:54:19.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosPools.PoolCreateDelete (5014 ms) 2024-09-16T16:54:19.846 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-09-16T16:54:24.831 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosPools.PoolCreateWithCrushRule (4985 ms) 2024-09-16T16:54:24.831 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosPools.PoolGetBaseTier 2024-09-16T16:54:24.831 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/pool.cc:139: Skipped 2024-09-16T16:54:24.831 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:24.831 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2024-09-16T16:54:24.831 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 9 tests from LibRadosPools (29929 ms total) 2024-09-16T16:54:24.831 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:54:24.831 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:54:24.832 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 9 tests from 1 test suite ran. (29929 ms total) 2024-09-16T16:54:24.832 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 8 tests. 2024-09-16T16:54:24.832 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-16T16:54:24.832 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier 2024-09-16T16:54:24.834 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:54:24.834 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:54:24.834 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_snapshots 2024-09-16T16:54:24.855 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:54:24.855 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 13 tests from 4 test suites. 2024-09-16T16:54:24.855 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:54:24.855 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosSnapshots 2024-09-16T16:54:26.843 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshots.SnapList 2024-09-16T16:54:28.850 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshots.SnapList (2006 ms) 2024-09-16T16:54:28.851 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshots.SnapRemove 2024-09-16T16:54:30.865 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshots.SnapRemove (2014 ms) 2024-09-16T16:54:30.865 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshots.Rollback 2024-09-16T16:54:32.869 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshots.Rollback (2004 ms) 2024-09-16T16:54:32.869 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshots.SnapGetName 2024-09-16T16:54:34.874 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshots.SnapGetName (2005 ms) 2024-09-16T16:54:35.883 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosSnapshots (8030 ms total) 2024-09-16T16:54:35.883 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:54:35.883 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-09-16T16:54:37.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-09-16T16:54:41.902 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Snap (4007 ms) 2024-09-16T16:54:41.902 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-09-16T16:54:45.982 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Rollback (4080 ms) 2024-09-16T16:54:45.982 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-09-16T16:54:51.023 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (5042 ms) 2024-09-16T16:54:51.837 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged (13129 ms total) 2024-09-16T16:54:51.837 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:54:51.837 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosSnapshotsEC 2024-09-16T16:54:51.837 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T16:54:51.837 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:51.837 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsEC.SnapList 2024-09-16T16:54:51.837 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:54:51.837 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:51.838 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:54:51.838 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:51.838 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList (0 ms) 2024-09-16T16:54:51.838 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-09-16T16:54:51.838 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:54:51.838 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:51.838 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:54:51.838 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:51.838 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2024-09-16T16:54:51.838 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsEC.Rollback 2024-09-16T16:54:51.838 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:54:51.838 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:51.838 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:54:51.838 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:51.839 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2024-09-16T16:54:51.839 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-09-16T16:54:51.839 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:54:51.839 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:51.839 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:54:51.839 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:51.839 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2024-09-16T16:54:51.839 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T16:54:51.839 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:51.839 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosSnapshotsEC (0 ms total) 2024-09-16T16:54:51.839 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:54:51.839 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-09-16T16:54:51.839 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T16:54:51.840 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:51.840 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-16T16:54:51.840 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:54:51.840 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:51.840 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:54:51.840 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:51.840 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2024-09-16T16:54:51.840 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-16T16:54:51.840 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:54:51.840 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:51.840 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:54:51.840 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:51.840 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2024-09-16T16:54:51.840 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T16:54:51.841 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:54:51.841 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2024-09-16T16:54:51.841 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:54:51.841 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:54:51.841 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 13 tests from 4 test suites ran. (26981 ms total) 2024-09-16T16:54:51.841 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 7 tests. 2024-09-16T16:54:51.841 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] 6 tests, listed below: 2024-09-16T16:54:51.841 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList 2024-09-16T16:54:51.841 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2024-09-16T16:54:51.841 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback 2024-09-16T16:54:51.841 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2024-09-16T16:54:51.841 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-16T16:54:51.841 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-16T16:54:51.842 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:54:51.842 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:54:51.842 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_snapshots_pp 2024-09-16T16:54:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:54:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 21 tests from 5 test suites. 2024-09-16T16:54:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:54:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 5 tests from LibRadosSnapshotsPP 2024-09-16T16:54:51.859 INFO:tasks.workunit.client.0.smithi089.stdout:seed 92734 2024-09-16T16:54:53.839 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-09-16T16:54:55.844 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshotsPP.SnapListPP (2005 ms) 2024-09-16T16:54:55.845 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-09-16T16:54:57.858 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshotsPP.SnapRemovePP (2014 ms) 2024-09-16T16:54:57.858 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-09-16T16:54:59.868 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshotsPP.RollbackPP (2010 ms) 2024-09-16T16:54:59.869 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-09-16T16:55:01.837 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1969 ms) 2024-09-16T16:55:01.837 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-09-16T16:55:05.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4061 ms) 2024-09-16T16:55:06.905 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 5 tests from LibRadosSnapshotsPP (12059 ms total) 2024-09-16T16:55:06.905 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:55:06.905 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-09-16T16:55:08.911 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-09-16T16:55:12.909 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (3998 ms) 2024-09-16T16:55:12.910 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-09-16T16:55:16.853 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3945 ms) 2024-09-16T16:55:16.854 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-09-16T16:55:22.841 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (5987 ms) 2024-09-16T16:55:22.841 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-09-16T16:55:26.857 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4016 ms) 2024-09-16T16:55:26.857 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-09-16T16:55:28.972 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2115 ms) 2024-09-16T16:55:28.973 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-16T16:55:28.973 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/snapshots_cxx.cc:460: Skipped 2024-09-16T16:55:28.973 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:55:28.973 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-09-16T16:55:28.973 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-09-16T16:55:30.879 INFO:tasks.workunit.client.0.smithi089.stdout:deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi089-92734-7 2024-09-16T16:55:31.840 INFO:tasks.workunit.client.0.smithi089.stdout:waiting for snaps to purge 2024-09-16T16:55:46.877 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17905 ms) 2024-09-16T16:55:47.849 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP (37966 ms total) 2024-09-16T16:55:47.849 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:55:47.849 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-09-16T16:55:47.849 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-09-16T16:55:47.856 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (7 ms) 2024-09-16T16:55:47.856 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-09-16T16:55:52.902 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5045 ms) 2024-09-16T16:55:52.902 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5052 ms total) 2024-09-16T16:55:52.902 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:55:52.903 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosSnapshotsECPP 2024-09-16T16:55:52.903 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T16:55:52.903 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.903 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-09-16T16:55:52.903 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:52.903 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.903 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:52.903 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.903 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2024-09-16T16:55:52.903 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-16T16:55:52.903 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:52.903 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.904 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:52.904 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.904 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2024-09-16T16:55:52.904 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-09-16T16:55:52.904 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:52.904 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.904 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:52.904 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.904 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2024-09-16T16:55:52.904 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-16T16:55:52.904 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:52.904 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.904 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:52.905 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.905 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2024-09-16T16:55:52.905 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T16:55:52.905 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.905 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2024-09-16T16:55:52.905 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:55:52.905 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-09-16T16:55:52.905 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T16:55:52.905 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.905 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-16T16:55:52.905 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:52.905 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.905 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:52.906 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.906 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2024-09-16T16:55:52.906 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-16T16:55:52.906 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:52.906 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.906 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:52.906 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.906 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2024-09-16T16:55:52.906 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-16T16:55:52.906 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:52.906 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.906 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:52.906 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.906 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2024-09-16T16:55:52.907 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T16:55:52.907 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:52.907 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2024-09-16T16:55:52.907 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:55:52.907 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:55:52.907 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 21 tests from 5 test suites ran. (61042 ms total) 2024-09-16T16:55:52.907 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 13 tests. 2024-09-16T16:55:52.907 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-16T16:55:52.907 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-16T16:55:52.907 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2024-09-16T16:55:52.907 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-16T16:55:52.907 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2024-09-16T16:55:52.907 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-16T16:55:52.908 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-16T16:55:52.908 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-16T16:55:52.908 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-16T16:55:52.908 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:55:52.908 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:55:52.908 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_stat 2024-09-16T16:55:52.931 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:55:52.932 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-16T16:55:52.932 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:55:52.932 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 5 tests from LibRadosStat 2024-09-16T16:55:54.879 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStat.Stat 2024-09-16T16:55:55.217 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosStat.Stat (338 ms) 2024-09-16T16:55:55.217 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStat.Stat2 2024-09-16T16:55:55.263 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosStat.Stat2 (46 ms) 2024-09-16T16:55:55.263 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStat.StatNS 2024-09-16T16:55:55.347 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosStat.StatNS (84 ms) 2024-09-16T16:55:55.348 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStat.ClusterStat 2024-09-16T16:55:55.348 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosStat.ClusterStat (1 ms) 2024-09-16T16:55:55.348 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStat.PoolStat 2024-09-16T16:55:55.366 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosStat.PoolStat (18 ms) 2024-09-16T16:55:55.886 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 5 tests from LibRadosStat (487 ms total) 2024-09-16T16:55:55.886 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:55:55.886 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosStatEC 2024-09-16T16:55:55.886 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T16:55:55.886 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:55.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStatEC.Stat 2024-09-16T16:55:55.886 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:55:55.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:55.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:55:55.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:55.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2024-09-16T16:55:55.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStatEC.StatNS 2024-09-16T16:55:55.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:55:55.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:55.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:55:55.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:55.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2024-09-16T16:55:55.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStatEC.ClusterStat 2024-09-16T16:55:55.887 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:55:55.887 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:55.888 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:55:55.888 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:55.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2024-09-16T16:55:55.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStatEC.PoolStat 2024-09-16T16:55:55.888 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:55:55.888 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:55.888 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:55:55.888 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:55.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2024-09-16T16:55:55.888 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T16:55:55.888 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:55.888 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosStatEC (0 ms total) 2024-09-16T16:55:55.888 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:55:55.888 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:55:55.889 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 9 tests from 2 test suites ran. (2953 ms total) 2024-09-16T16:55:55.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 5 tests. 2024-09-16T16:55:55.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-16T16:55:55.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosStatEC.Stat 2024-09-16T16:55:55.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosStatEC.StatNS 2024-09-16T16:55:55.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat 2024-09-16T16:55:55.889 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat 2024-09-16T16:55:55.890 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:55:55.890 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:55:55.890 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_stat_pp 2024-09-16T16:55:55.907 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:55:55.907 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-16T16:55:55.907 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:55:55.907 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 5 tests from LibRadosStatPP 2024-09-16T16:55:55.907 INFO:tasks.workunit.client.0.smithi089.stdout:seed 92869 2024-09-16T16:55:57.847 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStatPP.StatPP 2024-09-16T16:55:58.135 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosStatPP.StatPP (288 ms) 2024-09-16T16:55:58.135 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-09-16T16:55:58.195 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosStatPP.Stat2Mtime2PP (60 ms) 2024-09-16T16:55:58.196 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStatPP.ClusterStatPP 2024-09-16T16:55:58.196 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosStatPP.ClusterStatPP (1 ms) 2024-09-16T16:55:58.196 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStatPP.PoolStatPP 2024-09-16T16:55:58.214 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosStatPP.PoolStatPP (18 ms) 2024-09-16T16:55:58.214 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStatPP.StatPPNS 2024-09-16T16:55:58.295 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosStatPP.StatPPNS (81 ms) 2024-09-16T16:55:58.891 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 5 tests from LibRadosStatPP (448 ms total) 2024-09-16T16:55:58.891 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:55:58.891 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosStatECPP 2024-09-16T16:55:58.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T16:55:58.891 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:58.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStatECPP.StatPP 2024-09-16T16:55:58.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:58.891 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:58.891 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:58.891 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:58.891 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2024-09-16T16:55:58.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStatECPP.ClusterStatPP 2024-09-16T16:55:58.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:58.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:58.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:58.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:58.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-09-16T16:55:58.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStatECPP.PoolStatPP 2024-09-16T16:55:58.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:58.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:58.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:58.892 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:58.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2024-09-16T16:55:58.892 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosStatECPP.StatPPNS 2024-09-16T16:55:58.892 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:55:58.893 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:58.893 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:55:58.893 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:58.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS (1 ms) 2024-09-16T16:55:58.893 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T16:55:58.893 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:55:58.893 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosStatECPP (1 ms total) 2024-09-16T16:55:58.893 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:55:58.893 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:55:58.893 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 9 tests from 2 test suites ran. (2984 ms total) 2024-09-16T16:55:58.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 5 tests. 2024-09-16T16:55:58.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-16T16:55:58.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP 2024-09-16T16:55:58.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2024-09-16T16:55:58.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP 2024-09-16T16:55:58.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS 2024-09-16T16:55:58.894 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:55:58.894 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:55:58.894 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_watch_notify 2024-09-16T16:55:58.913 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:55:58.914 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-16T16:55:58.914 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:55:58.914 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 10 tests from LibRadosWatchNotify 2024-09-16T16:56:00.899 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify 2024-09-16T16:56:01.299 INFO:tasks.workunit.client.0.smithi089.stdout:watch_notify_test_cb 2024-09-16T16:56:01.335 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotify.WatchNotify (436 ms) 2024-09-16T16:56:01.335 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotify.Watch2Delete 2024-09-16T16:56:01.382 INFO:tasks.workunit.client.0.smithi089.stdout:waiting up to 300 for disconnect notification ... 2024-09-16T16:56:03.956 INFO:tasks.workunit.client.0.smithi089.stdout:watch_notify2_test_errcb cookie 21388832 err -107 2024-09-16T16:56:04.394 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotify.Watch2Delete (3059 ms) 2024-09-16T16:56:04.394 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-09-16T16:56:04.458 INFO:tasks.workunit.client.0.smithi089.stdout:waiting up to 300 for disconnect notification ... 2024-09-16T16:56:08.956 INFO:tasks.workunit.client.0.smithi089.stdout:watch_notify2_test_errcb cookie 21388832 err -107 2024-09-16T16:56:09.467 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete (5073 ms) 2024-09-16T16:56:09.467 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2 2024-09-16T16:56:09.505 INFO:tasks.workunit.client.0.smithi089.stdout:watch_notify2_test_cb from 15522 notify_id 1743756722176 cookie 21395008 2024-09-16T16:56:09.534 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2 (67 ms) 2024-09-16T16:56:09.534 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-09-16T16:56:09.569 INFO:tasks.workunit.client.0.smithi089.stdout:watch_notify2_test_cb from 15522 notify_id 1743756722176 cookie 21395008 2024-09-16T16:56:09.593 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotify.AioWatchNotify2 (59 ms) 2024-09-16T16:56:09.593 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotify.AioNotify 2024-09-16T16:56:09.631 INFO:tasks.workunit.client.0.smithi089.stdout:watch_notify2_test_cb from 15522 notify_id 1743756722177 cookie 21395008 2024-09-16T16:56:09.654 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotify.AioNotify (62 ms) 2024-09-16T16:56:09.654 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-09-16T16:56:09.704 INFO:tasks.workunit.client.0.smithi089.stdout:watch_notify2_test_cb from 15522 notify_id 1743756722176 cookie 21395008 2024-09-16T16:56:09.704 INFO:tasks.workunit.client.0.smithi089.stdout:watch_notify2_test_cb from 15522 notify_id 1743756722176 cookie 21433600 2024-09-16T16:56:09.741 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Multi (86 ms) 2024-09-16T16:56:09.741 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-09-16T16:56:09.777 INFO:tasks.workunit.client.0.smithi089.stdout:watch_notify2_test_cb from 15522 notify_id 1743756722177 cookie 21413024 2024-09-16T16:56:12.778 INFO:tasks.workunit.client.0.smithi089.stdout:watch_notify2_test_cb from 15522 notify_id 1743756722178 cookie 21413024 2024-09-16T16:56:12.806 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3065 ms) 2024-09-16T16:56:12.806 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-09-16T16:56:12.846 INFO:tasks.workunit.client.0.smithi089.stdout:waiting up to 1024 for osd to time us out ... 2024-09-16T16:56:16.860 INFO:tasks.workunit.client.0.smithi089.stdout:watch_notify2_test_errcb cookie 21413024 err -107 2024-09-16T16:56:17.878 INFO:tasks.workunit.client.0.smithi089.stdout:watch_notify2_test_cb from 15522 notify_id 1743756722178 cookie 21413024 2024-09-16T16:56:17.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotify.Watch3Timeout (5091 ms) 2024-09-16T16:56:17.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-09-16T16:56:17.946 INFO:tasks.workunit.client.0.smithi089.stdout:waiting up to 30 for disconnect notification ... 2024-09-16T16:56:18.970 INFO:tasks.workunit.client.0.smithi089.stdout:watch_notify2_test_errcb cookie 21413024 err -107 2024-09-16T16:56:19.958 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete2 (2061 ms) 2024-09-16T16:56:20.332 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 10 tests from LibRadosWatchNotify (19059 ms total) 2024-09-16T16:56:20.333 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:56:20.333 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibRadosWatchNotifyEC 2024-09-16T16:56:20.333 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T16:56:20.333 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.333 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-09-16T16:56:20.333 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T16:56:20.333 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.333 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T16:56:20.333 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.333 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2024-09-16T16:56:20.333 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T16:56:20.333 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.333 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2024-09-16T16:56:20.334 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:56:20.334 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:56:20.334 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 11 tests from 2 test suites ran. (21418 ms total) 2024-09-16T16:56:20.334 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 10 tests. 2024-09-16T16:56:20.334 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-16T16:56:20.334 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2024-09-16T16:56:20.334 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:56:20.335 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:56:20.335 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-09-16T16:56:20.355 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:56:20.355 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-16T16:56:20.355 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:56:20.355 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP 2024-09-16T16:56:20.355 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T16:56:20.355 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.355 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-16T16:56:20.355 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:56:20.355 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.355 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:56:20.355 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.356 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2024-09-16T16:56:20.356 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-16T16:56:20.356 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T16:56:20.356 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.356 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T16:56:20.356 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.356 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (0 ms) 2024-09-16T16:56:20.356 INFO:tasks.workunit.client.0.smithi089.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T16:56:20.356 INFO:tasks.workunit.client.0.smithi089.stdout:Not supported by crimson yet. Skipped 2024-09-16T16:56:20.356 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP (0 ms total) 2024-09-16T16:56:20.356 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:56:20.356 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-09-16T16:56:22.341 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-09-16T16:56:22.690 INFO:tasks.workunit.client.0.smithi089.stdout:notify 2024-09-16T16:56:22.712 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (370 ms) 2024-09-16T16:56:22.712 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-09-16T16:56:22.780 INFO:tasks.workunit.client.0.smithi089.stdout:notify 2024-09-16T16:56:22.797 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (86 ms) 2024-09-16T16:56:22.797 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-09-16T16:56:22.843 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (45 ms) 2024-09-16T16:56:22.843 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-09-16T16:56:22.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (52 ms) 2024-09-16T16:56:22.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-09-16T16:56:22.945 INFO:tasks.workunit.client.0.smithi089.stdout:handle_notify cookie 17062864 notify_id 1756641624066 notifier_gid 15525 2024-09-16T16:56:22.964 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (69 ms) 2024-09-16T16:56:22.964 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-09-16T16:56:23.004 INFO:tasks.workunit.client.0.smithi089.stdout:handle_notify cookie 17062864 notify_id 1756641624066 notifier_gid 15525 2024-09-16T16:56:23.022 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (58 ms) 2024-09-16T16:56:23.022 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-09-16T16:56:23.062 INFO:tasks.workunit.client.0.smithi089.stdout:handle_notify cookie 17062864 notify_id 1756641624067 notifier_gid 15525 2024-09-16T16:56:23.079 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (58 ms) 2024-09-16T16:56:23.080 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-09-16T16:56:23.122 INFO:tasks.workunit.client.0.smithi089.stdout:handle_notify cookie 17062864 notify_id 1756641624067 notifier_gid 15525 2024-09-16T16:56:23.139 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (59 ms) 2024-09-16T16:56:23.139 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-09-16T16:56:23.179 INFO:tasks.workunit.client.0.smithi089.stdout:handle_notify cookie 17062864 notify_id 1756641624068 notifier_gid 15525 2024-09-16T16:56:23.197 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (58 ms) 2024-09-16T16:56:23.197 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-09-16T16:56:23.243 INFO:tasks.workunit.client.0.smithi089.stdout:handle_notify cookie 17062864 notify_id 1756641624069 notifier_gid 15525 2024-09-16T16:56:23.263 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (66 ms) 2024-09-16T16:56:23.263 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-09-16T16:56:23.298 INFO:tasks.workunit.client.0.smithi089.stdout: trying... 2024-09-16T16:56:23.302 INFO:tasks.workunit.client.0.smithi089.stdout:handle_notify cookie 17062864 notify_id 1756641624070 notifier_gid 15525 2024-09-16T16:56:24.300 INFO:tasks.workunit.client.0.smithi089.stdout: timed out 2024-09-16T16:56:24.334 INFO:tasks.workunit.client.0.smithi089.stdout: flushing 2024-09-16T16:56:26.303 INFO:tasks.workunit.client.0.smithi089.stdout: flushed 2024-09-16T16:56:26.303 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3040 ms) 2024-09-16T16:56:26.304 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-09-16T16:56:26.352 INFO:tasks.workunit.client.0.smithi089.stdout: trying... 2024-09-16T16:56:26.357 INFO:tasks.workunit.client.0.smithi089.stdout:handle_notify cookie 17062864 notify_id 1756641624068 notifier_gid 15525 2024-09-16T16:56:27.356 INFO:tasks.workunit.client.0.smithi089.stdout: timed out 2024-09-16T16:56:27.378 INFO:tasks.workunit.client.0.smithi089.stdout: flushing 2024-09-16T16:56:29.357 INFO:tasks.workunit.client.0.smithi089.stdout: flushed 2024-09-16T16:56:29.358 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3054 ms) 2024-09-16T16:56:29.358 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-09-16T16:56:29.408 INFO:tasks.workunit.client.0.smithi089.stdout:List watches 2024-09-16T16:56:29.408 INFO:tasks.workunit.client.0.smithi089.stdout:notify2 2024-09-16T16:56:29.412 INFO:tasks.workunit.client.0.smithi089.stdout:handle_notify cookie 17062864 notify_id 1756641624068 notifier_gid 15525 2024-09-16T16:56:32.418 INFO:tasks.workunit.client.0.smithi089.stdout:notify2 done 2024-09-16T16:56:32.418 INFO:tasks.workunit.client.0.smithi089.stdout:watch_check 2024-09-16T16:56:32.418 INFO:tasks.workunit.client.0.smithi089.stdout:unwatch2 2024-09-16T16:56:32.436 INFO:tasks.workunit.client.0.smithi089.stdout: flushing 2024-09-16T16:56:32.436 INFO:tasks.workunit.client.0.smithi089.stdout:done 2024-09-16T16:56:32.437 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3080 ms) 2024-09-16T16:56:32.437 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-09-16T16:56:32.480 INFO:tasks.workunit.client.0.smithi089.stdout:List watches 2024-09-16T16:56:32.480 INFO:tasks.workunit.client.0.smithi089.stdout:notify2 2024-09-16T16:56:32.483 INFO:tasks.workunit.client.0.smithi089.stdout:handle_notify cookie 17080528 notify_id 1760936591363 notifier_gid 15525 2024-09-16T16:56:35.489 INFO:tasks.workunit.client.0.smithi089.stdout:notify2 done 2024-09-16T16:56:35.489 INFO:tasks.workunit.client.0.smithi089.stdout:watch_check 2024-09-16T16:56:35.489 INFO:tasks.workunit.client.0.smithi089.stdout:unwatch2 2024-09-16T16:56:35.507 INFO:tasks.workunit.client.0.smithi089.stdout: flushing 2024-09-16T16:56:35.507 INFO:tasks.workunit.client.0.smithi089.stdout:done 2024-09-16T16:56:35.507 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3070 ms) 2024-09-16T16:56:36.335 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (13165 ms total) 2024-09-16T16:56:36.336 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:56:36.336 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:56:36.336 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 16 tests from 2 test suites ran. (15980 ms total) 2024-09-16T16:56:36.336 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 14 tests. 2024-09-16T16:56:36.336 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-16T16:56:36.336 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-16T16:56:36.336 INFO:tasks.workunit.client.0.smithi089.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-16T16:56:36.338 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:56:36.338 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:56:36.339 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_cmd 2024-09-16T16:56:36.360 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:56:36.360 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T16:56:36.360 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:56:36.360 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosCmd 2024-09-16T16:56:36.360 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosCmd.MonDescribe 2024-09-16T16:56:36.426 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosCmd.MonDescribe (66 ms) 2024-09-16T16:56:36.426 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosCmd.OSDCmd 2024-09-16T16:56:36.478 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosCmd.OSDCmd (52 ms) 2024-09-16T16:56:36.478 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosCmd.PGCmd 2024-09-16T16:56:38.857 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosCmd.PGCmd (2379 ms) 2024-09-16T16:56:38.858 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosCmd.WatchLog 2024-09-16T16:56:38.886 INFO:tasks.workunit.client.0.smithi089.stdout:got: 2024-09-16T16:56:37.849147+0000 mon.a [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-16T16:56:38.886 INFO:tasks.workunit.client.0.smithi089.stdout:got: 2024-09-16T16:56:37.852550+0000 mon.a [INF] from='client.? 172.21.15.89:0/2222213494' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi089-92926-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-16T16:56:39.857 INFO:tasks.workunit.client.0.smithi089.stdout:got: 2024-09-16T16:56:38.886609+0000 client.admin [INF] onexx 2024-09-16T16:56:39.857 INFO:tasks.workunit.client.0.smithi089.stdout:got: 2024-09-16T16:56:38.886732+0000 mon.a [INF] from='client.? 172.21.15.89:0/652729421' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-16T16:56:40.857 INFO:tasks.workunit.client.0.smithi089.stdout:got: 2024-09-16T16:56:39.856580+0000 mon.a [INF] from='client.? 172.21.15.89:0/652729421' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-16T16:56:43.861 INFO:tasks.workunit.client.0.smithi089.stdout:got: 2024-09-16T16:56:41.860866+0000 mon.a [INF] from='client.? 172.21.15.89:0/652729421' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-16T16:56:44.868 INFO:tasks.workunit.client.0.smithi089.stdout:got: 2024-09-16T16:56:43.861482+0000 client.admin [INF] threexx 2024-09-16T16:56:44.868 INFO:tasks.workunit.client.0.smithi089.stdout:got: 2024-09-16T16:56:43.862166+0000 mon.a [INF] from='client.? 172.21.15.89:0/652729421' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-16T16:56:48.875 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosCmd.WatchLog (10018 ms) 2024-09-16T16:56:48.875 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosCmd (12515 ms total) 2024-09-16T16:56:48.875 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:56:48.875 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:56:48.875 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 4 tests from 1 test suite ran. (12515 ms total) 2024-09-16T16:56:48.875 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 4 tests. 2024-09-16T16:56:48.877 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:56:48.877 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:56:48.877 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_cmd_pp 2024-09-16T16:56:48.899 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:56:48.899 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-16T16:56:48.899 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:56:48.900 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 3 tests from LibRadosCmd 2024-09-16T16:56:48.900 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosCmd.MonDescribePP 2024-09-16T16:56:48.932 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosCmd.MonDescribePP (33 ms) 2024-09-16T16:56:48.932 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosCmd.OSDCmdPP 2024-09-16T16:56:48.965 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosCmd.OSDCmdPP (33 ms) 2024-09-16T16:56:48.965 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosCmd.PGCmdPP 2024-09-16T16:56:51.057 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosCmd.PGCmdPP (2092 ms) 2024-09-16T16:56:51.057 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 3 tests from LibRadosCmd (2158 ms total) 2024-09-16T16:56:51.057 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:56:51.057 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:56:51.057 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 3 tests from 1 test suite ran. (2158 ms total) 2024-09-16T16:56:51.057 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 3 tests. 2024-09-16T16:56:51.059 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:56:51.059 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:56:51.059 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_service 2024-09-16T16:56:51.092 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:56:51.091+0000 7fad29f41840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:51.092 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:56:51.091+0000 7fad29f41840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:51.092 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:56:51.091+0000 7fad29f41840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:51.092 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T16:56:51.092 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:56:51.092 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosService 2024-09-16T16:56:51.093 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosService.RegisterEarly 2024-09-16T16:56:56.125 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosService.RegisterEarly (5034 ms) 2024-09-16T16:56:56.126 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosService.RegisterLate 2024-09-16T16:56:56.153 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosService.RegisterLate (28 ms) 2024-09-16T16:56:56.154 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosService.StatusFormat 2024-09-16T16:56:56.310 INFO:tasks.workunit.client.0.smithi089.stdout: cluster: 2024-09-16T16:56:56.310 INFO:tasks.workunit.client.0.smithi089.stdout: id: 747238a8-71dc-4442-98b8-945fe8c55201 2024-09-16T16:56:56.310 INFO:tasks.workunit.client.0.smithi089.stdout: health: HEALTH_WARN 2024-09-16T16:56:56.310 INFO:tasks.workunit.client.0.smithi089.stdout: 1 pool(s) do not have an application enabled 2024-09-16T16:56:56.310 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:56:56.310 INFO:tasks.workunit.client.0.smithi089.stdout: services: 2024-09-16T16:56:56.310 INFO:tasks.workunit.client.0.smithi089.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-16T16:56:56.310 INFO:tasks.workunit.client.0.smithi089.stdout: mgr: x(active, since 10m) 2024-09-16T16:56:56.310 INFO:tasks.workunit.client.0.smithi089.stdout: osd: 4 osds: 4 up (since 10m), 4 in (since 10m) 2024-09-16T16:56:56.310 INFO:tasks.workunit.client.0.smithi089.stdout: laundry: 1 daemon active (1 hosts) 2024-09-16T16:56:56.310 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:56:56.311 INFO:tasks.workunit.client.0.smithi089.stdout: data: 2024-09-16T16:56:56.311 INFO:tasks.workunit.client.0.smithi089.stdout: pools: 3 pools, 41 pgs 2024-09-16T16:56:56.311 INFO:tasks.workunit.client.0.smithi089.stdout: objects: 5 objects, 577 KiB 2024-09-16T16:56:56.311 INFO:tasks.workunit.client.0.smithi089.stdout: usage: 24 MiB used, 199 GiB / 200 GiB avail 2024-09-16T16:56:56.311 INFO:tasks.workunit.client.0.smithi089.stdout: pgs: 41 active+clean 2024-09-16T16:56:56.311 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:56:56.311 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:56:58.339 INFO:tasks.workunit.client.0.smithi089.stdout: cluster: 2024-09-16T16:56:58.340 INFO:tasks.workunit.client.0.smithi089.stdout: id: 747238a8-71dc-4442-98b8-945fe8c55201 2024-09-16T16:56:58.340 INFO:tasks.workunit.client.0.smithi089.stdout: health: HEALTH_WARN 2024-09-16T16:56:58.340 INFO:tasks.workunit.client.0.smithi089.stdout: 1 pool(s) do not have an application enabled 2024-09-16T16:56:58.340 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:56:58.340 INFO:tasks.workunit.client.0.smithi089.stdout: services: 2024-09-16T16:56:58.340 INFO:tasks.workunit.client.0.smithi089.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-16T16:56:58.340 INFO:tasks.workunit.client.0.smithi089.stdout: mgr: x(active, since 10m) 2024-09-16T16:56:58.340 INFO:tasks.workunit.client.0.smithi089.stdout: osd: 4 osds: 4 up (since 10m), 4 in (since 10m) 2024-09-16T16:56:58.340 INFO:tasks.workunit.client.0.smithi089.stdout: foo: 16 portals active (1 hosts, 3 zones) 2024-09-16T16:56:58.340 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:56:58.340 INFO:tasks.workunit.client.0.smithi089.stdout: data: 2024-09-16T16:56:58.340 INFO:tasks.workunit.client.0.smithi089.stdout: pools: 3 pools, 41 pgs 2024-09-16T16:56:58.340 INFO:tasks.workunit.client.0.smithi089.stdout: objects: 5 objects, 577 KiB 2024-09-16T16:56:58.340 INFO:tasks.workunit.client.0.smithi089.stdout: usage: 24 MiB used, 199 GiB / 200 GiB avail 2024-09-16T16:56:58.341 INFO:tasks.workunit.client.0.smithi089.stdout: pgs: 41 active+clean 2024-09-16T16:56:58.341 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:56:58.341 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:56:58.364 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosService.StatusFormat (2210 ms) 2024-09-16T16:56:58.364 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosService.Status 2024-09-16T16:57:18.393 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosService.Status (20029 ms) 2024-09-16T16:57:18.393 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosService (27301 ms total) 2024-09-16T16:57:18.393 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:57:18.393 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:57:18.393 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 4 tests from 1 test suite ran. (27301 ms total) 2024-09-16T16:57:18.393 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 4 tests. 2024-09-16T16:57:18.399 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:57:18.399 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:57:18.399 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_service_pp 2024-09-16T16:57:18.435 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:57:18.434+0000 7fcf6a263840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:18.435 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:57:18.434+0000 7fcf6a263840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:18.435 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T16:57:18.434+0000 7fcf6a263840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:18.435 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T16:57:18.435 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:57:18.435 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosServicePP 2024-09-16T16:57:18.436 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosServicePP.RegisterEarly 2024-09-16T16:57:23.463 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosServicePP.RegisterEarly (5028 ms) 2024-09-16T16:57:23.463 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosServicePP.RegisterLate 2024-09-16T16:57:23.507 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosServicePP.RegisterLate (44 ms) 2024-09-16T16:57:23.507 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosServicePP.Status 2024-09-16T16:57:43.535 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosServicePP.Status (20028 ms) 2024-09-16T16:57:43.535 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosServicePP.Close 2024-09-16T16:57:43.536 INFO:tasks.workunit.client.0.smithi089.stdout:attempt 0 of 20 2024-09-16T16:57:48.590 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosServicePP.Close (5055 ms) 2024-09-16T16:57:48.591 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 4 tests from LibRadosServicePP (30155 ms total) 2024-09-16T16:57:48.591 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:57:48.591 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:57:48.591 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 4 tests from 1 test suite ran. (30155 ms total) 2024-09-16T16:57:48.591 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 4 tests. 2024-09-16T16:57:48.593 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:57:48.593 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:57:48.593 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_c_write_operations 2024-09-16T16:57:48.615 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:57:48.615 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 8 tests from 2 test suites. 2024-09-16T16:57:48.615 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:57:48.616 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibradosCWriteOps 2024-09-16T16:57:48.616 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibradosCWriteOps.NewDelete 2024-09-16T16:57:48.616 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-09-16T16:57:48.616 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from LibradosCWriteOps (0 ms total) 2024-09-16T16:57:48.616 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:57:48.616 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 7 tests from LibRadosCWriteOps 2024-09-16T16:57:48.616 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosCWriteOps.assertExists 2024-09-16T16:57:50.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosCWriteOps.assertExists (2278 ms) 2024-09-16T16:57:50.893 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-09-16T16:57:53.911 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3019 ms) 2024-09-16T16:57:53.912 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosCWriteOps.Xattrs 2024-09-16T16:57:56.924 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosCWriteOps.Xattrs (3012 ms) 2024-09-16T16:57:56.924 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosCWriteOps.Write 2024-09-16T16:57:59.946 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosCWriteOps.Write (3022 ms) 2024-09-16T16:57:59.946 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosCWriteOps.Exec 2024-09-16T16:58:02.952 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosCWriteOps.Exec (3005 ms) 2024-09-16T16:58:02.952 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosCWriteOps.WriteSame 2024-09-16T16:58:05.970 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosCWriteOps.WriteSame (3019 ms) 2024-09-16T16:58:05.970 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] LibRadosCWriteOps.CmpExt 2024-09-16T16:58:19.364 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] LibRadosCWriteOps.CmpExt (13394 ms) 2024-09-16T16:58:19.364 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 7 tests from LibRadosCWriteOps (30749 ms total) 2024-09-16T16:58:19.365 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:58:19.365 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:58:19.365 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 8 tests from 2 test suites ran. (30749 ms total) 2024-09-16T16:58:19.365 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 8 tests. 2024-09-16T16:58:19.366 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:58:19.366 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:58:19.366 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_api_c_read_operations 2024-09-16T16:58:19.386 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:58:19.387 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-16T16:58:19.387 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:58:19.387 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 17 tests from CReadOpsTest 2024-09-16T16:58:21.372 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.NewDelete 2024-09-16T16:58:21.372 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.NewDelete (0 ms) 2024-09-16T16:58:21.372 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.SetOpFlags 2024-09-16T16:58:21.724 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.SetOpFlags (352 ms) 2024-09-16T16:58:21.724 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.AssertExists 2024-09-16T16:58:21.775 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.AssertExists (51 ms) 2024-09-16T16:58:21.775 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.AssertVersion 2024-09-16T16:58:21.836 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.AssertVersion (62 ms) 2024-09-16T16:58:21.837 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.CmpXattr 2024-09-16T16:58:22.076 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.CmpXattr (239 ms) 2024-09-16T16:58:22.076 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.Read 2024-09-16T16:58:22.141 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.Read (66 ms) 2024-09-16T16:58:22.142 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.Checksum 2024-09-16T16:58:22.198 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.Checksum (56 ms) 2024-09-16T16:58:22.198 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.RWOrderedRead 2024-09-16T16:58:22.237 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.RWOrderedRead (40 ms) 2024-09-16T16:58:22.238 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.ShortRead 2024-09-16T16:58:22.292 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.ShortRead (54 ms) 2024-09-16T16:58:22.292 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.Exec 2024-09-16T16:58:22.336 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.Exec (44 ms) 2024-09-16T16:58:22.336 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.ExecUserBuf 2024-09-16T16:58:22.405 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.ExecUserBuf (69 ms) 2024-09-16T16:58:22.405 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.Stat 2024-09-16T16:58:22.479 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.Stat (74 ms) 2024-09-16T16:58:22.479 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.Stat2 2024-09-16T16:58:22.544 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.Stat2 (66 ms) 2024-09-16T16:58:22.545 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.Omap 2024-09-16T16:58:22.682 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.Omap (137 ms) 2024-09-16T16:58:22.682 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.OmapNuls 2024-09-16T16:58:22.797 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.OmapNuls (115 ms) 2024-09-16T16:58:22.797 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.GetXattrs 2024-09-16T16:58:22.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.GetXattrs (101 ms) 2024-09-16T16:58:22.898 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] CReadOpsTest.CmpExt 2024-09-16T16:58:22.946 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] CReadOpsTest.CmpExt (49 ms) 2024-09-16T16:58:23.389 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 17 tests from CReadOpsTest (1575 ms total) 2024-09-16T16:58:23.390 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:58:23.390 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:58:23.390 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 17 tests from 1 test suite ran. (4003 ms total) 2024-09-16T16:58:23.390 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 17 tests. 2024-09-16T16:58:23.392 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:58:23.393 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:58:23.393 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_list_parallel 2024-09-16T16:58:26.662 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93608]: starting. 2024-09-16T16:58:26.663 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93608]: creating pool ceph_test_rados_list_parallel.smithi089-93607 2024-09-16T16:58:26.663 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93608]: created object 0... 2024-09-16T16:58:26.663 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93608]: created object 25... 2024-09-16T16:58:26.663 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93608]: created object 49... 2024-09-16T16:58:26.663 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93608]: finishing. 2024-09-16T16:58:26.663 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93608]: shutting down. 2024-09-16T16:58:26.815 INFO:tasks.workunit.client.0.smithi089.stdout:process_2_[93609]: starting. 2024-09-16T16:58:26.815 INFO:tasks.workunit.client.0.smithi089.stdout:process_2_[93609]: listing objects. 2024-09-16T16:58:26.815 INFO:tasks.workunit.client.0.smithi089.stdout:process_2_[93609]: listed object 0... 2024-09-16T16:58:26.815 INFO:tasks.workunit.client.0.smithi089.stdout:process_2_[93609]: listed object 25... 2024-09-16T16:58:26.815 INFO:tasks.workunit.client.0.smithi089.stdout:process_2_[93609]: saw 50 objects 2024-09-16T16:58:26.815 INFO:tasks.workunit.client.0.smithi089.stdout:process_2_[93609]: shutting down. 2024-09-16T16:58:27.677 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:27.677 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[93644]: starting. 2024-09-16T16:58:27.678 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[93644]: creating pool ceph_test_rados_list_parallel.smithi089-93607 2024-09-16T16:58:27.678 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[93644]: created object 0... 2024-09-16T16:58:27.678 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[93644]: created object 25... 2024-09-16T16:58:27.678 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[93644]: created object 49... 2024-09-16T16:58:27.678 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[93644]: finishing. 2024-09-16T16:58:27.678 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[93644]: shutting down. 2024-09-16T16:58:28.093 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:28.093 INFO:tasks.workunit.client.0.smithi089.stdout:process_4_[93645]: starting. 2024-09-16T16:58:28.093 INFO:tasks.workunit.client.0.smithi089.stdout:process_4_[93645]: listing objects. 2024-09-16T16:58:28.093 INFO:tasks.workunit.client.0.smithi089.stdout:process_4_[93645]: listed object 0... 2024-09-16T16:58:28.093 INFO:tasks.workunit.client.0.smithi089.stdout:process_4_[93645]: listed object 25... 2024-09-16T16:58:28.093 INFO:tasks.workunit.client.0.smithi089.stdout:process_4_[93645]: saw 45 objects 2024-09-16T16:58:28.093 INFO:tasks.workunit.client.0.smithi089.stdout:process_4_[93645]: shutting down. 2024-09-16T16:58:28.468 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:28.468 INFO:tasks.workunit.client.0.smithi089.stdout:process_5_[93646]: starting. 2024-09-16T16:58:28.468 INFO:tasks.workunit.client.0.smithi089.stdout:process_5_[93646]: removed 25 objects... 2024-09-16T16:58:28.468 INFO:tasks.workunit.client.0.smithi089.stdout:process_5_[93646]: removed half of the objects 2024-09-16T16:58:28.468 INFO:tasks.workunit.client.0.smithi089.stdout:process_5_[93646]: removed 50 objects... 2024-09-16T16:58:28.468 INFO:tasks.workunit.client.0.smithi089.stdout:process_5_[93646]: removed 50 objects 2024-09-16T16:58:28.468 INFO:tasks.workunit.client.0.smithi089.stdout:process_5_[93646]: shutting down. 2024-09-16T16:58:29.390 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:29.390 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:29.390 INFO:tasks.workunit.client.0.smithi089.stdout:process_6_[93695]: starting. 2024-09-16T16:58:29.390 INFO:tasks.workunit.client.0.smithi089.stdout:process_6_[93695]: creating pool ceph_test_rados_list_parallel.smithi089-93607 2024-09-16T16:58:29.390 INFO:tasks.workunit.client.0.smithi089.stdout:process_6_[93695]: created object 0... 2024-09-16T16:58:29.390 INFO:tasks.workunit.client.0.smithi089.stdout:process_6_[93695]: created object 25... 2024-09-16T16:58:29.390 INFO:tasks.workunit.client.0.smithi089.stdout:process_6_[93695]: created object 49... 2024-09-16T16:58:29.390 INFO:tasks.workunit.client.0.smithi089.stdout:process_6_[93695]: finishing. 2024-09-16T16:58:29.391 INFO:tasks.workunit.client.0.smithi089.stdout:process_6_[93695]: shutting down. 2024-09-16T16:58:29.882 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:29.882 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:29.882 INFO:tasks.workunit.client.0.smithi089.stdout:process_7_[93696]: starting. 2024-09-16T16:58:29.882 INFO:tasks.workunit.client.0.smithi089.stdout:process_7_[93696]: listing objects. 2024-09-16T16:58:29.883 INFO:tasks.workunit.client.0.smithi089.stdout:process_7_[93696]: listed object 0... 2024-09-16T16:58:29.883 INFO:tasks.workunit.client.0.smithi089.stdout:process_7_[93696]: listed object 25... 2024-09-16T16:58:29.883 INFO:tasks.workunit.client.0.smithi089.stdout:process_7_[93696]: listed object 50... 2024-09-16T16:58:29.883 INFO:tasks.workunit.client.0.smithi089.stdout:process_7_[93696]: saw 54 objects 2024-09-16T16:58:29.883 INFO:tasks.workunit.client.0.smithi089.stdout:process_7_[93696]: shutting down. 2024-09-16T16:58:30.372 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:30.372 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:30.373 INFO:tasks.workunit.client.0.smithi089.stdout:process_8_[93697]: starting. 2024-09-16T16:58:30.373 INFO:tasks.workunit.client.0.smithi089.stdout:process_8_[93697]: added 25 objects... 2024-09-16T16:58:30.373 INFO:tasks.workunit.client.0.smithi089.stdout:process_8_[93697]: added half of the objects 2024-09-16T16:58:30.373 INFO:tasks.workunit.client.0.smithi089.stdout:process_8_[93697]: added 50 objects... 2024-09-16T16:58:30.373 INFO:tasks.workunit.client.0.smithi089.stdout:process_8_[93697]: added 50 objects 2024-09-16T16:58:30.373 INFO:tasks.workunit.client.0.smithi089.stdout:process_8_[93697]: shutting down. 2024-09-16T16:58:31.235 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:31.235 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:31.235 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:31.235 INFO:tasks.workunit.client.0.smithi089.stdout:process_9_[93746]: starting. 2024-09-16T16:58:31.235 INFO:tasks.workunit.client.0.smithi089.stdout:process_9_[93746]: creating pool ceph_test_rados_list_parallel.smithi089-93607 2024-09-16T16:58:31.236 INFO:tasks.workunit.client.0.smithi089.stdout:process_9_[93746]: created object 0... 2024-09-16T16:58:31.236 INFO:tasks.workunit.client.0.smithi089.stdout:process_9_[93746]: created object 25... 2024-09-16T16:58:31.236 INFO:tasks.workunit.client.0.smithi089.stdout:process_9_[93746]: created object 49... 2024-09-16T16:58:31.236 INFO:tasks.workunit.client.0.smithi089.stdout:process_9_[93746]: finishing. 2024-09-16T16:58:31.236 INFO:tasks.workunit.client.0.smithi089.stdout:process_9_[93746]: shutting down. 2024-09-16T16:58:31.767 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:31.767 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:31.767 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:31.767 INFO:tasks.workunit.client.0.smithi089.stdout:process_10_[93747]: starting. 2024-09-16T16:58:31.767 INFO:tasks.workunit.client.0.smithi089.stdout:process_10_[93747]: listing objects. 2024-09-16T16:58:31.767 INFO:tasks.workunit.client.0.smithi089.stdout:process_10_[93747]: listed object 0... 2024-09-16T16:58:31.767 INFO:tasks.workunit.client.0.smithi089.stdout:process_10_[93747]: listed object 25... 2024-09-16T16:58:31.767 INFO:tasks.workunit.client.0.smithi089.stdout:process_10_[93747]: listed object 50... 2024-09-16T16:58:31.767 INFO:tasks.workunit.client.0.smithi089.stdout:process_10_[93747]: listed object 75... 2024-09-16T16:58:31.767 INFO:tasks.workunit.client.0.smithi089.stdout:process_10_[93747]: saw 97 objects 2024-09-16T16:58:31.767 INFO:tasks.workunit.client.0.smithi089.stdout:process_10_[93747]: shutting down. 2024-09-16T16:58:32.297 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:32.297 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:32.297 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:32.297 INFO:tasks.workunit.client.0.smithi089.stdout:process_13_[93750]: starting. 2024-09-16T16:58:32.297 INFO:tasks.workunit.client.0.smithi089.stdout:process_13_[93750]: removed 25 objects... 2024-09-16T16:58:32.297 INFO:tasks.workunit.client.0.smithi089.stdout:process_13_[93750]: removed half of the objects 2024-09-16T16:58:32.298 INFO:tasks.workunit.client.0.smithi089.stdout:process_13_[93750]: removed 50 objects... 2024-09-16T16:58:32.298 INFO:tasks.workunit.client.0.smithi089.stdout:process_13_[93750]: removed 50 objects 2024-09-16T16:58:32.298 INFO:tasks.workunit.client.0.smithi089.stdout:process_13_[93750]: shutting down. 2024-09-16T16:58:32.469 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:32.469 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:32.470 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:32.470 INFO:tasks.workunit.client.0.smithi089.stdout:process_11_[93748]: starting. 2024-09-16T16:58:32.470 INFO:tasks.workunit.client.0.smithi089.stdout:process_11_[93748]: added 25 objects... 2024-09-16T16:58:32.470 INFO:tasks.workunit.client.0.smithi089.stdout:process_11_[93748]: added half of the objects 2024-09-16T16:58:32.470 INFO:tasks.workunit.client.0.smithi089.stdout:process_11_[93748]: added 50 objects... 2024-09-16T16:58:32.470 INFO:tasks.workunit.client.0.smithi089.stdout:process_11_[93748]: added 50 objects 2024-09-16T16:58:32.470 INFO:tasks.workunit.client.0.smithi089.stdout:process_11_[93748]: shutting down. 2024-09-16T16:58:32.595 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:32.595 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:32.595 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:32.595 INFO:tasks.workunit.client.0.smithi089.stdout:process_12_[93749]: starting. 2024-09-16T16:58:32.595 INFO:tasks.workunit.client.0.smithi089.stdout:process_12_[93749]: added 25 objects... 2024-09-16T16:58:32.595 INFO:tasks.workunit.client.0.smithi089.stdout:process_12_[93749]: added half of the objects 2024-09-16T16:58:32.596 INFO:tasks.workunit.client.0.smithi089.stdout:process_12_[93749]: added 50 objects... 2024-09-16T16:58:32.596 INFO:tasks.workunit.client.0.smithi089.stdout:process_12_[93749]: added 50 objects 2024-09-16T16:58:32.596 INFO:tasks.workunit.client.0.smithi089.stdout:process_12_[93749]: shutting down. 2024-09-16T16:58:33.578 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:33.578 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:33.578 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:33.578 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:33.578 INFO:tasks.workunit.client.0.smithi089.stdout:process_14_[93832]: starting. 2024-09-16T16:58:33.578 INFO:tasks.workunit.client.0.smithi089.stdout:process_14_[93832]: creating pool ceph_test_rados_list_parallel.smithi089-93607 2024-09-16T16:58:33.579 INFO:tasks.workunit.client.0.smithi089.stdout:process_14_[93832]: created object 0... 2024-09-16T16:58:33.579 INFO:tasks.workunit.client.0.smithi089.stdout:process_14_[93832]: created object 25... 2024-09-16T16:58:33.579 INFO:tasks.workunit.client.0.smithi089.stdout:process_14_[93832]: created object 49... 2024-09-16T16:58:33.579 INFO:tasks.workunit.client.0.smithi089.stdout:process_14_[93832]: finishing. 2024-09-16T16:58:33.579 INFO:tasks.workunit.client.0.smithi089.stdout:process_14_[93832]: shutting down. 2024-09-16T16:58:34.017 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:34.017 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:34.017 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:34.018 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:34.018 INFO:tasks.workunit.client.0.smithi089.stdout:process_15_[93833]: starting. 2024-09-16T16:58:34.018 INFO:tasks.workunit.client.0.smithi089.stdout:process_15_[93833]: listing objects. 2024-09-16T16:58:34.018 INFO:tasks.workunit.client.0.smithi089.stdout:process_15_[93833]: listed object 0... 2024-09-16T16:58:34.018 INFO:tasks.workunit.client.0.smithi089.stdout:process_15_[93833]: listed object 25... 2024-09-16T16:58:34.018 INFO:tasks.workunit.client.0.smithi089.stdout:process_15_[93833]: listed object 50... 2024-09-16T16:58:34.018 INFO:tasks.workunit.client.0.smithi089.stdout:process_15_[93833]: listed object 75... 2024-09-16T16:58:34.018 INFO:tasks.workunit.client.0.smithi089.stdout:process_15_[93833]: listed object 100... 2024-09-16T16:58:34.018 INFO:tasks.workunit.client.0.smithi089.stdout:process_15_[93833]: listed object 125... 2024-09-16T16:58:34.018 INFO:tasks.workunit.client.0.smithi089.stdout:process_15_[93833]: saw 150 objects 2024-09-16T16:58:34.018 INFO:tasks.workunit.client.0.smithi089.stdout:process_15_[93833]: shutting down. 2024-09-16T16:58:34.431 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:34.431 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:34.431 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:34.431 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:34.431 INFO:tasks.workunit.client.0.smithi089.stdout:process_16_[93834]: starting. 2024-09-16T16:58:34.431 INFO:tasks.workunit.client.0.smithi089.stdout:process_16_[93834]: added 25 objects... 2024-09-16T16:58:34.432 INFO:tasks.workunit.client.0.smithi089.stdout:process_16_[93834]: added half of the objects 2024-09-16T16:58:34.432 INFO:tasks.workunit.client.0.smithi089.stdout:process_16_[93834]: added 50 objects... 2024-09-16T16:58:34.432 INFO:tasks.workunit.client.0.smithi089.stdout:process_16_[93834]: added 50 objects 2024-09-16T16:58:34.432 INFO:tasks.workunit.client.0.smithi089.stdout:process_16_[93834]: shutting down. 2024-09-16T16:58:35.404 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:35.404 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:35.404 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:35.404 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:35.404 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:35.404 INFO:tasks.workunit.client.0.smithi089.stdout:******* SUCCESS ********** 2024-09-16T16:58:35.406 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:58:35.406 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:58:35.406 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_open_pools_parallel 2024-09-16T16:58:38.673 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93900]: starting. 2024-09-16T16:58:38.673 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93900]: creating pool ceph_test_rados_open_pools_parallel.smithi089-93899 2024-09-16T16:58:38.673 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93900]: created object 0... 2024-09-16T16:58:38.673 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93900]: created object 25... 2024-09-16T16:58:38.673 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93900]: created object 49... 2024-09-16T16:58:38.674 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93900]: finishing. 2024-09-16T16:58:38.674 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93900]: shutting down. 2024-09-16T16:58:39.427 INFO:tasks.workunit.client.0.smithi089.stdout:process_2_[93901]: starting. 2024-09-16T16:58:39.427 INFO:tasks.workunit.client.0.smithi089.stdout:process_2_[93901]: rados_pool_create. 2024-09-16T16:58:39.427 INFO:tasks.workunit.client.0.smithi089.stdout:process_2_[93901]: rados_ioctx_create. 2024-09-16T16:58:39.427 INFO:tasks.workunit.client.0.smithi089.stdout:process_2_[93901]: shutting down. 2024-09-16T16:58:42.758 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:42.759 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[93937]: starting. 2024-09-16T16:58:42.759 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[93937]: creating pool ceph_test_rados_open_pools_parallel.smithi089-93899 2024-09-16T16:58:42.759 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[93937]: created object 0... 2024-09-16T16:58:42.759 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[93937]: created object 25... 2024-09-16T16:58:42.759 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[93937]: created object 49... 2024-09-16T16:58:42.759 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[93937]: finishing. 2024-09-16T16:58:42.759 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[93937]: shutting down. 2024-09-16T16:58:43.440 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:43.440 INFO:tasks.workunit.client.0.smithi089.stdout:process_4_[93938]: starting. 2024-09-16T16:58:43.440 INFO:tasks.workunit.client.0.smithi089.stdout:process_4_[93938]: rados_pool_create. 2024-09-16T16:58:43.440 INFO:tasks.workunit.client.0.smithi089.stdout:process_4_[93938]: rados_ioctx_create. 2024-09-16T16:58:43.440 INFO:tasks.workunit.client.0.smithi089.stdout:process_4_[93938]: shutting down. 2024-09-16T16:58:43.442 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:43.442 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:43.442 INFO:tasks.workunit.client.0.smithi089.stdout:******* SUCCESS ********** 2024-09-16T16:58:43.442 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T16:58:43.443 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:58:43.443 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_rados_delete_pools_parallel 2024-09-16T16:58:46.658 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93974]: starting. 2024-09-16T16:58:46.659 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93974]: creating pool ceph_test_rados_delete_pools_parallel.smithi089-93973 2024-09-16T16:58:46.659 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93974]: created object 0... 2024-09-16T16:58:46.659 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93974]: created object 25... 2024-09-16T16:58:46.659 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93974]: created object 49... 2024-09-16T16:58:46.659 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93974]: finishing. 2024-09-16T16:58:46.659 INFO:tasks.workunit.client.0.smithi089.stdout:process_1_[93974]: shutting down. 2024-09-16T16:58:47.456 INFO:tasks.workunit.client.0.smithi089.stdout:process_2_[93975]: starting. 2024-09-16T16:58:47.456 INFO:tasks.workunit.client.0.smithi089.stdout:process_2_[93975]: deleting pool ceph_test_rados_delete_pools_parallel.smithi089-93973 2024-09-16T16:58:47.456 INFO:tasks.workunit.client.0.smithi089.stdout:process_2_[93975]: shutting down. 2024-09-16T16:58:50.775 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:50.775 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[94010]: starting. 2024-09-16T16:58:50.776 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[94010]: creating pool ceph_test_rados_delete_pools_parallel.smithi089-93973 2024-09-16T16:58:50.776 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[94010]: created object 0... 2024-09-16T16:58:50.776 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[94010]: created object 25... 2024-09-16T16:58:50.776 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[94010]: created object 49... 2024-09-16T16:58:50.776 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[94010]: finishing. 2024-09-16T16:58:50.776 INFO:tasks.workunit.client.0.smithi089.stdout:process_3_[94010]: shutting down. 2024-09-16T16:58:50.928 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:50.928 INFO:tasks.workunit.client.0.smithi089.stdout:process_5_[94012]: starting. 2024-09-16T16:58:50.928 INFO:tasks.workunit.client.0.smithi089.stdout:process_5_[94012]: listing objects. 2024-09-16T16:58:50.928 INFO:tasks.workunit.client.0.smithi089.stdout:process_5_[94012]: listed object 0... 2024-09-16T16:58:50.928 INFO:tasks.workunit.client.0.smithi089.stdout:process_5_[94012]: listed object 25... 2024-09-16T16:58:50.928 INFO:tasks.workunit.client.0.smithi089.stdout:process_5_[94012]: saw 50 objects 2024-09-16T16:58:50.928 INFO:tasks.workunit.client.0.smithi089.stdout:process_5_[94012]: shutting down. 2024-09-16T16:58:51.474 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:51.474 INFO:tasks.workunit.client.0.smithi089.stdout:process_4_[94011]: starting. 2024-09-16T16:58:51.474 INFO:tasks.workunit.client.0.smithi089.stdout:process_4_[94011]: deleting pool ceph_test_rados_delete_pools_parallel.smithi089-93973 2024-09-16T16:58:51.474 INFO:tasks.workunit.client.0.smithi089.stdout:process_4_[94011]: shutting down. 2024-09-16T16:58:51.476 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:51.476 INFO:tasks.workunit.client.0.smithi089.stdout:******************************* 2024-09-16T16:58:51.476 INFO:tasks.workunit.client.0.smithi089.stdout:******* SUCCESS ********** 2024-09-16T16:58:51.477 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T16:58:51.477 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:58:51.477 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T16:58:51.477 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' cls = ec_io ']' 2024-09-16T16:58:51.477 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' cls = ec_list ']' 2024-09-16T16:58:51.477 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_neorados_cls 2024-09-16T16:58:51.496 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:58:51.496 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 1 test from 1 test suite. 2024-09-16T16:58:51.496 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:58:51.496 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from NeoRadosCls 2024-09-16T16:58:51.496 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosCls.DNE 2024-09-16T16:58:53.887 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosCls.DNE (2392 ms) 2024-09-16T16:58:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from NeoRadosCls (2392 ms total) 2024-09-16T16:58:53.888 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:58:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:58:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 1 test from 1 test suite ran. (2392 ms total) 2024-09-16T16:58:53.888 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 1 test. 2024-09-16T16:58:53.890 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T16:58:53.890 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:58:53.890 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T16:58:53.890 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' cmd = ec_io ']' 2024-09-16T16:58:53.890 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' cmd = ec_list ']' 2024-09-16T16:58:53.890 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_neorados_cmd 2024-09-16T16:58:53.910 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:58:53.910 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-16T16:58:53.910 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:58:53.910 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 3 tests from NeoRadosCmd 2024-09-16T16:58:53.910 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosCmd.MonDescribe 2024-09-16T16:58:55.901 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosCmd.MonDescribe (1991 ms) 2024-09-16T16:58:55.901 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosCmd.OSDCmd 2024-09-16T16:58:57.910 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosCmd.OSDCmd (2010 ms) 2024-09-16T16:58:57.911 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosCmd.PGCmd 2024-09-16T16:59:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosCmd.PGCmd (3013 ms) 2024-09-16T16:59:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 3 tests from NeoRadosCmd (7014 ms total) 2024-09-16T16:59:00.925 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:59:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:59:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 3 tests from 1 test suite ran. (7014 ms total) 2024-09-16T16:59:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 3 tests. 2024-09-16T16:59:00.927 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T16:59:00.928 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:59:00.928 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T16:59:00.928 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' handler_error = ec_io ']' 2024-09-16T16:59:00.928 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' handler_error = ec_list ']' 2024-09-16T16:59:00.928 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_neorados_handler_error 2024-09-16T16:59:00.946 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:59:00.946 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 1 test from 1 test suite. 2024-09-16T16:59:00.946 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:59:00.946 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from neocls_handler_error 2024-09-16T16:59:00.946 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] neocls_handler_error.test_handler_error 2024-09-16T16:59:03.942 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] neocls_handler_error.test_handler_error (2996 ms) 2024-09-16T16:59:03.942 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 1 test from neocls_handler_error (2996 ms total) 2024-09-16T16:59:03.942 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:59:03.942 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:59:03.942 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 1 test from 1 test suite ran. (2996 ms total) 2024-09-16T16:59:03.942 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 1 test. 2024-09-16T16:59:03.944 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T16:59:03.944 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:59:03.944 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T16:59:03.944 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' io = ec_io ']' 2024-09-16T16:59:03.944 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' io = ec_list ']' 2024-09-16T16:59:03.945 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_neorados_io 2024-09-16T16:59:03.965 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:59:03.965 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-16T16:59:03.965 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:59:03.965 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 14 tests from NeoRadosIo 2024-09-16T16:59:03.965 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosIo.Limits 2024-09-16T16:59:04.944 INFO:tasks.workunit.client.0.smithi089.stderr:Not supported by crimson yet. Skipped 2024-09-16T16:59:05.950 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosIo.Limits (1985 ms) 2024-09-16T16:59:05.951 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosIo.SimpleWrite 2024-09-16T16:59:08.965 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosIo.SimpleWrite (3015 ms) 2024-09-16T16:59:08.965 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosIo.ReadOp 2024-09-16T16:59:11.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosIo.ReadOp (2921 ms) 2024-09-16T16:59:11.886 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosIo.SparseRead 2024-09-16T16:59:14.894 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosIo.SparseRead (3009 ms) 2024-09-16T16:59:14.895 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosIo.RoundTrip 2024-09-16T16:59:17.918 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosIo.RoundTrip (3023 ms) 2024-09-16T16:59:17.918 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-09-16T16:59:20.932 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosIo.ReadIntoBuufferlist (3014 ms) 2024-09-16T16:59:20.932 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-09-16T16:59:23.940 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3008 ms) 2024-09-16T16:59:23.940 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-09-16T16:59:26.954 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosIo.WriteFullRoundTrip (3014 ms) 2024-09-16T16:59:26.954 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosIo.AppendRoundTrip 2024-09-16T16:59:29.971 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosIo.AppendRoundTrip (3018 ms) 2024-09-16T16:59:29.972 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosIo.Trunc 2024-09-16T16:59:32.980 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosIo.Trunc (3008 ms) 2024-09-16T16:59:32.980 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosIo.Remove 2024-09-16T16:59:36.000 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosIo.Remove (3020 ms) 2024-09-16T16:59:36.000 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosIo.XattrsRoundTrip 2024-09-16T16:59:39.016 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosIo.XattrsRoundTrip (3016 ms) 2024-09-16T16:59:39.017 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosIo.RmXattr 2024-09-16T16:59:41.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosIo.RmXattr (2881 ms) 2024-09-16T16:59:41.897 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosIo.GetXattrs 2024-09-16T16:59:44.904 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosIo.GetXattrs (3007 ms) 2024-09-16T16:59:44.904 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 14 tests from NeoRadosIo (40939 ms total) 2024-09-16T16:59:44.904 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T16:59:44.904 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T16:59:44.904 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 14 tests from 1 test suite ran. (40939 ms total) 2024-09-16T16:59:44.904 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 14 tests. 2024-09-16T16:59:44.909 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T16:59:44.909 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:59:44.909 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T16:59:44.909 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' ec_io = ec_io ']' 2024-09-16T16:59:44.910 INFO:tasks.workunit.client.0.smithi089.stdout:Skipping EC with Crimson 2024-09-16T16:59:44.910 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo 'Skipping EC with Crimson' 2024-09-16T16:59:44.910 INFO:tasks.workunit.client.0.smithi089.stderr:+ continue 2024-09-16T16:59:44.910 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T16:59:44.910 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T16:59:44.910 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T16:59:44.911 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' list = ec_io ']' 2024-09-16T16:59:44.911 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' list = ec_list ']' 2024-09-16T16:59:44.911 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_neorados_list 2024-09-16T16:59:44.929 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T16:59:44.929 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-16T16:59:44.929 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T16:59:44.929 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 3 tests from NeoradosList 2024-09-16T16:59:44.929 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoradosList.ListObjects 2024-09-16T16:59:47.919 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoradosList.ListObjects (2990 ms) 2024-09-16T16:59:47.919 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoradosList.ListObjectsNS 2024-09-16T16:59:50.932 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoradosList.ListObjectsNS (3013 ms) 2024-09-16T16:59:50.932 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoradosList.ListObjectsMany 2024-09-16T17:00:03.383 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoradosList.ListObjectsMany (12450 ms) 2024-09-16T17:00:03.383 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 3 tests from NeoradosList (18453 ms total) 2024-09-16T17:00:03.383 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T17:00:03.383 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T17:00:03.383 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 3 tests from 1 test suite ran. (18453 ms total) 2024-09-16T17:00:03.383 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 3 tests. 2024-09-16T17:00:03.385 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T17:00:03.385 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T17:00:03.385 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T17:00:03.386 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' ec_list = ec_io ']' 2024-09-16T17:00:03.386 INFO:tasks.workunit.client.0.smithi089.stdout:Skipping EC with Crimson 2024-09-16T17:00:03.386 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' ec_list = ec_list ']' 2024-09-16T17:00:03.387 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo 'Skipping EC with Crimson' 2024-09-16T17:00:03.387 INFO:tasks.workunit.client.0.smithi089.stderr:+ continue 2024-09-16T17:00:03.387 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T17:00:03.387 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T17:00:03.387 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T17:00:03.387 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' misc = ec_io ']' 2024-09-16T17:00:03.387 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' misc = ec_list ']' 2024-09-16T17:00:03.387 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_neorados_misc 2024-09-16T17:00:03.407 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T17:00:03.407 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-16T17:00:03.407 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T17:00:03.407 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 12 tests from NeoRadosMisc 2024-09-16T17:00:03.407 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosMisc.Version 2024-09-16T17:00:05.392 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosMisc.Version (1985 ms) 2024-09-16T17:00:05.392 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosMisc.WaitOSDMap 2024-09-16T17:00:07.398 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosMisc.WaitOSDMap (2006 ms) 2024-09-16T17:00:07.398 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosMisc.LongName 2024-09-16T17:00:10.419 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosMisc.LongName (3022 ms) 2024-09-16T17:00:10.420 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosMisc.LongLocator 2024-09-16T17:00:11.426 INFO:tasks.workunit.client.0.smithi089.stderr:Not supported by crimson yet. Skipped 2024-09-16T17:00:11.900 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosMisc.LongLocator (1480 ms) 2024-09-16T17:00:11.900 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosMisc.LongNamespace 2024-09-16T17:00:14.909 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosMisc.LongNamespace (3010 ms) 2024-09-16T17:00:14.910 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosMisc.LongAttrName 2024-09-16T17:00:17.933 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosMisc.LongAttrName (3023 ms) 2024-09-16T17:00:17.933 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosMisc.Exec 2024-09-16T17:00:20.943 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosMisc.Exec (3010 ms) 2024-09-16T17:00:20.943 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosMisc.Operate1 2024-09-16T17:00:23.958 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosMisc.Operate1 (3015 ms) 2024-09-16T17:00:23.958 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosMisc.Operate2 2024-09-16T17:00:26.973 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosMisc.Operate2 (3015 ms) 2024-09-16T17:00:26.973 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosMisc.BigObject 2024-09-16T17:00:29.989 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosMisc.BigObject (3016 ms) 2024-09-16T17:00:29.989 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosMisc.BigAttr 2024-09-16T17:00:31.905 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosMisc.BigAttr (1916 ms) 2024-09-16T17:00:31.906 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosMisc.WriteSame 2024-09-16T17:00:32.906 INFO:tasks.workunit.client.0.smithi089.stderr:Not supported by crimson yet. Skipped 2024-09-16T17:00:33.911 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosMisc.WriteSame (2006 ms) 2024-09-16T17:00:33.912 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 12 tests from NeoRadosMisc (30504 ms total) 2024-09-16T17:00:33.912 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T17:00:33.912 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T17:00:33.912 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 12 tests from 1 test suite ran. (30504 ms total) 2024-09-16T17:00:33.912 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 12 tests. 2024-09-16T17:00:33.916 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T17:00:33.916 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T17:00:33.916 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T17:00:33.916 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' pool = ec_io ']' 2024-09-16T17:00:33.916 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' pool = ec_list ']' 2024-09-16T17:00:33.917 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_neorados_pool 2024-09-16T17:00:33.937 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T17:00:33.937 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-16T17:00:33.937 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T17:00:33.937 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 6 tests from NeoRadosPools 2024-09-16T17:00:33.937 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosPools.PoolList 2024-09-16T17:00:35.922 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosPools.PoolList (1985 ms) 2024-09-16T17:00:35.922 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosPools.PoolLookup 2024-09-16T17:00:37.938 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosPools.PoolLookup (2016 ms) 2024-09-16T17:00:37.938 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-09-16T17:00:39.946 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosPools.PoolLookupOtherInstance (2008 ms) 2024-09-16T17:00:39.946 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosPools.PoolDelete 2024-09-16T17:00:43.912 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosPools.PoolDelete (3966 ms) 2024-09-16T17:00:43.912 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosPools.PoolCreateDelete 2024-09-16T17:00:45.916 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosPools.PoolCreateDelete (2005 ms) 2024-09-16T17:00:45.917 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-09-16T17:00:47.933 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosPools.PoolCreateWithCrushRule (2016 ms) 2024-09-16T17:00:47.933 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 6 tests from NeoRadosPools (13996 ms total) 2024-09-16T17:00:47.933 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T17:00:47.933 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T17:00:47.934 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 6 tests from 1 test suite ran. (13996 ms total) 2024-09-16T17:00:47.934 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 6 tests. 2024-09-16T17:00:47.936 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T17:00:47.936 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T17:00:47.937 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T17:00:47.937 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' read_operations = ec_io ']' 2024-09-16T17:00:47.937 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' read_operations = ec_list ']' 2024-09-16T17:00:47.937 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_neorados_read_operations 2024-09-16T17:00:47.958 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T17:00:47.958 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-16T17:00:47.958 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T17:00:47.958 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 14 tests from NeoRadosReadOps 2024-09-16T17:00:47.958 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosReadOps.SetOpFlags 2024-09-16T17:00:50.954 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosReadOps.SetOpFlags (2996 ms) 2024-09-16T17:00:50.954 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosReadOps.AssertExists 2024-09-16T17:00:53.961 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosReadOps.AssertExists (3007 ms) 2024-09-16T17:00:53.961 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosReadOps.AssertVersion 2024-09-16T17:00:56.974 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosReadOps.AssertVersion (3013 ms) 2024-09-16T17:00:56.974 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosReadOps.CmpXattr 2024-09-16T17:00:59.993 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosReadOps.CmpXattr (3019 ms) 2024-09-16T17:00:59.993 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosReadOps.Read 2024-09-16T17:01:03.009 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosReadOps.Read (3016 ms) 2024-09-16T17:01:03.009 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosReadOps.Checksum 2024-09-16T17:01:06.026 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosReadOps.Checksum (3017 ms) 2024-09-16T17:01:06.027 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosReadOps.RWOrderedRead 2024-09-16T17:01:09.036 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosReadOps.RWOrderedRead (3010 ms) 2024-09-16T17:01:09.036 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosReadOps.ShortRead 2024-09-16T17:01:11.915 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosReadOps.ShortRead (2879 ms) 2024-09-16T17:01:11.915 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosReadOps.Exec 2024-09-16T17:01:14.922 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosReadOps.Exec (3006 ms) 2024-09-16T17:01:14.922 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosReadOps.Stat 2024-09-16T17:01:17.942 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosReadOps.Stat (3021 ms) 2024-09-16T17:01:17.942 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosReadOps.Omap 2024-09-16T17:01:20.955 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosReadOps.Omap (3013 ms) 2024-09-16T17:01:20.955 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosReadOps.OmapNuls 2024-09-16T17:01:23.965 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosReadOps.OmapNuls (3010 ms) 2024-09-16T17:01:23.965 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosReadOps.GetXattrs 2024-09-16T17:01:26.976 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosReadOps.GetXattrs (3011 ms) 2024-09-16T17:01:26.976 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosReadOps.CmpExt 2024-09-16T17:01:30.006 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosReadOps.CmpExt (3030 ms) 2024-09-16T17:01:30.006 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 14 tests from NeoRadosReadOps (42048 ms total) 2024-09-16T17:01:30.006 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T17:01:30.006 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T17:01:30.006 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 14 tests from 1 test suite ran. (42048 ms total) 2024-09-16T17:01:30.006 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 14 tests. 2024-09-16T17:01:30.010 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T17:01:30.010 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T17:01:30.010 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T17:01:30.010 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' snapshots = ec_io ']' 2024-09-16T17:01:30.010 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' snapshots = ec_list ']' 2024-09-16T17:01:30.010 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_neorados_snapshots 2024-09-16T17:01:30.031 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T17:01:30.031 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-16T17:01:30.031 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T17:01:30.031 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 5 tests from NeoRadosSnapshots 2024-09-16T17:01:30.031 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosSnapshots.SnapList 2024-09-16T17:01:35.022 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosSnapshots.SnapList (4991 ms) 2024-09-16T17:01:35.023 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosSnapshots.SnapRemove 2024-09-16T17:01:40.042 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosSnapshots.SnapRemove (5020 ms) 2024-09-16T17:01:40.042 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosSnapshots.Rollback 2024-09-16T17:01:43.933 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosSnapshots.Rollback (3891 ms) 2024-09-16T17:01:43.933 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosSnapshots.SnapGetName 2024-09-16T17:01:48.956 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosSnapshots.SnapGetName (5023 ms) 2024-09-16T17:01:48.956 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-09-16T17:01:55.986 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosSnapshots.SnapCreateRemove (7030 ms) 2024-09-16T17:01:55.986 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 5 tests from NeoRadosSnapshots (25955 ms total) 2024-09-16T17:01:55.986 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T17:01:55.986 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps 2024-09-16T17:01:55.986 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-09-16T17:02:01.012 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosSelfManagedSnaps.Snap (5026 ms) 2024-09-16T17:02:01.012 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-09-16T17:02:01.928 INFO:tasks.workunit.client.0.smithi089.stderr:Not supported by crimson yet. Skipped 2024-09-16T17:02:02.932 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosSelfManagedSnaps.Rollback (1920 ms) 2024-09-16T17:02:02.932 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-09-16T17:02:03.933 INFO:tasks.workunit.client.0.smithi089.stderr:Not supported by crimson yet. Skipped 2024-09-16T17:02:04.937 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (2005 ms) 2024-09-16T17:02:04.937 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-09-16T17:02:10.963 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6026 ms) 2024-09-16T17:02:10.964 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-09-16T17:02:14.938 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosSelfManagedSnaps.OrderSnap (3975 ms) 2024-09-16T17:02:14.938 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-09-16T17:02:17.956 INFO:tasks.workunit.client.0.smithi089.stdout:Deleting snap 3 in pool ReusePurgedSnapsmithi089-94922-11. 2024-09-16T17:02:18.958 INFO:tasks.workunit.client.0.smithi089.stdout:Waiting for snaps to purge. 2024-09-16T17:02:34.420 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19482 ms) 2024-09-16T17:02:34.420 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps (38434 ms total) 2024-09-16T17:02:34.420 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T17:02:34.421 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T17:02:34.421 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 11 tests from 2 test suites ran. (64389 ms total) 2024-09-16T17:02:34.421 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 11 tests. 2024-09-16T17:02:34.424 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T17:02:34.425 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T17:02:34.425 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T17:02:34.425 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' watch_notify = ec_io ']' 2024-09-16T17:02:34.425 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' watch_notify = ec_list ']' 2024-09-16T17:02:34.425 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_neorados_watch_notify 2024-09-16T17:02:34.446 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T17:02:34.446 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-16T17:02:34.446 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T17:02:34.446 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 2 tests from NeoRadosWatchNotify 2024-09-16T17:02:34.446 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotify 2024-09-16T17:02:36.739 INFO:tasks.workunit.client.0.smithi089.stdout:handle_notify cookie 33949632 notify_id 2860448219141 notifier_gid 15921 2024-09-16T17:02:36.935 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosWatchNotify.WatchNotify (2489 ms) 2024-09-16T17:02:36.935 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-09-16T17:02:39.287 INFO:tasks.workunit.client.0.smithi089.stdout:Trying... 2024-09-16T17:02:39.289 INFO:tasks.workunit.client.0.smithi089.stdout:handle_notify cookie 46747888 notify_id 2873333121028 notifier_gid 15924 2024-09-16T17:02:39.290 INFO:tasks.workunit.client.0.smithi089.stdout:Waiting for 3.000000000s 2024-09-16T17:02:40.288 INFO:tasks.workunit.client.0.smithi089.stdout:Timed out. 2024-09-16T17:02:40.303 INFO:tasks.workunit.client.0.smithi089.stdout:Flushing... 2024-09-16T17:02:40.303 INFO:tasks.workunit.client.0.smithi089.stdout:Flushed... 2024-09-16T17:02:43.363 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (6428 ms) 2024-09-16T17:02:43.363 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 2 tests from NeoRadosWatchNotify (8917 ms total) 2024-09-16T17:02:43.364 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T17:02:43.364 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T17:02:43.364 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 2 tests from 1 test suite ran. (8917 ms total) 2024-09-16T17:02:43.364 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 2 tests. 2024-09-16T17:02:43.366 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T17:02:43.367 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T17:02:43.367 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T17:02:43.367 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' write_operations = ec_io ']' 2024-09-16T17:02:43.367 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' write_operations = ec_list ']' 2024-09-16T17:02:43.367 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph_test_neorados_write_operations 2024-09-16T17:02:43.387 INFO:tasks.workunit.client.0.smithi089.stdout:Running main() from gmock_main.cc 2024-09-16T17:02:43.387 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T17:02:43.387 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment set-up. 2024-09-16T17:02:43.387 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 7 tests from NeoRadosWriteOps 2024-09-16T17:02:43.387 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosWriteOps.AssertExists 2024-09-16T17:02:46.421 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosWriteOps.AssertExists (3034 ms) 2024-09-16T17:02:46.422 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosWriteOps.AssertVersion 2024-09-16T17:02:49.438 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosWriteOps.AssertVersion (3017 ms) 2024-09-16T17:02:49.439 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosWriteOps.Xattrs 2024-09-16T17:02:51.939 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosWriteOps.Xattrs (2501 ms) 2024-09-16T17:02:51.940 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosWriteOps.Write 2024-09-16T17:02:54.951 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosWriteOps.Write (3012 ms) 2024-09-16T17:02:54.951 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosWriteOps.Exec 2024-09-16T17:02:57.976 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosWriteOps.Exec (3025 ms) 2024-09-16T17:02:57.976 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosWriteOps.WriteSame 2024-09-16T17:03:00.992 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosWriteOps.WriteSame (3016 ms) 2024-09-16T17:03:00.992 INFO:tasks.workunit.client.0.smithi089.stdout:[ RUN ] NeoRadosWriteOps.CmpExt 2024-09-16T17:03:14.425 INFO:tasks.workunit.client.0.smithi089.stdout:[ OK ] NeoRadosWriteOps.CmpExt (13433 ms) 2024-09-16T17:03:14.426 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] 7 tests from NeoRadosWriteOps (31038 ms total) 2024-09-16T17:03:14.426 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-09-16T17:03:14.426 INFO:tasks.workunit.client.0.smithi089.stdout:[----------] Global test environment tear-down 2024-09-16T17:03:14.426 INFO:tasks.workunit.client.0.smithi089.stdout:[==========] 7 tests from 1 test suite ran. (31038 ms total) 2024-09-16T17:03:14.426 INFO:tasks.workunit.client.0.smithi089.stdout:[ PASSED ] 7 tests. 2024-09-16T17:03:14.428 INFO:tasks.workunit.client.0.smithi089.stderr:+ ret=0 2024-09-16T17:03:14.428 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T17:03:14.428 INFO:tasks.workunit.client.0.smithi089.stderr:+ exit 0 2024-09-16T17:03:14.428 INFO:tasks.workunit.client.0.smithi089.stderr:+ cleanup 2024-09-16T17:03:14.428 INFO:tasks.workunit.client.0.smithi089.stderr:+ pkill -P 29328 2024-09-16T17:03:14.458 INFO:tasks.workunit.client.0.smithi089.stderr:+ true 2024-09-16T17:03:14.459 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T17:03:14.459 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T17:03:14.536 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-09-16T17:03:14.538 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-09-16T17:03:14.538 DEBUG:teuthology.orchestra.run.smithi089:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-09-16T17:03:14.599 INFO:tasks.workunit.client.0.smithi089.stderr:++ uuidgen 2024-09-16T17:03:14.603 INFO:tasks.workunit.client.0.smithi089.stderr:+ p=ad5c36b8-029a-4232-9d54-ea1601f1a3e9 2024-09-16T17:03:14.604 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph osd pool create ad5c36b8-029a-4232-9d54-ea1601f1a3e9 12 2024-09-16T17:03:14.723 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.714+0000 7f78ea2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:14.725 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.724+0000 7f78ea2c8640 1 Processor -- start 2024-09-16T17:03:14.725 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.724+0000 7f78ea2c8640 1 -- start start 2024-09-16T17:03:14.726 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.725+0000 7f78ea2c8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f78e409e9b0 0x7f78e4137040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:14.726 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.725+0000 7f78ea2c8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e406eec0 con 0x7f78e4070300 2024-09-16T17:03:14.726 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.725+0000 7f78ea2c8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f78e406fef0 con 0x7f78e409e9b0 2024-09-16T17:03:14.726 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.725+0000 7f78e37fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f78e409e9b0 0x7f78e4137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:14.726 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.725+0000 7f78e3fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f78e4070300 0x7f78e409e2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37652/0 (socket says 172.21.15.89:37652) 2024-09-16T17:03:14.726 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.725+0000 7f78e37fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f78e409e9b0 0x7f78e4137040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33634/0 (socket says 172.21.15.89:33634) 2024-09-16T17:03:14.727 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.725+0000 7f78e3fff640 1 -- 172.21.15.89:0/2244703664 learned_addr learned my addr 172.21.15.89:0/2244703664 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:03:14.728 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.726+0000 7f78e37fe640 1 -- 172.21.15.89:0/2244703664 >> v1:172.21.15.89:6789/0 conn(0x7f78e4070300 legacy=0x7f78e409e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:14.728 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.726+0000 7f78e2ffd640 1 -- 172.21.15.89:0/2244703664 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4041969766 0 0) 0x7f78e406eec0 con 0x7f78e4070300 2024-09-16T17:03:14.728 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.726+0000 7f78e37fe640 1 -- 172.21.15.89:0/2244703664 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e409fde0 con 0x7f78e409e9b0 2024-09-16T17:03:14.728 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.726+0000 7f78e37fe640 1 --2- 172.21.15.89:0/2244703664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e409e9b0 0x7f78e4137040 crc :-1 s=READY pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9211917536854c31 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:14.728 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.726+0000 7f78e2ffd640 1 -- 172.21.15.89:0/2244703664 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f78d800ad10 con 0x7f78e409e9b0 2024-09-16T17:03:14.728 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.726+0000 7f78e2ffd640 1 -- 172.21.15.89:0/2244703664 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f78d800ae70 con 0x7f78e409e9b0 2024-09-16T17:03:14.729 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.726+0000 7f78e2ffd640 1 -- 172.21.15.89:0/2244703664 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f78d800f470 con 0x7f78e409e9b0 2024-09-16T17:03:14.729 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.727+0000 7f78ea2c8640 1 -- 172.21.15.89:0/2244703664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e409e9b0 msgr2=0x7f78e4137040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:14.729 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.727+0000 7f78ea2c8640 1 --2- 172.21.15.89:0/2244703664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e409e9b0 0x7f78e4137040 crc :-1 s=READY pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:14.729 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.727+0000 7f78ea2c8640 1 -- 172.21.15.89:0/2244703664 shutdown_connections 2024-09-16T17:03:14.729 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.727+0000 7f78ea2c8640 1 --2- 172.21.15.89:0/2244703664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e409e9b0 0x7f78e4137040 unknown :-1 s=CLOSED pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:14.729 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.727+0000 7f78ea2c8640 1 -- 172.21.15.89:0/2244703664 >> 172.21.15.89:0/2244703664 conn(0x7f78e40a1530 msgr2=0x7f78e40a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:14.729 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.727+0000 7f78ea2c8640 1 -- 172.21.15.89:0/2244703664 shutdown_connections 2024-09-16T17:03:14.729 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.727+0000 7f78ea2c8640 1 -- 172.21.15.89:0/2244703664 wait complete. 2024-09-16T17:03:14.729 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.727+0000 7f78ea2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:14.730 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.729+0000 7f78ea2c8640 1 Processor -- start 2024-09-16T17:03:14.730 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.729+0000 7f78ea2c8640 1 -- start start 2024-09-16T17:03:14.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.730+0000 7f78ea2c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e4070300 0x7f78e411ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:14.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.730+0000 7f78ea2c8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f78e4132e60 con 0x7f78e4070300 2024-09-16T17:03:14.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.730+0000 7f78e3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e4070300 0x7f78e411ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:14.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.730+0000 7f78e3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e4070300 0x7f78e411ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33646/0 (socket says 172.21.15.89:33646) 2024-09-16T17:03:14.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.730+0000 7f78e3fff640 1 -- 172.21.15.89:0/2152370555 learned_addr learned my addr 172.21.15.89:0/2152370555 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:14.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.731+0000 7f78e3fff640 1 -- 172.21.15.89:0/2152370555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e4073040 con 0x7f78e4070300 2024-09-16T17:03:14.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.731+0000 7f78e3fff640 1 --2- 172.21.15.89:0/2152370555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e4070300 0x7f78e411ee20 crc :-1 s=READY pgs=12840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:14.733 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.731+0000 7f78e0ff9640 1 -- 172.21.15.89:0/2152370555 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f78d4004b80 con 0x7f78e4070300 2024-09-16T17:03:14.733 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.731+0000 7f78e0ff9640 1 -- 172.21.15.89:0/2152370555 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f78d4004ce0 con 0x7f78e4070300 2024-09-16T17:03:14.733 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.731+0000 7f78ea2c8640 1 -- 172.21.15.89:0/2152370555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e4122db0 con 0x7f78e4070300 2024-09-16T17:03:14.733 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.731+0000 7f78e0ff9640 1 -- 172.21.15.89:0/2152370555 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f78d4007120 con 0x7f78e4070300 2024-09-16T17:03:14.733 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.731+0000 7f78ea2c8640 1 -- 172.21.15.89:0/2152370555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e4120850 con 0x7f78e4070300 2024-09-16T17:03:14.733 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.732+0000 7f78ea2c8640 1 -- 172.21.15.89:0/2152370555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e4121080 con 0x7f78e4070300 2024-09-16T17:03:14.734 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.733+0000 7f78e0ff9640 1 -- 172.21.15.89:0/2152370555 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f78d40072d0 con 0x7f78e4070300 2024-09-16T17:03:14.734 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.733+0000 7f78e0ff9640 1 --2- 172.21.15.89:0/2152370555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f78d003e960 0x7f78d0040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:14.734 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.733+0000 7f78e0ff9640 1 -- 172.21.15.89:0/2152370555 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(695..695 src has 406..695) ==== 3431+0+0 (crc 0 0 0) 0x7f78d404faa0 con 0x7f78e4070300 2024-09-16T17:03:14.734 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.733+0000 7f78e37fe640 1 --2- 172.21.15.89:0/2152370555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f78d003e960 0x7f78d0040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:14.735 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.734+0000 7f78e37fe640 1 --2- 172.21.15.89:0/2152370555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f78d003e960 0x7f78d0040e70 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:14.740 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.739+0000 7f78e0ff9640 1 -- 172.21.15.89:0/2152370555 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f78d400f230 con 0x7f78e4070300 2024-09-16T17:03:14.933 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:14.932+0000 7f78ea2c8640 1 -- 172.21.15.89:0/2152370555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "pg_num": 12} v 0) -- 0x7f78e406d040 con 0x7f78e4070300 2024-09-16T17:03:15.435 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.433+0000 7f78e0ff9640 1 -- 172.21.15.89:0/2152370555 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "pg_num": 12}]=0 pool 'ad5c36b8-029a-4232-9d54-ea1601f1a3e9' created v696) ==== 176+0+0 (crc 0 0 0) 0x7f78d400a0c0 con 0x7f78e4070300 2024-09-16T17:03:15.576 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.575+0000 7f78ea2c8640 1 -- 172.21.15.89:0/2152370555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "pg_num": 12} v 0) -- 0x7f78e4121670 con 0x7f78e4070300 2024-09-16T17:03:15.576 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.575+0000 7f78e0ff9640 1 -- 172.21.15.89:0/2152370555 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "pg_num": 12}]=0 pool 'ad5c36b8-029a-4232-9d54-ea1601f1a3e9' already exists v696) ==== 183+0+0 (crc 0 0 0) 0x7f78d400a7b0 con 0x7f78e4070300 2024-09-16T17:03:15.577 INFO:tasks.workunit.client.0.smithi089.stderr:pool 'ad5c36b8-029a-4232-9d54-ea1601f1a3e9' already exists 2024-09-16T17:03:15.579 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.577+0000 7f78ea2c8640 1 -- 172.21.15.89:0/2152370555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f78d003e960 msgr2=0x7f78d0040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:15.579 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.577+0000 7f78ea2c8640 1 --2- 172.21.15.89:0/2152370555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f78d003e960 0x7f78d0040e70 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:15.579 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.578+0000 7f78ea2c8640 1 -- 172.21.15.89:0/2152370555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e4070300 msgr2=0x7f78e411ee20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:15.579 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.578+0000 7f78ea2c8640 1 --2- 172.21.15.89:0/2152370555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e4070300 0x7f78e411ee20 crc :-1 s=READY pgs=12840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:15.579 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.578+0000 7f78ea2c8640 1 -- 172.21.15.89:0/2152370555 shutdown_connections 2024-09-16T17:03:15.579 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.578+0000 7f78ea2c8640 1 --2- 172.21.15.89:0/2152370555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f78d003e960 0x7f78d0040e70 unknown :-1 s=CLOSED pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:15.579 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.578+0000 7f78ea2c8640 1 --2- 172.21.15.89:0/2152370555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e4070300 0x7f78e411ee20 unknown :-1 s=CLOSED pgs=12840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:15.579 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.578+0000 7f78ea2c8640 1 -- 172.21.15.89:0/2152370555 >> 172.21.15.89:0/2152370555 conn(0x7f78e40a1530 msgr2=0x7f78e41b7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:15.580 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.578+0000 7f78ea2c8640 1 -- 172.21.15.89:0/2152370555 shutdown_connections 2024-09-16T17:03:15.580 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.578+0000 7f78ea2c8640 1 -- 172.21.15.89:0/2152370555 wait complete. 2024-09-16T17:03:15.588 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph osd pool set-quota ad5c36b8-029a-4232-9d54-ea1601f1a3e9 max_objects 10 2024-09-16T17:03:15.679 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.670+0000 7f53dc711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:15.680 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.680+0000 7f53dc711640 1 Processor -- start 2024-09-16T17:03:15.680 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.680+0000 7f53dc711640 1 -- start start 2024-09-16T17:03:15.684 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.681+0000 7f53dc711640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f53d4138880 0x7f53d413aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:15.684 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.681+0000 7f53dc711640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d40a2460 con 0x7f53d40a2df0 2024-09-16T17:03:15.684 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.681+0000 7f53dc711640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f53d40a3d40 con 0x7f53d4138880 2024-09-16T17:03:15.684 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.681+0000 7f53da4ad640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f53d40a2df0 0x7f53d40a3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37664/0 (socket says 172.21.15.89:37664) 2024-09-16T17:03:15.684 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.681+0000 7f53da4ad640 1 -- 172.21.15.89:0/784106166 learned_addr learned my addr 172.21.15.89:0/784106166 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:03:15.684 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.681+0000 7f53d9cac640 1 --2- 172.21.15.89:0/784106166 >> v2:172.21.15.89:3300/0 conn(0x7f53d4138880 0x7f53d413aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:15.684 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.681+0000 7f53d94ab640 1 -- 172.21.15.89:0/784106166 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 475522664 0 0) 0x7f53d40a2460 con 0x7f53d40a2df0 2024-09-16T17:03:15.684 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.681+0000 7f53d94ab640 1 -- 172.21.15.89:0/784106166 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53bc003580 con 0x7f53d40a2df0 2024-09-16T17:03:15.685 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.681+0000 7f53d9cac640 1 -- 172.21.15.89:0/784106166 >> v1:172.21.15.89:6789/0 conn(0x7f53d40a2df0 legacy=0x7f53d40a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:15.685 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.681+0000 7f53d9cac640 1 -- 172.21.15.89:0/784106166 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d40a29a0 con 0x7f53d4138880 2024-09-16T17:03:15.685 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.682+0000 7f53d9cac640 1 --2- 172.21.15.89:0/784106166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53d4138880 0x7f53d413aca0 crc :-1 s=READY pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fbe7555833b185 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:15.685 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.682+0000 7f53d94ab640 1 -- 172.21.15.89:0/784106166 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f53c8009d90 con 0x7f53d4138880 2024-09-16T17:03:15.685 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.682+0000 7f53d94ab640 1 -- 172.21.15.89:0/784106166 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f53c800e230 con 0x7f53d4138880 2024-09-16T17:03:15.685 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.682+0000 7f53d94ab640 1 -- 172.21.15.89:0/784106166 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f53c800e4d0 con 0x7f53d4138880 2024-09-16T17:03:15.685 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.682+0000 7f53dc711640 1 -- 172.21.15.89:0/784106166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53d4138880 msgr2=0x7f53d413aca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:15.685 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.682+0000 7f53dc711640 1 --2- 172.21.15.89:0/784106166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53d4138880 0x7f53d413aca0 crc :-1 s=READY pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:15.685 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.682+0000 7f53dc711640 1 -- 172.21.15.89:0/784106166 shutdown_connections 2024-09-16T17:03:15.685 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.682+0000 7f53dc711640 1 --2- 172.21.15.89:0/784106166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53d4138880 0x7f53d413aca0 unknown :-1 s=CLOSED pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:15.685 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.683+0000 7f53dc711640 1 -- 172.21.15.89:0/784106166 >> 172.21.15.89:0/784106166 conn(0x7f53d40a4ad0 msgr2=0x7f53d40a4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:15.686 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.683+0000 7f53dc711640 1 -- 172.21.15.89:0/784106166 shutdown_connections 2024-09-16T17:03:15.686 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.683+0000 7f53dc711640 1 -- 172.21.15.89:0/784106166 wait complete. 2024-09-16T17:03:15.686 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.683+0000 7f53dc711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:15.687 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.684+0000 7f53dc711640 1 Processor -- start 2024-09-16T17:03:15.687 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.684+0000 7f53dc711640 1 -- start start 2024-09-16T17:03:15.687 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.685+0000 7f53dc711640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53d40a2df0 0x7f53d4132c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:15.688 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.685+0000 7f53dc711640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4121030 con 0x7f53d40a2df0 2024-09-16T17:03:15.688 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.685+0000 7f53da4ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53d40a2df0 0x7f53d4132c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:15.688 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.685+0000 7f53da4ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53d40a2df0 0x7f53d4132c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33670/0 (socket says 172.21.15.89:33670) 2024-09-16T17:03:15.688 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.685+0000 7f53da4ad640 1 -- 172.21.15.89:0/2947792877 learned_addr learned my addr 172.21.15.89:0/2947792877 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:15.688 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.686+0000 7f53da4ad640 1 -- 172.21.15.89:0/2947792877 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d4123c90 con 0x7f53d40a2df0 2024-09-16T17:03:15.688 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.686+0000 7f53da4ad640 1 --2- 172.21.15.89:0/2947792877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53d40a2df0 0x7f53d4132c30 crc :-1 s=READY pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:15.688 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.686+0000 7f53d2ffd640 1 -- 172.21.15.89:0/2947792877 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f53c40070b0 con 0x7f53d40a2df0 2024-09-16T17:03:15.688 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.686+0000 7f53d2ffd640 1 -- 172.21.15.89:0/2947792877 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f53c4007210 con 0x7f53d40a2df0 2024-09-16T17:03:15.688 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.686+0000 7f53d2ffd640 1 -- 172.21.15.89:0/2947792877 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f53c40074b0 con 0x7f53d40a2df0 2024-09-16T17:03:15.688 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.686+0000 7f53dc711640 1 -- 172.21.15.89:0/2947792877 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d4121730 con 0x7f53d40a2df0 2024-09-16T17:03:15.689 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.686+0000 7f53dc711640 1 -- 172.21.15.89:0/2947792877 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d4122550 con 0x7f53d40a2df0 2024-09-16T17:03:15.689 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.687+0000 7f53d2ffd640 1 -- 172.21.15.89:0/2947792877 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f53c4007610 con 0x7f53d40a2df0 2024-09-16T17:03:15.690 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.687+0000 7f53dc711640 1 -- 172.21.15.89:0/2947792877 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d409c8a0 con 0x7f53d40a2df0 2024-09-16T17:03:15.690 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.687+0000 7f53d2ffd640 1 --2- 172.21.15.89:0/2947792877 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f53c003e930 0x7f53c0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:15.690 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.687+0000 7f53d2ffd640 1 -- 172.21.15.89:0/2947792877 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(696..696 src has 406..696) ==== 3806+0+0 (crc 0 0 0) 0x7f53c4050400 con 0x7f53d40a2df0 2024-09-16T17:03:15.690 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.688+0000 7f53d9cac640 1 --2- 172.21.15.89:0/2947792877 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f53c003e930 0x7f53c0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:15.690 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.688+0000 7f53d9cac640 1 --2- 172.21.15.89:0/2947792877 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f53c003e930 0x7f53c0040e40 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:15.694 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.693+0000 7f53d2ffd640 1 -- 172.21.15.89:0/2947792877 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f53c40096b0 con 0x7f53d40a2df0 2024-09-16T17:03:15.868 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:15.867+0000 7f53dc711640 1 -- 172.21.15.89:0/2947792877 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_objects", "val": "10"} v 0) -- 0x7f53d40698c0 con 0x7f53d40a2df0 2024-09-16T17:03:16.438 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:16.438+0000 7f53d2ffd640 1 -- 172.21.15.89:0/2947792877 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 v697) ==== 223+0+0 (crc 0 0 0) 0x7f53c40090b0 con 0x7f53d40a2df0 2024-09-16T17:03:16.596 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:16.595+0000 7f53dc711640 1 -- 172.21.15.89:0/2947792877 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_objects", "val": "10"} v 0) -- 0x7f53d4123010 con 0x7f53d40a2df0 2024-09-16T17:03:16.940 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:16.939+0000 7f53d2ffd640 1 -- 172.21.15.89:0/2947792877 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 v698) ==== 223+0+0 (crc 0 0 0) 0x7f53c4009290 con 0x7f53d40a2df0 2024-09-16T17:03:16.940 INFO:tasks.workunit.client.0.smithi089.stderr:set-quota max_objects = 10 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 2024-09-16T17:03:16.944 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:16.943+0000 7f53dc711640 1 -- 172.21.15.89:0/2947792877 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f53c003e930 msgr2=0x7f53c0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:16.944 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:16.943+0000 7f53dc711640 1 --2- 172.21.15.89:0/2947792877 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f53c003e930 0x7f53c0040e40 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:16.944 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:16.943+0000 7f53dc711640 1 -- 172.21.15.89:0/2947792877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53d40a2df0 msgr2=0x7f53d4132c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:16.944 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:16.943+0000 7f53dc711640 1 --2- 172.21.15.89:0/2947792877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53d40a2df0 0x7f53d4132c30 crc :-1 s=READY pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:16.944 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:16.943+0000 7f53dc711640 1 -- 172.21.15.89:0/2947792877 shutdown_connections 2024-09-16T17:03:16.945 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:16.943+0000 7f53dc711640 1 --2- 172.21.15.89:0/2947792877 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f53c003e930 0x7f53c0040e40 unknown :-1 s=CLOSED pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:16.945 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:16.943+0000 7f53dc711640 1 --2- 172.21.15.89:0/2947792877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53d40a2df0 0x7f53d4132c30 unknown :-1 s=CLOSED pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:16.945 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:16.943+0000 7f53dc711640 1 -- 172.21.15.89:0/2947792877 >> 172.21.15.89:0/2947792877 conn(0x7f53d40a4ad0 msgr2=0x7f53d4135420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:16.945 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:16.943+0000 7f53dc711640 1 -- 172.21.15.89:0/2947792877 shutdown_connections 2024-09-16T17:03:16.945 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:16.943+0000 7f53dc711640 1 -- 172.21.15.89:0/2947792877 wait complete. 2024-09-16T17:03:16.960 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph osd pool application enable ad5c36b8-029a-4232-9d54-ea1601f1a3e9 rados 2024-09-16T17:03:17.061 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.051+0000 7fc558eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:17.062 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.061+0000 7fc558eac640 1 Processor -- start 2024-09-16T17:03:17.062 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.061+0000 7fc558eac640 1 -- start start 2024-09-16T17:03:17.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.062+0000 7fc558eac640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5541355a0 0x7fc5541379c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:17.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.062+0000 7fc558eac640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55412fc40 con 0x7fc55412f120 2024-09-16T17:03:17.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.062+0000 7fc558eac640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7fc5540711e0 con 0x7fc5541355a0 2024-09-16T17:03:17.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.062+0000 7fc549d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5541355a0 0x7fc5541379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:17.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.062+0000 7fc55259c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc55412f120 0x7fc55412f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37676/0 (socket says 172.21.15.89:37676) 2024-09-16T17:03:17.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.062+0000 7fc55259c640 1 -- 172.21.15.89:0/2580447866 learned_addr learned my addr 172.21.15.89:0/2580447866 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:03:17.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.062+0000 7fc549d9b640 1 --2- 172.21.15.89:0/2580447866 >> v2:172.21.15.89:3300/0 conn(0x7fc5541355a0 0x7fc5541379c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33672/0 (socket says 172.21.15.89:33672) 2024-09-16T17:03:17.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.062+0000 7fc551d9b640 1 -- 172.21.15.89:0/2580447866 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 512498299 0 0) 0x7fc55412fc40 con 0x7fc55412f120 2024-09-16T17:03:17.065 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.062+0000 7fc551d9b640 1 -- 172.21.15.89:0/2580447866 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc540003580 con 0x7fc55412f120 2024-09-16T17:03:17.065 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.062+0000 7fc549d9b640 1 -- 172.21.15.89:0/2580447866 >> v1:172.21.15.89:6789/0 conn(0x7fc55412f120 legacy=0x7fc55412f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:17.065 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.062+0000 7fc549d9b640 1 -- 172.21.15.89:0/2580447866 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5540a3060 con 0x7fc5541355a0 2024-09-16T17:03:17.065 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.063+0000 7fc549d9b640 1 --2- 172.21.15.89:0/2580447866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5541355a0 0x7fc5541379c0 crc :-1 s=READY pgs=12845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e754b6c5380b3c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:17.065 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.063+0000 7fc551d9b640 1 -- 172.21.15.89:0/2580447866 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc53c009d90 con 0x7fc5541355a0 2024-09-16T17:03:17.065 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.063+0000 7fc551d9b640 1 -- 172.21.15.89:0/2580447866 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc53c00e230 con 0x7fc5541355a0 2024-09-16T17:03:17.065 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.063+0000 7fc551d9b640 1 -- 172.21.15.89:0/2580447866 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc53c00e4d0 con 0x7fc5541355a0 2024-09-16T17:03:17.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.063+0000 7fc558eac640 1 -- 172.21.15.89:0/2580447866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5541355a0 msgr2=0x7fc5541379c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:17.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.063+0000 7fc558eac640 1 --2- 172.21.15.89:0/2580447866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5541355a0 0x7fc5541379c0 crc :-1 s=READY pgs=12845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:17.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.063+0000 7fc558eac640 1 -- 172.21.15.89:0/2580447866 shutdown_connections 2024-09-16T17:03:17.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.063+0000 7fc558eac640 1 --2- 172.21.15.89:0/2580447866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5541355a0 0x7fc5541379c0 unknown :-1 s=CLOSED pgs=12845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:17.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.064+0000 7fc558eac640 1 -- 172.21.15.89:0/2580447866 >> 172.21.15.89:0/2580447866 conn(0x7fc5540a1530 msgr2=0x7fc5540a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:17.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.064+0000 7fc558eac640 1 -- 172.21.15.89:0/2580447866 shutdown_connections 2024-09-16T17:03:17.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.064+0000 7fc558eac640 1 -- 172.21.15.89:0/2580447866 wait complete. 2024-09-16T17:03:17.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.064+0000 7fc558eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:17.067 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.066+0000 7fc558eac640 1 Processor -- start 2024-09-16T17:03:17.067 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.066+0000 7fc558eac640 1 -- start start 2024-09-16T17:03:17.068 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.067+0000 7fc558eac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc55412f120 0x7fc5541c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:17.069 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.067+0000 7fc558eac640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc55411f840 con 0x7fc55412f120 2024-09-16T17:03:17.069 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.067+0000 7fc55259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc55412f120 0x7fc5541c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:17.069 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.067+0000 7fc55259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc55412f120 0x7fc5541c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33674/0 (socket says 172.21.15.89:33674) 2024-09-16T17:03:17.069 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.067+0000 7fc55259c640 1 -- 172.21.15.89:0/1900002026 learned_addr learned my addr 172.21.15.89:0/1900002026 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:17.069 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.067+0000 7fc55259c640 1 -- 172.21.15.89:0/1900002026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55411bb70 con 0x7fc55412f120 2024-09-16T17:03:17.069 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.067+0000 7fc55259c640 1 --2- 172.21.15.89:0/1900002026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc55412f120 0x7fc5541c6b70 crc :-1 s=READY pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:17.069 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.067+0000 7fc54b7fe640 1 -- 172.21.15.89:0/1900002026 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc54400ec60 con 0x7fc55412f120 2024-09-16T17:03:17.069 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.067+0000 7fc54b7fe640 1 -- 172.21.15.89:0/1900002026 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc54400edc0 con 0x7fc55412f120 2024-09-16T17:03:17.069 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.067+0000 7fc558eac640 1 -- 172.21.15.89:0/1900002026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc55411b860 con 0x7fc55412f120 2024-09-16T17:03:17.069 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.068+0000 7fc54b7fe640 1 -- 172.21.15.89:0/1900002026 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc544005a60 con 0x7fc55412f120 2024-09-16T17:03:17.069 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.068+0000 7fc558eac640 1 -- 172.21.15.89:0/1900002026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc55411e000 con 0x7fc55412f120 2024-09-16T17:03:17.070 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.068+0000 7fc558eac640 1 -- 172.21.15.89:0/1900002026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc55409de00 con 0x7fc55412f120 2024-09-16T17:03:17.070 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.069+0000 7fc54b7fe640 1 -- 172.21.15.89:0/1900002026 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc544005bc0 con 0x7fc55412f120 2024-09-16T17:03:17.070 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.069+0000 7fc54b7fe640 1 --2- 172.21.15.89:0/1900002026 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc53403e960 0x7fc534040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:17.070 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.069+0000 7fc54b7fe640 1 -- 172.21.15.89:0/1900002026 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(698..698 src has 406..698) ==== 3806+0+0 (crc 0 0 0) 0x7fc5440529c0 con 0x7fc55412f120 2024-09-16T17:03:17.070 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.069+0000 7fc549d9b640 1 --2- 172.21.15.89:0/1900002026 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc53403e960 0x7fc534040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:17.071 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.070+0000 7fc549d9b640 1 --2- 172.21.15.89:0/1900002026 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc53403e960 0x7fc534040e70 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:17.075 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.074+0000 7fc54b7fe640 1 -- 172.21.15.89:0/1900002026 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc54400b4a0 con 0x7fc55412f120 2024-09-16T17:03:17.252 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.251+0000 7fc558eac640 1 -- 172.21.15.89:0/1900002026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "app": "rados"} v 0) -- 0x7fc55406d040 con 0x7fc55412f120 2024-09-16T17:03:17.943 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:17.942+0000 7fc54b7fe640 1 -- 172.21.15.89:0/1900002026 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "app": "rados"}]=0 enabled application 'rados' on pool 'ad5c36b8-029a-4232-9d54-ea1601f1a3e9' v699) ==== 213+0+0 (crc 0 0 0) 0x7fc54400b2c0 con 0x7fc55412f120 2024-09-16T17:03:18.074 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:18.073+0000 7fc558eac640 1 -- 172.21.15.89:0/1900002026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "app": "rados"} v 0) -- 0x7fc55411db00 con 0x7fc55412f120 2024-09-16T17:03:18.945 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:18.944+0000 7fc54b7fe640 1 -- 172.21.15.89:0/1900002026 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "app": "rados"}]=0 enabled application 'rados' on pool 'ad5c36b8-029a-4232-9d54-ea1601f1a3e9' v700) ==== 213+0+0 (crc 0 0 0) 0x7fc54400b2c0 con 0x7fc55412f120 2024-09-16T17:03:18.945 INFO:tasks.workunit.client.0.smithi089.stderr:enabled application 'rados' on pool 'ad5c36b8-029a-4232-9d54-ea1601f1a3e9' 2024-09-16T17:03:18.949 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:18.947+0000 7fc558eac640 1 -- 172.21.15.89:0/1900002026 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc53403e960 msgr2=0x7fc534040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:18.949 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:18.947+0000 7fc558eac640 1 --2- 172.21.15.89:0/1900002026 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc53403e960 0x7fc534040e70 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:18.949 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:18.947+0000 7fc558eac640 1 -- 172.21.15.89:0/1900002026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc55412f120 msgr2=0x7fc5541c6b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:18.949 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:18.947+0000 7fc558eac640 1 --2- 172.21.15.89:0/1900002026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc55412f120 0x7fc5541c6b70 crc :-1 s=READY pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:18.949 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:18.948+0000 7fc558eac640 1 -- 172.21.15.89:0/1900002026 shutdown_connections 2024-09-16T17:03:18.949 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:18.948+0000 7fc558eac640 1 --2- 172.21.15.89:0/1900002026 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc53403e960 0x7fc534040e70 unknown :-1 s=CLOSED pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:18.949 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:18.948+0000 7fc558eac640 1 --2- 172.21.15.89:0/1900002026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc55412f120 0x7fc5541c6b70 unknown :-1 s=CLOSED pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:18.949 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:18.948+0000 7fc558eac640 1 -- 172.21.15.89:0/1900002026 >> 172.21.15.89:0/1900002026 conn(0x7fc5540a1530 msgr2=0x7fc5540733f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:18.949 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:18.948+0000 7fc558eac640 1 -- 172.21.15.89:0/1900002026 shutdown_connections 2024-09-16T17:03:18.949 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:18.948+0000 7fc558eac640 1 -- 172.21.15.89:0/1900002026 wait complete. 2024-09-16T17:03:18.966 INFO:tasks.workunit.client.0.smithi089.stderr:++ seq 1 10 2024-09-16T17:03:19.090 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:19.090 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p ad5c36b8-029a-4232-9d54-ea1601f1a3e9 put obj1 /etc/passwd 2024-09-16T17:03:19.129 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.128+0000 7f9ec302bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.134 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.133+0000 7f9ec302bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.134 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.133+0000 7f9ec302bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.134 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.134+0000 7f9ec302bec0 1 Processor -- start 2024-09-16T17:03:19.134 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.134+0000 7f9ec302bec0 1 -- start start 2024-09-16T17:03:19.136 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.135+0000 7f9ec302bec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x130a120 0x1424090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.136 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.135+0000 7f9ec302bec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x126e520 con 0x130a120 2024-09-16T17:03:19.136 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.135+0000 7f9ebb03f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x130a120 0x1424090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.136 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.135+0000 7f9ebb03f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x130a120 0x1424090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60052/0 (socket says 172.21.15.89:60052) 2024-09-16T17:03:19.136 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.135+0000 7f9ebb03f640 1 -- 172.21.15.89:0/2608439220 learned_addr learned my addr 172.21.15.89:0/2608439220 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.137 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.135+0000 7f9ebb03f640 1 -- 172.21.15.89:0/2608439220 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x120ae10 con 0x130a120 2024-09-16T17:03:19.137 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.135+0000 7f9ebb03f640 1 --2- 172.21.15.89:0/2608439220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x130a120 0x1424090 crc :-1 s=READY pgs=12849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1438b8eedf08187b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.137 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.135+0000 7f9eb983c640 1 -- 172.21.15.89:0/2608439220 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9ea402dbb0 con 0x130a120 2024-09-16T17:03:19.137 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.135+0000 7f9eb983c640 1 -- 172.21.15.89:0/2608439220 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9ea4033040 con 0x130a120 2024-09-16T17:03:19.137 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.135+0000 7f9eb983c640 1 -- 172.21.15.89:0/2608439220 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9ea402de40 con 0x130a120 2024-09-16T17:03:19.138 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.136+0000 7f9ec302bec0 1 -- 172.21.15.89:0/2608439220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x130a120 msgr2=0x1424090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.138 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.136+0000 7f9ec302bec0 1 --2- 172.21.15.89:0/2608439220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x130a120 0x1424090 crc :-1 s=READY pgs=12849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.138 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.136+0000 7f9ec302bec0 1 -- 172.21.15.89:0/2608439220 shutdown_connections 2024-09-16T17:03:19.138 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.136+0000 7f9ec302bec0 1 --2- 172.21.15.89:0/2608439220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x130a120 0x1424090 unknown :-1 s=CLOSED pgs=12849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.138 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.136+0000 7f9ec302bec0 1 -- 172.21.15.89:0/2608439220 >> 172.21.15.89:0/2608439220 conn(0x122e770 msgr2=0x1304110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.138 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.136+0000 7f9ec302bec0 1 -- 172.21.15.89:0/2608439220 shutdown_connections 2024-09-16T17:03:19.138 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.136+0000 7f9ec302bec0 1 -- 172.21.15.89:0/2608439220 wait complete. 2024-09-16T17:03:19.138 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.137+0000 7f9ec302bec0 1 Processor -- start 2024-09-16T17:03:19.139 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.137+0000 7f9ec302bec0 1 -- start start 2024-09-16T17:03:19.140 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.138+0000 7f9ec302bec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x130a120 0x1387630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.140 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.138+0000 7f9ec302bec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x126c280 con 0x130a120 2024-09-16T17:03:19.140 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.138+0000 7f9ebb03f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x130a120 0x1387630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.140 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.138+0000 7f9ebb03f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x130a120 0x1387630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60056/0 (socket says 172.21.15.89:60056) 2024-09-16T17:03:19.140 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.138+0000 7f9ebb03f640 1 -- 172.21.15.89:0/1547539489 learned_addr learned my addr 172.21.15.89:0/1547539489 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.140 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.138+0000 7f9ebb03f640 1 -- 172.21.15.89:0/1547539489 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x11fc920 con 0x130a120 2024-09-16T17:03:19.140 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.138+0000 7f9ebb03f640 1 --2- 172.21.15.89:0/1547539489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x130a120 0x1387630 crc :-1 s=READY pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.140 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.138+0000 7f9eb883a640 1 -- 172.21.15.89:0/1547539489 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9ea40375b0 con 0x130a120 2024-09-16T17:03:19.140 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.138+0000 7f9eb883a640 1 -- 172.21.15.89:0/1547539489 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9ea4037710 con 0x130a120 2024-09-16T17:03:19.141 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.138+0000 7f9ec302bec0 1 -- 172.21.15.89:0/1547539489 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x11fc380 con 0x130a120 2024-09-16T17:03:19.141 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.139+0000 7f9eb883a640 1 -- 172.21.15.89:0/1547539489 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9ea40379b0 con 0x130a120 2024-09-16T17:03:19.141 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.139+0000 7f9ec302bec0 1 -- 172.21.15.89:0/1547539489 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x138a8d0 con 0x130a120 2024-09-16T17:03:19.142 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.140+0000 7f9eb883a640 1 -- 172.21.15.89:0/1547539489 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f9ea4003040 con 0x130a120 2024-09-16T17:03:19.142 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.140+0000 7f9eb883a640 1 --2- 172.21.15.89:0/1547539489 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f9ea003d1c0 0x7f9ea003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.142 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.140+0000 7f9eb883a640 1 -- 172.21.15.89:0/1547539489 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(700..700 src has 406..700) ==== 3819+0+0 (crc 0 0 0) 0x7f9ea4072f90 con 0x130a120 2024-09-16T17:03:19.142 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.140+0000 7f9ec302bec0 1 --2- 172.21.15.89:0/1547539489 >> v2:172.21.15.89:6801/3499031688 conn(0x130aa70 0x139aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.142 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.140+0000 7f9ec302bec0 1 -- 172.21.15.89:0/1547539489 --> v2:172.21.15.89:6801/3499031688 -- osd_op(unknown.0.0:1 199.7 199:ff7b1f36:::obj1:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e700) -- 0x138af60 con 0x130aa70 2024-09-16T17:03:19.142 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.140+0000 7f9eba83e640 1 --2- 172.21.15.89:0/1547539489 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f9ea003d1c0 0x7f9ea003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.142 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.141+0000 7f9eba83e640 1 --2- 172.21.15.89:0/1547539489 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f9ea003d1c0 0x7f9ea003f6d0 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.142 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.141+0000 7f9ebb840640 1 --2- 172.21.15.89:0/1547539489 >> v2:172.21.15.89:6801/3499031688 conn(0x130aa70 0x139aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:19.145 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.145+0000 7f9ebb840640 1 --2- 172.21.15.89:0/1547539489 >> v2:172.21.15.89:6801/3499031688 conn(0x130aa70 0x139aa80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.167 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.165+0000 7f9ebb840640 1 -- 172.21.15.89:0/1547539489 <== osd.0 v2:172.21.15.89:6801/3499031688 1 ==== osd_op_reply(1 obj1 [writefull 0~12875] v700'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f9eac00c430 con 0x130aa70 2024-09-16T17:03:19.167 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.165+0000 7f9ec302bec0 1 -- 172.21.15.89:0/1547539489 >> v2:172.21.15.89:6801/3499031688 conn(0x130aa70 msgr2=0x139aa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.167 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.165+0000 7f9ec302bec0 1 --2- 172.21.15.89:0/1547539489 >> v2:172.21.15.89:6801/3499031688 conn(0x130aa70 0x139aa80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.167 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.166+0000 7f9ec302bec0 1 -- 172.21.15.89:0/1547539489 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f9ea003d1c0 msgr2=0x7f9ea003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.167 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.166+0000 7f9ec302bec0 1 --2- 172.21.15.89:0/1547539489 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f9ea003d1c0 0x7f9ea003f6d0 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.167 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.166+0000 7f9ec302bec0 1 -- 172.21.15.89:0/1547539489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x130a120 msgr2=0x1387630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.167 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.166+0000 7f9ec302bec0 1 --2- 172.21.15.89:0/1547539489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x130a120 0x1387630 crc :-1 s=READY pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.167 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.166+0000 7f9ec302bec0 1 -- 172.21.15.89:0/1547539489 shutdown_connections 2024-09-16T17:03:19.167 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.166+0000 7f9ec302bec0 1 --2- 172.21.15.89:0/1547539489 >> v2:172.21.15.89:6801/3499031688 conn(0x130aa70 0x139aa80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.167 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.166+0000 7f9ec302bec0 1 --2- 172.21.15.89:0/1547539489 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f9ea003d1c0 0x7f9ea003f6d0 unknown :-1 s=CLOSED pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.168 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.166+0000 7f9ec302bec0 1 --2- 172.21.15.89:0/1547539489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x130a120 0x1387630 unknown :-1 s=CLOSED pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.168 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.166+0000 7f9ec302bec0 1 -- 172.21.15.89:0/1547539489 >> 172.21.15.89:0/1547539489 conn(0x122e770 msgr2=0x1424090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.168 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.166+0000 7f9ec302bec0 1 -- 172.21.15.89:0/1547539489 shutdown_connections 2024-09-16T17:03:19.168 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.166+0000 7f9ec302bec0 1 -- 172.21.15.89:0/1547539489 wait complete. 2024-09-16T17:03:19.169 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:19.169 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p ad5c36b8-029a-4232-9d54-ea1601f1a3e9 put obj2 /etc/passwd 2024-09-16T17:03:19.205 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.204+0000 7fc6d6efdec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.210 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.209+0000 7fc6d6efdec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.210 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.209+0000 7fc6d6efdec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.211 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.210+0000 7fc6d6efdec0 1 Processor -- start 2024-09-16T17:03:19.211 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.210+0000 7fc6d6efdec0 1 -- start start 2024-09-16T17:03:19.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.211+0000 7fc6d6efdec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x204c810 0x20e6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.211+0000 7fc6d6efdec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x1fb9520 con 0x204c810 2024-09-16T17:03:19.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.211+0000 7fc6cf23f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x204c810 0x20e6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.211+0000 7fc6cf23f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x204c810 0x20e6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60076/0 (socket says 172.21.15.89:60076) 2024-09-16T17:03:19.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.211+0000 7fc6cf23f640 1 -- 172.21.15.89:0/3531056588 learned_addr learned my addr 172.21.15.89:0/3531056588 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.211+0000 7fc6cf23f640 1 -- 172.21.15.89:0/3531056588 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1f55e10 con 0x204c810 2024-09-16T17:03:19.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.212+0000 7fc6cf23f640 1 --2- 172.21.15.89:0/3531056588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x204c810 0x20e6b20 crc :-1 s=READY pgs=12853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a046f63d2487163a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.212+0000 7fc6cda3c640 1 -- 172.21.15.89:0/3531056588 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc6b800b580 con 0x204c810 2024-09-16T17:03:19.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.212+0000 7fc6cda3c640 1 -- 172.21.15.89:0/3531056588 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc6b800b6e0 con 0x204c810 2024-09-16T17:03:19.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.212+0000 7fc6cda3c640 1 -- 172.21.15.89:0/3531056588 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc6b800b980 con 0x204c810 2024-09-16T17:03:19.214 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.212+0000 7fc6d6efdec0 1 -- 172.21.15.89:0/3531056588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x204c810 msgr2=0x20e6b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.214 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.212+0000 7fc6d6efdec0 1 --2- 172.21.15.89:0/3531056588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x204c810 0x20e6b20 crc :-1 s=READY pgs=12853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.214 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.212+0000 7fc6d6efdec0 1 -- 172.21.15.89:0/3531056588 shutdown_connections 2024-09-16T17:03:19.214 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.212+0000 7fc6d6efdec0 1 --2- 172.21.15.89:0/3531056588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x204c810 0x20e6b20 unknown :-1 s=CLOSED pgs=12853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.215 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.212+0000 7fc6d6efdec0 1 -- 172.21.15.89:0/3531056588 >> 172.21.15.89:0/3531056588 conn(0x1f79770 msgr2=0x204dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.215 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.213+0000 7fc6d6efdec0 1 -- 172.21.15.89:0/3531056588 shutdown_connections 2024-09-16T17:03:19.215 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.213+0000 7fc6d6efdec0 1 -- 172.21.15.89:0/3531056588 wait complete. 2024-09-16T17:03:19.215 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.213+0000 7fc6d6efdec0 1 Processor -- start 2024-09-16T17:03:19.215 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.213+0000 7fc6d6efdec0 1 -- start start 2024-09-16T17:03:19.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.214+0000 7fc6d6efdec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x204c810 0x20d51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.214+0000 7fc6d6efdec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x1fb7280 con 0x204c810 2024-09-16T17:03:19.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.214+0000 7fc6cf23f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x204c810 0x20d51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.214+0000 7fc6cf23f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x204c810 0x20d51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60080/0 (socket says 172.21.15.89:60080) 2024-09-16T17:03:19.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.214+0000 7fc6cf23f640 1 -- 172.21.15.89:0/2810157335 learned_addr learned my addr 172.21.15.89:0/2810157335 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.215+0000 7fc6cf23f640 1 -- 172.21.15.89:0/2810157335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1f47920 con 0x204c810 2024-09-16T17:03:19.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.215+0000 7fc6cf23f640 1 --2- 172.21.15.89:0/2810157335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x204c810 0x20d51d0 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.215+0000 7fc6cca3a640 1 -- 172.21.15.89:0/2810157335 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc6b8017040 con 0x204c810 2024-09-16T17:03:19.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.215+0000 7fc6d6efdec0 1 -- 172.21.15.89:0/2810157335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1f47380 con 0x204c810 2024-09-16T17:03:19.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.215+0000 7fc6cca3a640 1 -- 172.21.15.89:0/2810157335 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc6b8005040 con 0x204c810 2024-09-16T17:03:19.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.215+0000 7fc6cca3a640 1 -- 172.21.15.89:0/2810157335 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc6b8012c80 con 0x204c810 2024-09-16T17:03:19.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.215+0000 7fc6d6efdec0 1 -- 172.21.15.89:0/2810157335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x20d8490 con 0x204c810 2024-09-16T17:03:19.218 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.216+0000 7fc6cca3a640 1 -- 172.21.15.89:0/2810157335 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc6b800d040 con 0x204c810 2024-09-16T17:03:19.218 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.216+0000 7fc6cca3a640 1 --2- 172.21.15.89:0/2810157335 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc6b403d170 0x7fc6b403f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.218 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.216+0000 7fc6cca3a640 1 -- 172.21.15.89:0/2810157335 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(700..700 src has 406..700) ==== 3819+0+0 (crc 0 0 0) 0x7fc6b800a040 con 0x204c810 2024-09-16T17:03:19.218 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.216+0000 7fc6d6efdec0 1 --2- 172.21.15.89:0/2810157335 >> v2:172.21.15.177:6807/75130198 conn(0x2055830 0x20d5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.218 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.216+0000 7fc6d6efdec0 1 -- 172.21.15.89:0/2810157335 --> v2:172.21.15.177:6807/75130198 -- osd_op(unknown.0.0:1 199.8 199:104778fc:::obj2:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e700) -- 0x217b0f0 con 0x2055830 2024-09-16T17:03:19.218 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.216+0000 7fc6cea3e640 1 --2- 172.21.15.89:0/2810157335 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc6b403d170 0x7fc6b403f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.218 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.217+0000 7fc6cea3e640 1 --2- 172.21.15.89:0/2810157335 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc6b403d170 0x7fc6b403f680 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.219 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.217+0000 7fc6cfa40640 1 --2- 172.21.15.89:0/2810157335 >> v2:172.21.15.177:6807/75130198 conn(0x2055830 0x20d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:19.222 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.221+0000 7fc6cfa40640 1 --2- 172.21.15.89:0/2810157335 >> v2:172.21.15.177:6807/75130198 conn(0x2055830 0x20d5c20 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.240 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.239+0000 7fc6cfa40640 1 -- 172.21.15.89:0/2810157335 <== osd.3 v2:172.21.15.177:6807/75130198 1 ==== osd_op_reply(1 obj2 [writefull 0~12875] v700'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc6c000a430 con 0x2055830 2024-09-16T17:03:19.241 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.239+0000 7fc6d6efdec0 1 -- 172.21.15.89:0/2810157335 >> v2:172.21.15.177:6807/75130198 conn(0x2055830 msgr2=0x20d5c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.241 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.239+0000 7fc6d6efdec0 1 --2- 172.21.15.89:0/2810157335 >> v2:172.21.15.177:6807/75130198 conn(0x2055830 0x20d5c20 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.241 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.239+0000 7fc6d6efdec0 1 -- 172.21.15.89:0/2810157335 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc6b403d170 msgr2=0x7fc6b403f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.241 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.239+0000 7fc6d6efdec0 1 --2- 172.21.15.89:0/2810157335 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc6b403d170 0x7fc6b403f680 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.241 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.239+0000 7fc6d6efdec0 1 -- 172.21.15.89:0/2810157335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x204c810 msgr2=0x20d51d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.241 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.239+0000 7fc6d6efdec0 1 --2- 172.21.15.89:0/2810157335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x204c810 0x20d51d0 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.241 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.239+0000 7fc6d6efdec0 1 -- 172.21.15.89:0/2810157335 shutdown_connections 2024-09-16T17:03:19.241 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.239+0000 7fc6d6efdec0 1 --2- 172.21.15.89:0/2810157335 >> v2:172.21.15.177:6807/75130198 conn(0x2055830 0x20d5c20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.241 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.239+0000 7fc6d6efdec0 1 --2- 172.21.15.89:0/2810157335 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc6b403d170 0x7fc6b403f680 unknown :-1 s=CLOSED pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.241 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.239+0000 7fc6d6efdec0 1 --2- 172.21.15.89:0/2810157335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x204c810 0x20d51d0 unknown :-1 s=CLOSED pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.241 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.239+0000 7fc6d6efdec0 1 -- 172.21.15.89:0/2810157335 >> 172.21.15.89:0/2810157335 conn(0x1f79770 msgr2=0x204fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.241 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.239+0000 7fc6d6efdec0 1 -- 172.21.15.89:0/2810157335 shutdown_connections 2024-09-16T17:03:19.241 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.239+0000 7fc6d6efdec0 1 -- 172.21.15.89:0/2810157335 wait complete. 2024-09-16T17:03:19.243 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:19.243 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p ad5c36b8-029a-4232-9d54-ea1601f1a3e9 put obj3 /etc/passwd 2024-09-16T17:03:19.278 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.277+0000 7ff0b3839ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.283 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.282+0000 7ff0b3839ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.283 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.282+0000 7ff0b3839ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.284 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.283+0000 7ff0b3839ec0 1 Processor -- start 2024-09-16T17:03:19.284 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.283+0000 7ff0b3839ec0 1 -- start start 2024-09-16T17:03:19.285 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.284+0000 7ff0b3839ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc69d90 0xc6ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.285 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.284+0000 7ff0b3839ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0xb3f520 con 0xc69d90 2024-09-16T17:03:19.286 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.284+0000 7ff0a77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc69d90 0xc6ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.286 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.284+0000 7ff0a77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc69d90 0xc6ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60096/0 (socket says 172.21.15.89:60096) 2024-09-16T17:03:19.286 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.284+0000 7ff0a77fe640 1 -- 172.21.15.89:0/2679301871 learned_addr learned my addr 172.21.15.89:0/2679301871 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.286 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.284+0000 7ff0a77fe640 1 -- 172.21.15.89:0/2679301871 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xadbe10 con 0xc69d90 2024-09-16T17:03:19.286 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.285+0000 7ff0a77fe640 1 --2- 172.21.15.89:0/2679301871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc69d90 0xc6ab70 crc :-1 s=READY pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea37de8d4b0c3e24 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.286 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.285+0000 7ff0a5ffb640 1 -- 172.21.15.89:0/2679301871 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff094009040 con 0xc69d90 2024-09-16T17:03:19.286 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.285+0000 7ff0a5ffb640 1 -- 172.21.15.89:0/2679301871 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff09400a040 con 0xc69d90 2024-09-16T17:03:19.286 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.285+0000 7ff0a5ffb640 1 -- 172.21.15.89:0/2679301871 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff09400c6a0 con 0xc69d90 2024-09-16T17:03:19.287 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.285+0000 7ff0b3839ec0 1 -- 172.21.15.89:0/2679301871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc69d90 msgr2=0xc6ab70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.287 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.285+0000 7ff0b3839ec0 1 --2- 172.21.15.89:0/2679301871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc69d90 0xc6ab70 crc :-1 s=READY pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.287 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.285+0000 7ff0b3839ec0 1 -- 172.21.15.89:0/2679301871 shutdown_connections 2024-09-16T17:03:19.287 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.285+0000 7ff0b3839ec0 1 --2- 172.21.15.89:0/2679301871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc69d90 0xc6ab70 unknown :-1 s=CLOSED pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.287 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.285+0000 7ff0b3839ec0 1 -- 172.21.15.89:0/2679301871 >> 172.21.15.89:0/2679301871 conn(0xaff770 msgr2=0xc677a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.287 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.285+0000 7ff0b3839ec0 1 -- 172.21.15.89:0/2679301871 shutdown_connections 2024-09-16T17:03:19.287 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.285+0000 7ff0b3839ec0 1 -- 172.21.15.89:0/2679301871 wait complete. 2024-09-16T17:03:19.287 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.286+0000 7ff0b3839ec0 1 Processor -- start 2024-09-16T17:03:19.287 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.286+0000 7ff0b3839ec0 1 -- start start 2024-09-16T17:03:19.289 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.287+0000 7ff0b3839ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc69d90 0xc55470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.289 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.287+0000 7ff0b3839ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0xb3d280 con 0xc69d90 2024-09-16T17:03:19.289 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.287+0000 7ff0a77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc69d90 0xc55470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.289 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.287+0000 7ff0a77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc69d90 0xc55470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60110/0 (socket says 172.21.15.89:60110) 2024-09-16T17:03:19.289 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.287+0000 7ff0a77fe640 1 -- 172.21.15.89:0/393100770 learned_addr learned my addr 172.21.15.89:0/393100770 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.289 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.288+0000 7ff0a77fe640 1 -- 172.21.15.89:0/393100770 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xacd920 con 0xc69d90 2024-09-16T17:03:19.289 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.288+0000 7ff0a77fe640 1 --2- 172.21.15.89:0/393100770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc69d90 0xc55470 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.289 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.288+0000 7ff0a4ff9640 1 -- 172.21.15.89:0/393100770 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff094012840 con 0xc69d90 2024-09-16T17:03:19.289 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.288+0000 7ff0a4ff9640 1 -- 172.21.15.89:0/393100770 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff0940129a0 con 0xc69d90 2024-09-16T17:03:19.289 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.288+0000 7ff0b3839ec0 1 -- 172.21.15.89:0/393100770 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xacd380 con 0xc69d90 2024-09-16T17:03:19.289 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.288+0000 7ff0a4ff9640 1 -- 172.21.15.89:0/393100770 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff094012c40 con 0xc69d90 2024-09-16T17:03:19.289 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.288+0000 7ff0b3839ec0 1 -- 172.21.15.89:0/393100770 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0xc6cc50 con 0xc69d90 2024-09-16T17:03:19.290 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.289+0000 7ff0a4ff9640 1 -- 172.21.15.89:0/393100770 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff094013420 con 0xc69d90 2024-09-16T17:03:19.290 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.289+0000 7ff0a4ff9640 1 --2- 172.21.15.89:0/393100770 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff08403d1c0 0x7ff08403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.290 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.289+0000 7ff0a4ff9640 1 -- 172.21.15.89:0/393100770 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(700..700 src has 406..700) ==== 3819+0+0 (crc 0 0 0) 0x7ff094009040 con 0xc69d90 2024-09-16T17:03:19.290 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.289+0000 7ff0b3839ec0 1 --2- 172.21.15.89:0/393100770 >> v2:172.21.15.89:6801/3499031688 conn(0xc700e0 0xc661e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.290 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.289+0000 7ff0a6ffd640 1 --2- 172.21.15.89:0/393100770 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff08403d1c0 0x7ff08403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.291 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.289+0000 7ff0b3839ec0 1 -- 172.21.15.89:0/393100770 --> v2:172.21.15.89:6801/3499031688 -- osd_op(unknown.0.0:1 199.1 199:8dd16f86:::obj3:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e700) -- 0xc57f40 con 0xc700e0 2024-09-16T17:03:19.291 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.290+0000 7ff0a6ffd640 1 --2- 172.21.15.89:0/393100770 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff08403d1c0 0x7ff08403f6d0 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.291 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.290+0000 7ff0a7fff640 1 --2- 172.21.15.89:0/393100770 >> v2:172.21.15.89:6801/3499031688 conn(0xc700e0 0xc661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:19.294 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.294+0000 7ff0a7fff640 1 --2- 172.21.15.89:0/393100770 >> v2:172.21.15.89:6801/3499031688 conn(0xc700e0 0xc661e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.316 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.315+0000 7ff0a7fff640 1 -- 172.21.15.89:0/393100770 <== osd.0 v2:172.21.15.89:6801/3499031688 1 ==== osd_op_reply(1 obj3 [writefull 0~12875] v700'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff09c00a430 con 0xc700e0 2024-09-16T17:03:19.317 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.315+0000 7ff0b3839ec0 1 -- 172.21.15.89:0/393100770 >> v2:172.21.15.89:6801/3499031688 conn(0xc700e0 msgr2=0xc661e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.317 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.315+0000 7ff0b3839ec0 1 --2- 172.21.15.89:0/393100770 >> v2:172.21.15.89:6801/3499031688 conn(0xc700e0 0xc661e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.317 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.315+0000 7ff0b3839ec0 1 -- 172.21.15.89:0/393100770 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff08403d1c0 msgr2=0x7ff08403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.317 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.315+0000 7ff0b3839ec0 1 --2- 172.21.15.89:0/393100770 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff08403d1c0 0x7ff08403f6d0 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.317 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.315+0000 7ff0b3839ec0 1 -- 172.21.15.89:0/393100770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc69d90 msgr2=0xc55470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.317 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.315+0000 7ff0b3839ec0 1 --2- 172.21.15.89:0/393100770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc69d90 0xc55470 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.317 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.315+0000 7ff0b3839ec0 1 -- 172.21.15.89:0/393100770 shutdown_connections 2024-09-16T17:03:19.317 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.315+0000 7ff0b3839ec0 1 --2- 172.21.15.89:0/393100770 >> v2:172.21.15.89:6801/3499031688 conn(0xc700e0 0xc661e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.317 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.315+0000 7ff0b3839ec0 1 --2- 172.21.15.89:0/393100770 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff08403d1c0 0x7ff08403f6d0 unknown :-1 s=CLOSED pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.317 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.315+0000 7ff0b3839ec0 1 --2- 172.21.15.89:0/393100770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc69d90 0xc55470 unknown :-1 s=CLOSED pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.317 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.315+0000 7ff0b3839ec0 1 -- 172.21.15.89:0/393100770 >> 172.21.15.89:0/393100770 conn(0xaff770 msgr2=0xc677a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.317 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.315+0000 7ff0b3839ec0 1 -- 172.21.15.89:0/393100770 shutdown_connections 2024-09-16T17:03:19.317 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.315+0000 7ff0b3839ec0 1 -- 172.21.15.89:0/393100770 wait complete. 2024-09-16T17:03:19.319 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:19.319 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p ad5c36b8-029a-4232-9d54-ea1601f1a3e9 put obj4 /etc/passwd 2024-09-16T17:03:19.355 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.354+0000 7fcea6531ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.360 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.359+0000 7fcea6531ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.360 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.359+0000 7fcea6531ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.361 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.360+0000 7fcea6531ec0 1 Processor -- start 2024-09-16T17:03:19.361 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.360+0000 7fcea6531ec0 1 -- start start 2024-09-16T17:03:19.362 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.361+0000 7fcea6531ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x152eb60 0x15ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.362 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.361+0000 7fcea6531ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x1493520 con 0x152eb60 2024-09-16T17:03:19.362 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.361+0000 7fce9ee3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x152eb60 0x15ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.362 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.361+0000 7fce9ee3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x152eb60 0x15ac7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60126/0 (socket says 172.21.15.89:60126) 2024-09-16T17:03:19.362 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.361+0000 7fce9ee3f640 1 -- 172.21.15.89:0/2019857470 learned_addr learned my addr 172.21.15.89:0/2019857470 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.363 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.361+0000 7fce9ee3f640 1 -- 172.21.15.89:0/2019857470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x142fe10 con 0x152eb60 2024-09-16T17:03:19.363 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.361+0000 7fce9ee3f640 1 --2- 172.21.15.89:0/2019857470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x152eb60 0x15ac7f0 crc :-1 s=READY pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de3e5c4e274ec51 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.363 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.361+0000 7fce9d63c640 1 -- 172.21.15.89:0/2019857470 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce88009040 con 0x152eb60 2024-09-16T17:03:19.363 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.361+0000 7fce9d63c640 1 -- 172.21.15.89:0/2019857470 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fce8800a040 con 0x152eb60 2024-09-16T17:03:19.363 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.361+0000 7fce9d63c640 1 -- 172.21.15.89:0/2019857470 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce8800c6a0 con 0x152eb60 2024-09-16T17:03:19.364 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.362+0000 7fcea6531ec0 1 -- 172.21.15.89:0/2019857470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x152eb60 msgr2=0x15ac7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.364 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.362+0000 7fcea6531ec0 1 --2- 172.21.15.89:0/2019857470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x152eb60 0x15ac7f0 crc :-1 s=READY pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.364 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.362+0000 7fcea6531ec0 1 -- 172.21.15.89:0/2019857470 shutdown_connections 2024-09-16T17:03:19.364 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.362+0000 7fcea6531ec0 1 --2- 172.21.15.89:0/2019857470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x152eb60 0x15ac7f0 unknown :-1 s=CLOSED pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.364 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.362+0000 7fcea6531ec0 1 -- 172.21.15.89:0/2019857470 >> 172.21.15.89:0/2019857470 conn(0x1453770 msgr2=0x1528fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.364 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.362+0000 7fcea6531ec0 1 -- 172.21.15.89:0/2019857470 shutdown_connections 2024-09-16T17:03:19.364 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.362+0000 7fcea6531ec0 1 -- 172.21.15.89:0/2019857470 wait complete. 2024-09-16T17:03:19.364 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.363+0000 7fcea6531ec0 1 Processor -- start 2024-09-16T17:03:19.364 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.363+0000 7fcea6531ec0 1 -- start start 2024-09-16T17:03:19.366 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.364+0000 7fcea6531ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x152eb60 0x15afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.366 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.364+0000 7fcea6531ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x1491280 con 0x152eb60 2024-09-16T17:03:19.366 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.364+0000 7fce9ee3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x152eb60 0x15afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.366 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.364+0000 7fce9ee3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x152eb60 0x15afc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60136/0 (socket says 172.21.15.89:60136) 2024-09-16T17:03:19.366 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.364+0000 7fce9ee3f640 1 -- 172.21.15.89:0/736541965 learned_addr learned my addr 172.21.15.89:0/736541965 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.366 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.364+0000 7fce9ee3f640 1 -- 172.21.15.89:0/736541965 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1421920 con 0x152eb60 2024-09-16T17:03:19.366 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.364+0000 7fce9ee3f640 1 --2- 172.21.15.89:0/736541965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x152eb60 0x15afc40 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.366 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.365+0000 7fce97fff640 1 -- 172.21.15.89:0/736541965 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce88012840 con 0x152eb60 2024-09-16T17:03:19.366 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.365+0000 7fce97fff640 1 -- 172.21.15.89:0/736541965 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fce880129a0 con 0x152eb60 2024-09-16T17:03:19.366 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.365+0000 7fcea6531ec0 1 -- 172.21.15.89:0/736541965 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1421380 con 0x152eb60 2024-09-16T17:03:19.366 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.365+0000 7fce97fff640 1 -- 172.21.15.89:0/736541965 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce88012c40 con 0x152eb60 2024-09-16T17:03:19.366 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.365+0000 7fcea6531ec0 1 -- 172.21.15.89:0/736541965 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x15b3bd0 con 0x152eb60 2024-09-16T17:03:19.367 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.366+0000 7fce97fff640 1 -- 172.21.15.89:0/736541965 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fce88013420 con 0x152eb60 2024-09-16T17:03:19.367 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.366+0000 7fce97fff640 1 --2- 172.21.15.89:0/736541965 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fce8403d1c0 0x7fce8403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.367 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.366+0000 7fce97fff640 1 -- 172.21.15.89:0/736541965 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(700..700 src has 406..700) ==== 3819+0+0 (crc 0 0 0) 0x7fce88009040 con 0x152eb60 2024-09-16T17:03:19.367 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.366+0000 7fce9e63e640 1 --2- 172.21.15.89:0/736541965 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fce8403d1c0 0x7fce8403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.368 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.366+0000 7fcea6531ec0 1 --2- 172.21.15.89:0/736541965 >> v2:172.21.15.89:6803/245700216 conn(0x152fc50 0x1a5a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.368 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.366+0000 7fcea6531ec0 1 -- 172.21.15.89:0/736541965 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:1 199.0 199:0ee9ae15:::obj4:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e700) -- 0x15b3660 con 0x152fc50 2024-09-16T17:03:19.368 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.367+0000 7fce9e63e640 1 --2- 172.21.15.89:0/736541965 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fce8403d1c0 0x7fce8403f6d0 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.368 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.367+0000 7fce9f640640 1 --2- 172.21.15.89:0/736541965 >> v2:172.21.15.89:6803/245700216 conn(0x152fc50 0x1a5a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:19.371 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.370+0000 7fce9f640640 1 --2- 172.21.15.89:0/736541965 >> v2:172.21.15.89:6803/245700216 conn(0x152fc50 0x1a5a260 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.392 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.391+0000 7fce9f640640 1 -- 172.21.15.89:0/736541965 <== osd.1 v2:172.21.15.89:6803/245700216 1 ==== osd_op_reply(1 obj4 [writefull 0~12875] v700'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fce9000a430 con 0x152fc50 2024-09-16T17:03:19.392 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.391+0000 7fcea6531ec0 1 -- 172.21.15.89:0/736541965 >> v2:172.21.15.89:6803/245700216 conn(0x152fc50 msgr2=0x1a5a260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.392 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.391+0000 7fcea6531ec0 1 --2- 172.21.15.89:0/736541965 >> v2:172.21.15.89:6803/245700216 conn(0x152fc50 0x1a5a260 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.393 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.391+0000 7fcea6531ec0 1 -- 172.21.15.89:0/736541965 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fce8403d1c0 msgr2=0x7fce8403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.393 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.391+0000 7fcea6531ec0 1 --2- 172.21.15.89:0/736541965 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fce8403d1c0 0x7fce8403f6d0 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.393 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.391+0000 7fcea6531ec0 1 -- 172.21.15.89:0/736541965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x152eb60 msgr2=0x15afc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.393 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.391+0000 7fcea6531ec0 1 --2- 172.21.15.89:0/736541965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x152eb60 0x15afc40 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.393 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.391+0000 7fcea6531ec0 1 -- 172.21.15.89:0/736541965 shutdown_connections 2024-09-16T17:03:19.393 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.391+0000 7fcea6531ec0 1 --2- 172.21.15.89:0/736541965 >> v2:172.21.15.89:6803/245700216 conn(0x152fc50 0x1a5a260 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.393 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.391+0000 7fcea6531ec0 1 --2- 172.21.15.89:0/736541965 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fce8403d1c0 0x7fce8403f6d0 unknown :-1 s=CLOSED pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.393 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.391+0000 7fcea6531ec0 1 --2- 172.21.15.89:0/736541965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x152eb60 0x15afc40 unknown :-1 s=CLOSED pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.393 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.391+0000 7fcea6531ec0 1 -- 172.21.15.89:0/736541965 >> 172.21.15.89:0/736541965 conn(0x1453770 msgr2=0x1528f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.393 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.391+0000 7fcea6531ec0 1 -- 172.21.15.89:0/736541965 shutdown_connections 2024-09-16T17:03:19.393 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.391+0000 7fcea6531ec0 1 -- 172.21.15.89:0/736541965 wait complete. 2024-09-16T17:03:19.395 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:19.395 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p ad5c36b8-029a-4232-9d54-ea1601f1a3e9 put obj5 /etc/passwd 2024-09-16T17:03:19.433 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.432+0000 7f24b74ebec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.438 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.437+0000 7f24b74ebec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.438 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.437+0000 7f24b74ebec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.438 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.438+0000 7f24b74ebec0 1 Processor -- start 2024-09-16T17:03:19.439 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.438+0000 7f24b74ebec0 1 -- start start 2024-09-16T17:03:19.440 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.439+0000 7f24b74ebec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2427ea0 0x2423920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.441 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.439+0000 7f24b74ebec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x22fb520 con 0x2427ea0 2024-09-16T17:03:19.441 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.439+0000 7f24aaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2427ea0 0x2423920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.441 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.439+0000 7f24aaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2427ea0 0x2423920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60166/0 (socket says 172.21.15.89:60166) 2024-09-16T17:03:19.441 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.439+0000 7f24aaffd640 1 -- 172.21.15.89:0/648139055 learned_addr learned my addr 172.21.15.89:0/648139055 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.441 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.439+0000 7f24aaffd640 1 -- 172.21.15.89:0/648139055 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2297e10 con 0x2427ea0 2024-09-16T17:03:19.441 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.439+0000 7f24aaffd640 1 --2- 172.21.15.89:0/648139055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2427ea0 0x2423920 crc :-1 s=READY pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876eba4f4f5a9e4c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.441 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.439+0000 7f24a9ffb640 1 -- 172.21.15.89:0/648139055 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f249c02f780 con 0x2427ea0 2024-09-16T17:03:19.441 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.439+0000 7f24a9ffb640 1 -- 172.21.15.89:0/648139055 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f249c00a380 con 0x2427ea0 2024-09-16T17:03:19.441 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.439+0000 7f24a9ffb640 1 -- 172.21.15.89:0/648139055 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f249c02fab0 con 0x2427ea0 2024-09-16T17:03:19.442 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.440+0000 7f24b74ebec0 1 -- 172.21.15.89:0/648139055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2427ea0 msgr2=0x2423920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.442 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.440+0000 7f24b74ebec0 1 --2- 172.21.15.89:0/648139055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2427ea0 0x2423920 crc :-1 s=READY pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.442 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.440+0000 7f24b74ebec0 1 -- 172.21.15.89:0/648139055 shutdown_connections 2024-09-16T17:03:19.442 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.440+0000 7f24b74ebec0 1 --2- 172.21.15.89:0/648139055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2427ea0 0x2423920 unknown :-1 s=CLOSED pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.443 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.440+0000 7f24b74ebec0 1 -- 172.21.15.89:0/648139055 >> 172.21.15.89:0/648139055 conn(0x22bb770 msgr2=0x2398050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.443 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.440+0000 7f24b74ebec0 1 -- 172.21.15.89:0/648139055 shutdown_connections 2024-09-16T17:03:19.443 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.440+0000 7f24b74ebec0 1 -- 172.21.15.89:0/648139055 wait complete. 2024-09-16T17:03:19.443 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.441+0000 7f24b74ebec0 1 Processor -- start 2024-09-16T17:03:19.443 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.441+0000 7f24b74ebec0 1 -- start start 2024-09-16T17:03:19.445 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.442+0000 7f24b74ebec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2427ea0 0x2411d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.445 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.442+0000 7f24b74ebec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x22f9280 con 0x2427ea0 2024-09-16T17:03:19.445 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.442+0000 7f24aaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2427ea0 0x2411d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.445 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.442+0000 7f24aaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2427ea0 0x2411d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60168/0 (socket says 172.21.15.89:60168) 2024-09-16T17:03:19.445 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.442+0000 7f24aaffd640 1 -- 172.21.15.89:0/1460313499 learned_addr learned my addr 172.21.15.89:0/1460313499 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.445 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.442+0000 7f24aaffd640 1 -- 172.21.15.89:0/1460313499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2289920 con 0x2427ea0 2024-09-16T17:03:19.445 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.442+0000 7f24aaffd640 1 --2- 172.21.15.89:0/1460313499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2427ea0 0x2411d10 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.445 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.443+0000 7f24a8ff9640 1 -- 172.21.15.89:0/1460313499 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f249c008590 con 0x2427ea0 2024-09-16T17:03:19.445 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.443+0000 7f24a8ff9640 1 -- 172.21.15.89:0/1460313499 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f249c0086f0 con 0x2427ea0 2024-09-16T17:03:19.446 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.443+0000 7f24b74ebec0 1 -- 172.21.15.89:0/1460313499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2289380 con 0x2427ea0 2024-09-16T17:03:19.446 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.443+0000 7f24a8ff9640 1 -- 172.21.15.89:0/1460313499 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f249c008990 con 0x2427ea0 2024-09-16T17:03:19.446 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.443+0000 7f24b74ebec0 1 -- 172.21.15.89:0/1460313499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x24134d0 con 0x2427ea0 2024-09-16T17:03:19.446 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.444+0000 7f24a8ff9640 1 -- 172.21.15.89:0/1460313499 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f249c037040 con 0x2427ea0 2024-09-16T17:03:19.446 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.444+0000 7f24a8ff9640 1 --2- 172.21.15.89:0/1460313499 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f248c03d1c0 0x7f248c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.446 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.444+0000 7f24a8ff9640 1 -- 172.21.15.89:0/1460313499 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(700..700 src has 406..700) ==== 3819+0+0 (crc 0 0 0) 0x7f249c040040 con 0x2427ea0 2024-09-16T17:03:19.446 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.444+0000 7f24b74ebec0 1 --2- 172.21.15.89:0/1460313499 >> v2:172.21.15.177:6807/75130198 conn(0x24287f0 0x24bbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.446 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.444+0000 7f24b74ebec0 1 -- 172.21.15.89:0/1460313499 --> v2:172.21.15.177:6807/75130198 -- osd_op(unknown.0.0:1 199.3 199:c52c9666:::obj5:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e700) -- 0x24154a0 con 0x24287f0 2024-09-16T17:03:19.446 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.444+0000 7f24a27fc640 1 --2- 172.21.15.89:0/1460313499 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f248c03d1c0 0x7f248c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.447 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.445+0000 7f24a27fc640 1 --2- 172.21.15.89:0/1460313499 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f248c03d1c0 0x7f248c03f6d0 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.447 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.445+0000 7f24ab7fe640 1 --2- 172.21.15.89:0/1460313499 >> v2:172.21.15.177:6807/75130198 conn(0x24287f0 0x24bbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:19.449 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.449+0000 7f24ab7fe640 1 --2- 172.21.15.89:0/1460313499 >> v2:172.21.15.177:6807/75130198 conn(0x24287f0 0x24bbe80 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.470 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.468+0000 7f24ab7fe640 1 -- 172.21.15.89:0/1460313499 <== osd.3 v2:172.21.15.177:6807/75130198 1 ==== osd_op_reply(1 obj5 [writefull 0~12875] v700'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24a400a430 con 0x24287f0 2024-09-16T17:03:19.470 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.468+0000 7f24b74ebec0 1 -- 172.21.15.89:0/1460313499 >> v2:172.21.15.177:6807/75130198 conn(0x24287f0 msgr2=0x24bbe80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.470 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.468+0000 7f24b74ebec0 1 --2- 172.21.15.89:0/1460313499 >> v2:172.21.15.177:6807/75130198 conn(0x24287f0 0x24bbe80 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.470 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.468+0000 7f24b74ebec0 1 -- 172.21.15.89:0/1460313499 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f248c03d1c0 msgr2=0x7f248c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.470 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.468+0000 7f24b74ebec0 1 --2- 172.21.15.89:0/1460313499 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f248c03d1c0 0x7f248c03f6d0 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.470 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.468+0000 7f24b74ebec0 1 -- 172.21.15.89:0/1460313499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2427ea0 msgr2=0x2411d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.470 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.468+0000 7f24b74ebec0 1 --2- 172.21.15.89:0/1460313499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2427ea0 0x2411d10 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.470 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.468+0000 7f24b74ebec0 1 -- 172.21.15.89:0/1460313499 shutdown_connections 2024-09-16T17:03:19.470 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.468+0000 7f24b74ebec0 1 --2- 172.21.15.89:0/1460313499 >> v2:172.21.15.177:6807/75130198 conn(0x24287f0 0x24bbe80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.471 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.468+0000 7f24b74ebec0 1 --2- 172.21.15.89:0/1460313499 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f248c03d1c0 0x7f248c03f6d0 unknown :-1 s=CLOSED pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.471 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.468+0000 7f24b74ebec0 1 --2- 172.21.15.89:0/1460313499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2427ea0 0x2411d10 unknown :-1 s=CLOSED pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.471 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.468+0000 7f24b74ebec0 1 -- 172.21.15.89:0/1460313499 >> 172.21.15.89:0/1460313499 conn(0x22bb770 msgr2=0x2398e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.471 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.469+0000 7f24b74ebec0 1 -- 172.21.15.89:0/1460313499 shutdown_connections 2024-09-16T17:03:19.471 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.469+0000 7f24b74ebec0 1 -- 172.21.15.89:0/1460313499 wait complete. 2024-09-16T17:03:19.472 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:19.472 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p ad5c36b8-029a-4232-9d54-ea1601f1a3e9 put obj6 /etc/passwd 2024-09-16T17:03:19.508 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.507+0000 7fe45bf31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.513 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.512+0000 7fe45bf31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.513 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.512+0000 7fe45bf31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.513 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.513+0000 7fe45bf31ec0 1 Processor -- start 2024-09-16T17:03:19.513 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.513+0000 7fe45bf31ec0 1 -- start start 2024-09-16T17:03:19.515 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.514+0000 7fe45bf31ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1119120 0x1233090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.515 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.514+0000 7fe45bf31ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x107d520 con 0x1119120 2024-09-16T17:03:19.515 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.514+0000 7fe45483f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1119120 0x1233090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.515 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.514+0000 7fe45483f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1119120 0x1233090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60184/0 (socket says 172.21.15.89:60184) 2024-09-16T17:03:19.515 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.514+0000 7fe45483f640 1 -- 172.21.15.89:0/2477034867 learned_addr learned my addr 172.21.15.89:0/2477034867 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.515 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.514+0000 7fe45483f640 1 -- 172.21.15.89:0/2477034867 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1019e10 con 0x1119120 2024-09-16T17:03:19.516 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.514+0000 7fe45483f640 1 --2- 172.21.15.89:0/2477034867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1119120 0x1233090 crc :-1 s=READY pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba763e5a681f081 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.516 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.514+0000 7fe44e7fc640 1 -- 172.21.15.89:0/2477034867 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe44002daf0 con 0x1119120 2024-09-16T17:03:19.516 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.514+0000 7fe44e7fc640 1 -- 172.21.15.89:0/2477034867 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe44002dc50 con 0x1119120 2024-09-16T17:03:19.516 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.514+0000 7fe44e7fc640 1 -- 172.21.15.89:0/2477034867 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe4400374a0 con 0x1119120 2024-09-16T17:03:19.517 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.515+0000 7fe45bf31ec0 1 -- 172.21.15.89:0/2477034867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1119120 msgr2=0x1233090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.517 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.515+0000 7fe45bf31ec0 1 --2- 172.21.15.89:0/2477034867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1119120 0x1233090 crc :-1 s=READY pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.517 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.515+0000 7fe45bf31ec0 1 -- 172.21.15.89:0/2477034867 shutdown_connections 2024-09-16T17:03:19.517 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.515+0000 7fe45bf31ec0 1 --2- 172.21.15.89:0/2477034867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1119120 0x1233090 unknown :-1 s=CLOSED pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.517 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.515+0000 7fe45bf31ec0 1 -- 172.21.15.89:0/2477034867 >> 172.21.15.89:0/2477034867 conn(0x103d770 msgr2=0x1115ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.517 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.515+0000 7fe45bf31ec0 1 -- 172.21.15.89:0/2477034867 shutdown_connections 2024-09-16T17:03:19.517 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.515+0000 7fe45bf31ec0 1 -- 172.21.15.89:0/2477034867 wait complete. 2024-09-16T17:03:19.517 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.516+0000 7fe45bf31ec0 1 Processor -- start 2024-09-16T17:03:19.517 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.516+0000 7fe45bf31ec0 1 -- start start 2024-09-16T17:03:19.519 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.517+0000 7fe45bf31ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1119120 0x1240070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.519 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.517+0000 7fe45bf31ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x107b280 con 0x1119120 2024-09-16T17:03:19.519 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.517+0000 7fe45483f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1119120 0x1240070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.519 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.517+0000 7fe45483f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1119120 0x1240070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60198/0 (socket says 172.21.15.89:60198) 2024-09-16T17:03:19.519 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.517+0000 7fe45483f640 1 -- 172.21.15.89:0/931549307 learned_addr learned my addr 172.21.15.89:0/931549307 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.519 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.517+0000 7fe45483f640 1 -- 172.21.15.89:0/931549307 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x100b920 con 0x1119120 2024-09-16T17:03:19.519 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.517+0000 7fe45483f640 1 --2- 172.21.15.89:0/931549307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1119120 0x1240070 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.519 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.517+0000 7fe44d7fa640 1 -- 172.21.15.89:0/931549307 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe44002daf0 con 0x1119120 2024-09-16T17:03:19.519 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.517+0000 7fe44d7fa640 1 -- 172.21.15.89:0/931549307 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe440037370 con 0x1119120 2024-09-16T17:03:19.519 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.517+0000 7fe45bf31ec0 1 -- 172.21.15.89:0/931549307 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x100b380 con 0x1119120 2024-09-16T17:03:19.519 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.517+0000 7fe44d7fa640 1 -- 172.21.15.89:0/931549307 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe440039580 con 0x1119120 2024-09-16T17:03:19.519 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.518+0000 7fe45bf31ec0 1 -- 172.21.15.89:0/931549307 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1197560 con 0x1119120 2024-09-16T17:03:19.520 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.518+0000 7fe44d7fa640 1 -- 172.21.15.89:0/931549307 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe440039730 con 0x1119120 2024-09-16T17:03:19.521 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.518+0000 7fe44d7fa640 1 --2- 172.21.15.89:0/931549307 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe43c03d1c0 0x7fe43c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.521 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.519+0000 7fe44d7fa640 1 -- 172.21.15.89:0/931549307 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(700..700 src has 406..700) ==== 3819+0+0 (crc 0 0 0) 0x7fe440032040 con 0x1119120 2024-09-16T17:03:19.521 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.519+0000 7fe45bf31ec0 1 --2- 172.21.15.89:0/931549307 >> v2:172.21.15.89:6801/3499031688 conn(0x1119a70 0x11962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.521 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.519+0000 7fe45bf31ec0 1 -- 172.21.15.89:0/931549307 --> v2:172.21.15.89:6801/3499031688 -- osd_op(unknown.0.0:1 199.4 199:233a42c1:::obj6:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e700) -- 0x1199500 con 0x1119a70 2024-09-16T17:03:19.521 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.519+0000 7fe44f7fe640 1 --2- 172.21.15.89:0/931549307 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe43c03d1c0 0x7fe43c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.521 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.519+0000 7fe44f7fe640 1 --2- 172.21.15.89:0/931549307 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe43c03d1c0 0x7fe43c03f6d0 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.521 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.520+0000 7fe455040640 1 --2- 172.21.15.89:0/931549307 >> v2:172.21.15.89:6801/3499031688 conn(0x1119a70 0x11962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:19.524 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.523+0000 7fe455040640 1 --2- 172.21.15.89:0/931549307 >> v2:172.21.15.89:6801/3499031688 conn(0x1119a70 0x11962b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.545 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.544+0000 7fe455040640 1 -- 172.21.15.89:0/931549307 <== osd.0 v2:172.21.15.89:6801/3499031688 1 ==== osd_op_reply(1 obj6 [writefull 0~12875] v700'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe44800a430 con 0x1119a70 2024-09-16T17:03:19.545 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.544+0000 7fe45bf31ec0 1 -- 172.21.15.89:0/931549307 >> v2:172.21.15.89:6801/3499031688 conn(0x1119a70 msgr2=0x11962b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.545 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.544+0000 7fe45bf31ec0 1 --2- 172.21.15.89:0/931549307 >> v2:172.21.15.89:6801/3499031688 conn(0x1119a70 0x11962b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.545 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.544+0000 7fe45bf31ec0 1 -- 172.21.15.89:0/931549307 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe43c03d1c0 msgr2=0x7fe43c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.546 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.544+0000 7fe45bf31ec0 1 --2- 172.21.15.89:0/931549307 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe43c03d1c0 0x7fe43c03f6d0 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.546 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.544+0000 7fe45bf31ec0 1 -- 172.21.15.89:0/931549307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1119120 msgr2=0x1240070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.546 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.544+0000 7fe45bf31ec0 1 --2- 172.21.15.89:0/931549307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1119120 0x1240070 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.546 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.544+0000 7fe45bf31ec0 1 -- 172.21.15.89:0/931549307 shutdown_connections 2024-09-16T17:03:19.546 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.544+0000 7fe45bf31ec0 1 --2- 172.21.15.89:0/931549307 >> v2:172.21.15.89:6801/3499031688 conn(0x1119a70 0x11962b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.546 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.544+0000 7fe45bf31ec0 1 --2- 172.21.15.89:0/931549307 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe43c03d1c0 0x7fe43c03f6d0 unknown :-1 s=CLOSED pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.546 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.544+0000 7fe45bf31ec0 1 --2- 172.21.15.89:0/931549307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1119120 0x1240070 unknown :-1 s=CLOSED pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.546 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.544+0000 7fe45bf31ec0 1 -- 172.21.15.89:0/931549307 >> 172.21.15.89:0/931549307 conn(0x103d770 msgr2=0x11159f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.546 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.544+0000 7fe45bf31ec0 1 -- 172.21.15.89:0/931549307 shutdown_connections 2024-09-16T17:03:19.546 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.544+0000 7fe45bf31ec0 1 -- 172.21.15.89:0/931549307 wait complete. 2024-09-16T17:03:19.547 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:19.547 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p ad5c36b8-029a-4232-9d54-ea1601f1a3e9 put obj7 /etc/passwd 2024-09-16T17:03:19.583 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.582+0000 7f6ee472fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.588 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.587+0000 7f6ee472fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.588 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.587+0000 7f6ee472fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.588 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.588+0000 7f6ee472fec0 1 Processor -- start 2024-09-16T17:03:19.589 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.588+0000 7f6ee472fec0 1 -- start start 2024-09-16T17:03:19.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.589+0000 7f6ee472fec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe24810 0xf47a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.589+0000 7f6ee472fec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0xd91520 con 0xe24810 2024-09-16T17:03:19.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.589+0000 7f6edd03f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe24810 0xf47a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.589+0000 7f6edd03f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe24810 0xf47a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60222/0 (socket says 172.21.15.89:60222) 2024-09-16T17:03:19.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.589+0000 7f6edd03f640 1 -- 172.21.15.89:0/3618859438 learned_addr learned my addr 172.21.15.89:0/3618859438 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.591 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.589+0000 7f6edd03f640 1 -- 172.21.15.89:0/3618859438 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd2de10 con 0xe24810 2024-09-16T17:03:19.591 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.589+0000 7f6edd03f640 1 --2- 172.21.15.89:0/3618859438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe24810 0xf47a50 crc :-1 s=READY pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751d81fdf40e4dcc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.591 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.589+0000 7f6ed77fe640 1 -- 172.21.15.89:0/3618859438 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ed0009590 con 0xe24810 2024-09-16T17:03:19.591 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.589+0000 7f6ed77fe640 1 -- 172.21.15.89:0/3618859438 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6ed00096f0 con 0xe24810 2024-09-16T17:03:19.591 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.589+0000 7f6ed77fe640 1 -- 172.21.15.89:0/3618859438 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ed0009990 con 0xe24810 2024-09-16T17:03:19.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.590+0000 7f6ee472fec0 1 -- 172.21.15.89:0/3618859438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe24810 msgr2=0xf47a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.590+0000 7f6ee472fec0 1 --2- 172.21.15.89:0/3618859438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe24810 0xf47a50 crc :-1 s=READY pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.590+0000 7f6ee472fec0 1 -- 172.21.15.89:0/3618859438 shutdown_connections 2024-09-16T17:03:19.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.590+0000 7f6ee472fec0 1 --2- 172.21.15.89:0/3618859438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe24810 0xf47a50 unknown :-1 s=CLOSED pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.590+0000 7f6ee472fec0 1 -- 172.21.15.89:0/3618859438 >> 172.21.15.89:0/3618859438 conn(0xd51770 msgr2=0xe287a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.590+0000 7f6ee472fec0 1 -- 172.21.15.89:0/3618859438 shutdown_connections 2024-09-16T17:03:19.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.590+0000 7f6ee472fec0 1 -- 172.21.15.89:0/3618859438 wait complete. 2024-09-16T17:03:19.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.591+0000 7f6ee472fec0 1 Processor -- start 2024-09-16T17:03:19.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.591+0000 7f6ee472fec0 1 -- start start 2024-09-16T17:03:19.594 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.592+0000 7f6ee472fec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe24810 0xea8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.594 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.592+0000 7f6ee472fec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0xd8f280 con 0xe24810 2024-09-16T17:03:19.594 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.592+0000 7f6edd03f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe24810 0xea8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.594 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.592+0000 7f6edd03f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe24810 0xea8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60226/0 (socket says 172.21.15.89:60226) 2024-09-16T17:03:19.594 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.592+0000 7f6edd03f640 1 -- 172.21.15.89:0/1783153507 learned_addr learned my addr 172.21.15.89:0/1783153507 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.594 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.592+0000 7f6edd03f640 1 -- 172.21.15.89:0/1783153507 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd1f920 con 0xe24810 2024-09-16T17:03:19.594 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.592+0000 7f6edd03f640 1 --2- 172.21.15.89:0/1783153507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe24810 0xea8fd0 crc :-1 s=READY pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.594 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.593+0000 7f6ed67fc640 1 -- 172.21.15.89:0/1783153507 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ed0010040 con 0xe24810 2024-09-16T17:03:19.594 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.593+0000 7f6ed67fc640 1 -- 172.21.15.89:0/1783153507 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6ed00147b0 con 0xe24810 2024-09-16T17:03:19.594 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.593+0000 7f6ee472fec0 1 -- 172.21.15.89:0/1783153507 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xd1f380 con 0xe24810 2024-09-16T17:03:19.594 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.593+0000 7f6ed67fc640 1 -- 172.21.15.89:0/1783153507 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ed0014a50 con 0xe24810 2024-09-16T17:03:19.595 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.593+0000 7f6ee472fec0 1 -- 172.21.15.89:0/1783153507 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0xeaa070 con 0xe24810 2024-09-16T17:03:19.595 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.594+0000 7f6ed67fc640 1 -- 172.21.15.89:0/1783153507 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6ed0014c00 con 0xe24810 2024-09-16T17:03:19.595 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.594+0000 7f6ed67fc640 1 --2- 172.21.15.89:0/1783153507 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f6eb803d1c0 0x7f6eb803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.595 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.594+0000 7f6ed67fc640 1 -- 172.21.15.89:0/1783153507 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(700..700 src has 406..700) ==== 3819+0+0 (crc 0 0 0) 0x7f6ed0051ba0 con 0xe24810 2024-09-16T17:03:19.596 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.594+0000 7f6ee472fec0 1 --2- 172.21.15.89:0/1783153507 >> v2:172.21.15.89:6803/245700216 conn(0xe2d830 0xea9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.596 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.594+0000 7f6edc83e640 1 --2- 172.21.15.89:0/1783153507 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f6eb803d1c0 0x7f6eb803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.596 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.594+0000 7f6ee472fec0 1 -- 172.21.15.89:0/1783153507 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:1 199.9 199:9a09113a:::obj7:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e700) -- 0xeab760 con 0xe2d830 2024-09-16T17:03:19.596 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.595+0000 7f6edc83e640 1 --2- 172.21.15.89:0/1783153507 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f6eb803d1c0 0x7f6eb803f6d0 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.596 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.595+0000 7f6edd840640 1 --2- 172.21.15.89:0/1783153507 >> v2:172.21.15.89:6803/245700216 conn(0xe2d830 0xea9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:19.599 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.598+0000 7f6edd840640 1 --2- 172.21.15.89:0/1783153507 >> v2:172.21.15.89:6803/245700216 conn(0xe2d830 0xea9a20 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.618 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.617+0000 7f6edd840640 1 -- 172.21.15.89:0/1783153507 <== osd.1 v2:172.21.15.89:6803/245700216 1 ==== osd_op_reply(1 obj7 [writefull 0~12875] v700'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6ec800a430 con 0xe2d830 2024-09-16T17:03:19.618 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.617+0000 7f6ee472fec0 1 -- 172.21.15.89:0/1783153507 >> v2:172.21.15.89:6803/245700216 conn(0xe2d830 msgr2=0xea9a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.618 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.617+0000 7f6ee472fec0 1 --2- 172.21.15.89:0/1783153507 >> v2:172.21.15.89:6803/245700216 conn(0xe2d830 0xea9a20 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.818 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.617+0000 7f6ee472fec0 1 -- 172.21.15.89:0/1783153507 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f6eb803d1c0 msgr2=0x7f6eb803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.819 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.617+0000 7f6ee472fec0 1 --2- 172.21.15.89:0/1783153507 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f6eb803d1c0 0x7f6eb803f6d0 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.819 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.617+0000 7f6ee472fec0 1 -- 172.21.15.89:0/1783153507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe24810 msgr2=0xea8fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.819 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.617+0000 7f6ee472fec0 1 --2- 172.21.15.89:0/1783153507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe24810 0xea8fd0 crc :-1 s=READY pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.819 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.617+0000 7f6ee472fec0 1 -- 172.21.15.89:0/1783153507 shutdown_connections 2024-09-16T17:03:19.819 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.617+0000 7f6ee472fec0 1 --2- 172.21.15.89:0/1783153507 >> v2:172.21.15.89:6803/245700216 conn(0xe2d830 0xea9a20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.819 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.617+0000 7f6ee472fec0 1 --2- 172.21.15.89:0/1783153507 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f6eb803d1c0 0x7f6eb803f6d0 unknown :-1 s=CLOSED pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.819 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.617+0000 7f6ee472fec0 1 --2- 172.21.15.89:0/1783153507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe24810 0xea8fd0 unknown :-1 s=CLOSED pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.819 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.617+0000 7f6ee472fec0 1 -- 172.21.15.89:0/1783153507 >> 172.21.15.89:0/1783153507 conn(0xd51770 msgr2=0xe28480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.819 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.617+0000 7f6ee472fec0 1 -- 172.21.15.89:0/1783153507 shutdown_connections 2024-09-16T17:03:19.819 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.617+0000 7f6ee472fec0 1 -- 172.21.15.89:0/1783153507 wait complete. 2024-09-16T17:03:19.833 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:19.833 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p ad5c36b8-029a-4232-9d54-ea1601f1a3e9 put obj8 /etc/passwd 2024-09-16T17:03:19.833 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.655+0000 7fd2be681ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.834 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.660+0000 7fd2be681ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.834 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.660+0000 7fd2be681ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.834 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.661+0000 7fd2be681ec0 1 Processor -- start 2024-09-16T17:03:19.834 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.661+0000 7fd2be681ec0 1 -- start start 2024-09-16T17:03:19.834 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.662+0000 7fd2be681ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x24fa120 0x258caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.834 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.662+0000 7fd2be681ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x245e520 con 0x24fa120 2024-09-16T17:03:19.834 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.662+0000 7fd2b679b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x24fa120 0x258caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.834 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.662+0000 7fd2b679b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x24fa120 0x258caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60244/0 (socket says 172.21.15.89:60244) 2024-09-16T17:03:19.834 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.662+0000 7fd2b679b640 1 -- 172.21.15.89:0/523840939 learned_addr learned my addr 172.21.15.89:0/523840939 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.834 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.662+0000 7fd2b679b640 1 -- 172.21.15.89:0/523840939 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x23fae10 con 0x24fa120 2024-09-16T17:03:19.834 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.663+0000 7fd2b679b640 1 --2- 172.21.15.89:0/523840939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x24fa120 0x258caa0 crc :-1 s=READY pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36e30d8e0dc4108 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.834 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.663+0000 7fd2b4f98640 1 -- 172.21.15.89:0/523840939 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd2a000b580 con 0x24fa120 2024-09-16T17:03:19.834 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.663+0000 7fd2b4f98640 1 -- 172.21.15.89:0/523840939 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd2a000b6e0 con 0x24fa120 2024-09-16T17:03:19.835 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.663+0000 7fd2b4f98640 1 -- 172.21.15.89:0/523840939 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd2a000b980 con 0x24fa120 2024-09-16T17:03:19.835 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.663+0000 7fd2be681ec0 1 -- 172.21.15.89:0/523840939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x24fa120 msgr2=0x258caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.835 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.663+0000 7fd2be681ec0 1 --2- 172.21.15.89:0/523840939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x24fa120 0x258caa0 crc :-1 s=READY pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.835 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.663+0000 7fd2be681ec0 1 -- 172.21.15.89:0/523840939 shutdown_connections 2024-09-16T17:03:19.835 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.663+0000 7fd2be681ec0 1 --2- 172.21.15.89:0/523840939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x24fa120 0x258caa0 unknown :-1 s=CLOSED pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.835 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.663+0000 7fd2be681ec0 1 -- 172.21.15.89:0/523840939 >> 172.21.15.89:0/523840939 conn(0x241e770 msgr2=0x24f6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.835 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.663+0000 7fd2be681ec0 1 -- 172.21.15.89:0/523840939 shutdown_connections 2024-09-16T17:03:19.835 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.663+0000 7fd2be681ec0 1 -- 172.21.15.89:0/523840939 wait complete. 2024-09-16T17:03:19.835 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.664+0000 7fd2be681ec0 1 Processor -- start 2024-09-16T17:03:19.835 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.664+0000 7fd2be681ec0 1 -- start start 2024-09-16T17:03:19.835 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.665+0000 7fd2be681ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x24fa120 0x258a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.835 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.665+0000 7fd2be681ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x245c280 con 0x24fa120 2024-09-16T17:03:19.835 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.665+0000 7fd2b679b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x24fa120 0x258a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.835 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.665+0000 7fd2b679b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x24fa120 0x258a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60256/0 (socket says 172.21.15.89:60256) 2024-09-16T17:03:19.836 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.665+0000 7fd2b679b640 1 -- 172.21.15.89:0/3680823782 learned_addr learned my addr 172.21.15.89:0/3680823782 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.836 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.666+0000 7fd2b679b640 1 -- 172.21.15.89:0/3680823782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x23ec920 con 0x24fa120 2024-09-16T17:03:19.836 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.666+0000 7fd2b679b640 1 --2- 172.21.15.89:0/3680823782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x24fa120 0x258a700 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.836 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.666+0000 7fd2af7fe640 1 -- 172.21.15.89:0/3680823782 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd2a00128e0 con 0x24fa120 2024-09-16T17:03:19.836 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.666+0000 7fd2af7fe640 1 -- 172.21.15.89:0/3680823782 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd2a0005040 con 0x24fa120 2024-09-16T17:03:19.836 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.666+0000 7fd2be681ec0 1 -- 172.21.15.89:0/3680823782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x23ec380 con 0x24fa120 2024-09-16T17:03:19.836 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.666+0000 7fd2af7fe640 1 -- 172.21.15.89:0/3680823782 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd2a0012b70 con 0x24fa120 2024-09-16T17:03:19.836 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.666+0000 7fd2be681ec0 1 -- 172.21.15.89:0/3680823782 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x25786d0 con 0x24fa120 2024-09-16T17:03:19.836 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.667+0000 7fd2af7fe640 1 -- 172.21.15.89:0/3680823782 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd2a000d040 con 0x24fa120 2024-09-16T17:03:19.836 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.667+0000 7fd2af7fe640 1 --2- 172.21.15.89:0/3680823782 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fd29c03d170 0x7fd29c03f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.836 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.667+0000 7fd2af7fe640 1 -- 172.21.15.89:0/3680823782 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(700..700 src has 406..700) ==== 3819+0+0 (crc 0 0 0) 0x7fd2a000a040 con 0x24fa120 2024-09-16T17:03:19.836 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.667+0000 7fd2be681ec0 1 --2- 172.21.15.89:0/3680823782 >> v2:172.21.15.177:6806/229775330 conn(0x24fac40 0x2577400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.836 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.667+0000 7fd2be681ec0 1 -- 172.21.15.89:0/3680823782 --> v2:172.21.15.177:6806/229775330 -- osd_op(unknown.0.0:1 199.5 199:a557efb1:::obj8:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e700) -- 0x257ae70 con 0x24fac40 2024-09-16T17:03:19.836 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.667+0000 7fd2b5f9a640 1 --2- 172.21.15.89:0/3680823782 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fd29c03d170 0x7fd29c03f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.837 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.668+0000 7fd2b5f9a640 1 --2- 172.21.15.89:0/3680823782 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fd29c03d170 0x7fd29c03f680 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.837 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.668+0000 7fd2b6f9c640 1 --2- 172.21.15.89:0/3680823782 >> v2:172.21.15.177:6806/229775330 conn(0x24fac40 0x2577400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:19.837 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.671+0000 7fd2b6f9c640 1 --2- 172.21.15.89:0/3680823782 >> v2:172.21.15.177:6806/229775330 conn(0x24fac40 0x2577400 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.837 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.691+0000 7fd2b6f9c640 1 -- 172.21.15.89:0/3680823782 <== osd.2 v2:172.21.15.177:6806/229775330 1 ==== osd_op_reply(1 obj8 [writefull 0~12875] v700'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd2a800a430 con 0x24fac40 2024-09-16T17:03:19.837 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.691+0000 7fd2be681ec0 1 -- 172.21.15.89:0/3680823782 >> v2:172.21.15.177:6806/229775330 conn(0x24fac40 msgr2=0x2577400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.837 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.691+0000 7fd2be681ec0 1 --2- 172.21.15.89:0/3680823782 >> v2:172.21.15.177:6806/229775330 conn(0x24fac40 0x2577400 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.837 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.691+0000 7fd2be681ec0 1 -- 172.21.15.89:0/3680823782 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fd29c03d170 msgr2=0x7fd29c03f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.837 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.691+0000 7fd2be681ec0 1 --2- 172.21.15.89:0/3680823782 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fd29c03d170 0x7fd29c03f680 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.837 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.691+0000 7fd2be681ec0 1 -- 172.21.15.89:0/3680823782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x24fa120 msgr2=0x258a700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.837 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.691+0000 7fd2be681ec0 1 --2- 172.21.15.89:0/3680823782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x24fa120 0x258a700 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.837 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.691+0000 7fd2be681ec0 1 -- 172.21.15.89:0/3680823782 shutdown_connections 2024-09-16T17:03:19.837 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.691+0000 7fd2be681ec0 1 --2- 172.21.15.89:0/3680823782 >> v2:172.21.15.177:6806/229775330 conn(0x24fac40 0x2577400 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.837 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.691+0000 7fd2be681ec0 1 --2- 172.21.15.89:0/3680823782 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fd29c03d170 0x7fd29c03f680 unknown :-1 s=CLOSED pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.838 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.691+0000 7fd2be681ec0 1 --2- 172.21.15.89:0/3680823782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x24fa120 0x258a700 unknown :-1 s=CLOSED pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.838 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.691+0000 7fd2be681ec0 1 -- 172.21.15.89:0/3680823782 >> 172.21.15.89:0/3680823782 conn(0x241e770 msgr2=0x258c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.838 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.691+0000 7fd2be681ec0 1 -- 172.21.15.89:0/3680823782 shutdown_connections 2024-09-16T17:03:19.838 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.691+0000 7fd2be681ec0 1 -- 172.21.15.89:0/3680823782 wait complete. 2024-09-16T17:03:19.838 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:19.838 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p ad5c36b8-029a-4232-9d54-ea1601f1a3e9 put obj9 /etc/passwd 2024-09-16T17:03:19.838 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.729+0000 7f3b8b031ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.838 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.734+0000 7f3b8b031ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.838 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.734+0000 7f3b8b031ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.838 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.735+0000 7f3b8b031ec0 1 Processor -- start 2024-09-16T17:03:19.838 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.735+0000 7f3b8b031ec0 1 -- start start 2024-09-16T17:03:19.838 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.736+0000 7f3b8b031ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe1aea0 0xea1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.838 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.736+0000 7f3b8b031ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0xcee520 con 0xe1aea0 2024-09-16T17:03:19.838 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.736+0000 7f3b8319b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe1aea0 0xea1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.839 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.736+0000 7f3b8319b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe1aea0 0xea1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60280/0 (socket says 172.21.15.89:60280) 2024-09-16T17:03:19.839 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.736+0000 7f3b8319b640 1 -- 172.21.15.89:0/880899297 learned_addr learned my addr 172.21.15.89:0/880899297 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.839 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.736+0000 7f3b8319b640 1 -- 172.21.15.89:0/880899297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xc8ae10 con 0xe1aea0 2024-09-16T17:03:19.839 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.736+0000 7f3b8319b640 1 --2- 172.21.15.89:0/880899297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe1aea0 0xea1db0 crc :-1 s=READY pgs=12881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbdaadc7b42fdeb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.839 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.736+0000 7f3b81998640 1 -- 172.21.15.89:0/880899297 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b6c00d790 con 0xe1aea0 2024-09-16T17:03:19.839 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.736+0000 7f3b81998640 1 -- 172.21.15.89:0/880899297 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3b6c00d8f0 con 0xe1aea0 2024-09-16T17:03:19.839 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.736+0000 7f3b81998640 1 -- 172.21.15.89:0/880899297 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b6c00db90 con 0xe1aea0 2024-09-16T17:03:19.839 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.737+0000 7f3b8b031ec0 1 -- 172.21.15.89:0/880899297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe1aea0 msgr2=0xea1db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.839 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.737+0000 7f3b8b031ec0 1 --2- 172.21.15.89:0/880899297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe1aea0 0xea1db0 crc :-1 s=READY pgs=12881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.839 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.737+0000 7f3b8b031ec0 1 -- 172.21.15.89:0/880899297 shutdown_connections 2024-09-16T17:03:19.839 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.737+0000 7f3b8b031ec0 1 --2- 172.21.15.89:0/880899297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe1aea0 0xea1db0 unknown :-1 s=CLOSED pgs=12881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.839 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.737+0000 7f3b8b031ec0 1 -- 172.21.15.89:0/880899297 >> 172.21.15.89:0/880899297 conn(0xcae770 msgr2=0xd8bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.839 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.737+0000 7f3b8b031ec0 1 -- 172.21.15.89:0/880899297 shutdown_connections 2024-09-16T17:03:19.839 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.737+0000 7f3b8b031ec0 1 -- 172.21.15.89:0/880899297 wait complete. 2024-09-16T17:03:19.840 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.738+0000 7f3b8b031ec0 1 Processor -- start 2024-09-16T17:03:19.840 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.738+0000 7f3b8b031ec0 1 -- start start 2024-09-16T17:03:19.840 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.739+0000 7f3b8b031ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe1aea0 0xe14570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.840 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.739+0000 7f3b8b031ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0xcec280 con 0xe1aea0 2024-09-16T17:03:19.840 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.739+0000 7f3b8319b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe1aea0 0xe14570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.840 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.739+0000 7f3b8319b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe1aea0 0xe14570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60288/0 (socket says 172.21.15.89:60288) 2024-09-16T17:03:19.840 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.739+0000 7f3b8319b640 1 -- 172.21.15.89:0/709991107 learned_addr learned my addr 172.21.15.89:0/709991107 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.840 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.739+0000 7f3b8319b640 1 -- 172.21.15.89:0/709991107 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xc7c920 con 0xe1aea0 2024-09-16T17:03:19.840 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.739+0000 7f3b8319b640 1 --2- 172.21.15.89:0/709991107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe1aea0 0xe14570 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.840 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.740+0000 7f3b80996640 1 -- 172.21.15.89:0/709991107 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b6c009380 con 0xe1aea0 2024-09-16T17:03:19.840 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.740+0000 7f3b80996640 1 -- 172.21.15.89:0/709991107 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3b6c013040 con 0xe1aea0 2024-09-16T17:03:19.840 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.740+0000 7f3b8b031ec0 1 -- 172.21.15.89:0/709991107 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xc7c380 con 0xe1aea0 2024-09-16T17:03:19.840 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.740+0000 7f3b80996640 1 -- 172.21.15.89:0/709991107 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b6c009610 con 0xe1aea0 2024-09-16T17:03:19.841 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.740+0000 7f3b8b031ec0 1 -- 172.21.15.89:0/709991107 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0xd875d0 con 0xe1aea0 2024-09-16T17:03:19.841 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.741+0000 7f3b80996640 1 -- 172.21.15.89:0/709991107 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3b6c009770 con 0xe1aea0 2024-09-16T17:03:19.841 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.741+0000 7f3b80996640 1 --2- 172.21.15.89:0/709991107 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f3b6803d1c0 0x7f3b6803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.841 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.741+0000 7f3b80996640 1 -- 172.21.15.89:0/709991107 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(700..700 src has 406..700) ==== 3819+0+0 (crc 0 0 0) 0x7f3b6c051e30 con 0xe1aea0 2024-09-16T17:03:19.841 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.741+0000 7f3b8b031ec0 1 --2- 172.21.15.89:0/709991107 >> v2:172.21.15.89:6801/3499031688 conn(0xe1b9c0 0xd837d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.841 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.741+0000 7f3b8b031ec0 1 -- 172.21.15.89:0/709991107 --> v2:172.21.15.89:6801/3499031688 -- osd_op(unknown.0.0:1 199.7 199:fe351e27:::obj9:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e700) -- 0xd870b0 con 0xe1b9c0 2024-09-16T17:03:19.841 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.741+0000 7f3b8299a640 1 --2- 172.21.15.89:0/709991107 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f3b6803d1c0 0x7f3b6803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.841 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.742+0000 7f3b8399c640 1 --2- 172.21.15.89:0/709991107 >> v2:172.21.15.89:6801/3499031688 conn(0xe1b9c0 0xd837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:19.841 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.742+0000 7f3b8299a640 1 --2- 172.21.15.89:0/709991107 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f3b6803d1c0 0x7f3b6803f6d0 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.841 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.744+0000 7f3b8399c640 1 --2- 172.21.15.89:0/709991107 >> v2:172.21.15.89:6801/3499031688 conn(0xe1b9c0 0xd837d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.841 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.765+0000 7f3b8399c640 1 -- 172.21.15.89:0/709991107 <== osd.0 v2:172.21.15.89:6801/3499031688 1 ==== osd_op_reply(1 obj9 [writefull 0~12875] v700'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3b7400a430 con 0xe1b9c0 2024-09-16T17:03:19.841 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.765+0000 7f3b8b031ec0 1 -- 172.21.15.89:0/709991107 >> v2:172.21.15.89:6801/3499031688 conn(0xe1b9c0 msgr2=0xd837d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.841 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.765+0000 7f3b8b031ec0 1 --2- 172.21.15.89:0/709991107 >> v2:172.21.15.89:6801/3499031688 conn(0xe1b9c0 0xd837d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.841 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.765+0000 7f3b8b031ec0 1 -- 172.21.15.89:0/709991107 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f3b6803d1c0 msgr2=0x7f3b6803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.842 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.765+0000 7f3b8b031ec0 1 --2- 172.21.15.89:0/709991107 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f3b6803d1c0 0x7f3b6803f6d0 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.842 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.765+0000 7f3b8b031ec0 1 -- 172.21.15.89:0/709991107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe1aea0 msgr2=0xe14570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.842 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.765+0000 7f3b8b031ec0 1 --2- 172.21.15.89:0/709991107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe1aea0 0xe14570 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.842 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.765+0000 7f3b8b031ec0 1 -- 172.21.15.89:0/709991107 shutdown_connections 2024-09-16T17:03:19.842 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.765+0000 7f3b8b031ec0 1 --2- 172.21.15.89:0/709991107 >> v2:172.21.15.89:6801/3499031688 conn(0xe1b9c0 0xd837d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.842 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.765+0000 7f3b8b031ec0 1 --2- 172.21.15.89:0/709991107 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f3b6803d1c0 0x7f3b6803f6d0 unknown :-1 s=CLOSED pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.842 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.765+0000 7f3b8b031ec0 1 --2- 172.21.15.89:0/709991107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xe1aea0 0xe14570 unknown :-1 s=CLOSED pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.842 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.765+0000 7f3b8b031ec0 1 -- 172.21.15.89:0/709991107 >> 172.21.15.89:0/709991107 conn(0xcae770 msgr2=0xe1b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.842 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.765+0000 7f3b8b031ec0 1 -- 172.21.15.89:0/709991107 shutdown_connections 2024-09-16T17:03:19.842 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.765+0000 7f3b8b031ec0 1 -- 172.21.15.89:0/709991107 wait complete. 2024-09-16T17:03:19.842 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:03:19.842 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p ad5c36b8-029a-4232-9d54-ea1601f1a3e9 put obj10 /etc/passwd 2024-09-16T17:03:19.842 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.805+0000 7f2e7367aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.843 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.810+0000 7f2e7367aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.843 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.810+0000 7f2e7367aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:19.843 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.811+0000 7f2e7367aec0 1 Processor -- start 2024-09-16T17:03:19.843 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.811+0000 7f2e7367aec0 1 -- start start 2024-09-16T17:03:19.843 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.812+0000 7f2e7367aec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc89810 0xc776f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.843 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.812+0000 7f2e7367aec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0xbf6520 con 0xc89810 2024-09-16T17:03:19.843 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.812+0000 7f2e6b79b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc89810 0xc776f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.843 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.812+0000 7f2e6b79b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc89810 0xc776f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60306/0 (socket says 172.21.15.89:60306) 2024-09-16T17:03:19.843 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.812+0000 7f2e6b79b640 1 -- 172.21.15.89:0/679079382 learned_addr learned my addr 172.21.15.89:0/679079382 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.843 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.812+0000 7f2e6b79b640 1 -- 172.21.15.89:0/679079382 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb92e10 con 0xc89810 2024-09-16T17:03:19.843 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.812+0000 7f2e6b79b640 1 --2- 172.21.15.89:0/679079382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc89810 0xc776f0 crc :-1 s=READY pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b395e6c1a1a262 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.843 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.812+0000 7f2e69f98640 1 -- 172.21.15.89:0/679079382 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2e5402dc90 con 0xc89810 2024-09-16T17:03:19.843 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.813+0000 7f2e69f98640 1 -- 172.21.15.89:0/679079382 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2e5402de90 con 0xc89810 2024-09-16T17:03:19.843 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.813+0000 7f2e69f98640 1 -- 172.21.15.89:0/679079382 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2e5400a170 con 0xc89810 2024-09-16T17:03:19.844 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.813+0000 7f2e7367aec0 1 -- 172.21.15.89:0/679079382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc89810 msgr2=0xc776f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.844 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.813+0000 7f2e7367aec0 1 --2- 172.21.15.89:0/679079382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc89810 0xc776f0 crc :-1 s=READY pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.844 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.813+0000 7f2e7367aec0 1 -- 172.21.15.89:0/679079382 shutdown_connections 2024-09-16T17:03:19.844 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.813+0000 7f2e7367aec0 1 --2- 172.21.15.89:0/679079382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc89810 0xc776f0 unknown :-1 s=CLOSED pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.844 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.813+0000 7f2e7367aec0 1 -- 172.21.15.89:0/679079382 >> 172.21.15.89:0/679079382 conn(0xbb6770 msgr2=0xc8afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.844 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.813+0000 7f2e7367aec0 1 -- 172.21.15.89:0/679079382 shutdown_connections 2024-09-16T17:03:19.844 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.813+0000 7f2e7367aec0 1 -- 172.21.15.89:0/679079382 wait complete. 2024-09-16T17:03:19.844 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.814+0000 7f2e7367aec0 1 Processor -- start 2024-09-16T17:03:19.844 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.814+0000 7f2e7367aec0 1 -- start start 2024-09-16T17:03:19.844 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.815+0000 7f2e7367aec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc89810 0xd16f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.844 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.815+0000 7f2e7367aec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0xbf4280 con 0xc89810 2024-09-16T17:03:19.844 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.815+0000 7f2e6b79b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc89810 0xd16f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.844 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.815+0000 7f2e6b79b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc89810 0xd16f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:60320/0 (socket says 172.21.15.89:60320) 2024-09-16T17:03:19.844 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.815+0000 7f2e6b79b640 1 -- 172.21.15.89:0/1548128279 learned_addr learned my addr 172.21.15.89:0/1548128279 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:19.845 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.815+0000 7f2e6b79b640 1 -- 172.21.15.89:0/1548128279 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb84920 con 0xc89810 2024-09-16T17:03:19.845 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.816+0000 7f2e6b79b640 1 --2- 172.21.15.89:0/1548128279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc89810 0xd16f30 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.845 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.816+0000 7f2e68f96640 1 -- 172.21.15.89:0/1548128279 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2e5403e040 con 0xc89810 2024-09-16T17:03:19.845 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.816+0000 7f2e68f96640 1 -- 172.21.15.89:0/1548128279 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2e54039660 con 0xc89810 2024-09-16T17:03:19.845 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.816+0000 7f2e7367aec0 1 -- 172.21.15.89:0/1548128279 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xb84380 con 0xc89810 2024-09-16T17:03:19.845 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.816+0000 7f2e68f96640 1 -- 172.21.15.89:0/1548128279 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2e54039900 con 0xc89810 2024-09-16T17:03:19.845 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.816+0000 7f2e7367aec0 1 -- 172.21.15.89:0/1548128279 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0xd169f0 con 0xc89810 2024-09-16T17:03:19.845 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.817+0000 7f2e68f96640 1 -- 172.21.15.89:0/1548128279 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2e54039b00 con 0xc89810 2024-09-16T17:03:19.845 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.817+0000 7f2e68f96640 1 --2- 172.21.15.89:0/1548128279 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2e5003d170 0x7f2e5003f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.845 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.817+0000 7f2e68f96640 1 -- 172.21.15.89:0/1548128279 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(700..700 src has 406..700) ==== 3819+0+0 (crc 0 0 0) 0x7f2e54032040 con 0xc89810 2024-09-16T17:03:19.845 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.817+0000 7f2e7367aec0 1 --2- 172.21.15.89:0/1548128279 >> v2:172.21.15.89:6801/3499031688 conn(0xc92660 0xd142b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:19.845 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.817+0000 7f2e7367aec0 1 -- 172.21.15.89:0/1548128279 --> v2:172.21.15.89:6801/3499031688 -- osd_op(unknown.0.0:1 199.b 199:d1337354:::obj10:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e700) -- 0xdb9100 con 0xc92660 2024-09-16T17:03:19.845 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.817+0000 7f2e6af9a640 1 --2- 172.21.15.89:0/1548128279 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2e5003d170 0x7f2e5003f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:19.845 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.818+0000 7f2e6af9a640 1 --2- 172.21.15.89:0/1548128279 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2e5003d170 0x7f2e5003f680 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.846 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.818+0000 7f2e6bf9c640 1 --2- 172.21.15.89:0/1548128279 >> v2:172.21.15.89:6801/3499031688 conn(0xc92660 0xd142b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:19.846 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.821+0000 7f2e6bf9c640 1 --2- 172.21.15.89:0/1548128279 >> v2:172.21.15.89:6801/3499031688 conn(0xc92660 0xd142b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:19.847 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.842+0000 7f2e6bf9c640 1 -- 172.21.15.89:0/1548128279 <== osd.0 v2:172.21.15.89:6801/3499031688 1 ==== osd_op_reply(1 obj10 [writefull 0~12875] v700'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2e5c00a430 con 0xc92660 2024-09-16T17:03:19.847 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.842+0000 7f2e7367aec0 1 -- 172.21.15.89:0/1548128279 >> v2:172.21.15.89:6801/3499031688 conn(0xc92660 msgr2=0xd142b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.847 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.842+0000 7f2e7367aec0 1 --2- 172.21.15.89:0/1548128279 >> v2:172.21.15.89:6801/3499031688 conn(0xc92660 0xd142b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.847 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.843+0000 7f2e7367aec0 1 -- 172.21.15.89:0/1548128279 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2e5003d170 msgr2=0x7f2e5003f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.847 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.843+0000 7f2e7367aec0 1 --2- 172.21.15.89:0/1548128279 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2e5003d170 0x7f2e5003f680 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.847 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.843+0000 7f2e7367aec0 1 -- 172.21.15.89:0/1548128279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc89810 msgr2=0xd16f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:19.847 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.843+0000 7f2e7367aec0 1 --2- 172.21.15.89:0/1548128279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc89810 0xd16f30 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.847 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.843+0000 7f2e7367aec0 1 -- 172.21.15.89:0/1548128279 shutdown_connections 2024-09-16T17:03:19.847 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.843+0000 7f2e7367aec0 1 --2- 172.21.15.89:0/1548128279 >> v2:172.21.15.89:6801/3499031688 conn(0xc92660 0xd142b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.848 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.843+0000 7f2e7367aec0 1 --2- 172.21.15.89:0/1548128279 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2e5003d170 0x7f2e5003f680 unknown :-1 s=CLOSED pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.848 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.843+0000 7f2e7367aec0 1 --2- 172.21.15.89:0/1548128279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xc89810 0xd16f30 unknown :-1 s=CLOSED pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:19.848 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.843+0000 7f2e7367aec0 1 -- 172.21.15.89:0/1548128279 >> 172.21.15.89:0/1548128279 conn(0xbb6770 msgr2=0xc8afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:19.848 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.843+0000 7f2e7367aec0 1 -- 172.21.15.89:0/1548128279 shutdown_connections 2024-09-16T17:03:19.848 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:19.843+0000 7f2e7367aec0 1 -- 172.21.15.89:0/1548128279 wait complete. 2024-09-16T17:03:19.848 INFO:tasks.workunit.client.0.smithi089.stderr:+ sleep 30 2024-09-16T17:03:49.848 INFO:tasks.workunit.client.0.smithi089.stderr:+ pid=95555 2024-09-16T17:03:49.848 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph osd pool set-quota ad5c36b8-029a-4232-9d54-ea1601f1a3e9 max_objects 100 2024-09-16T17:03:49.848 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p ad5c36b8-029a-4232-9d54-ea1601f1a3e9 put onemore /etc/passwd 2024-09-16T17:03:49.889 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.888+0000 7f9405d22ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:49.895 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.893+0000 7f9405d22ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:49.895 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.893+0000 7f9405d22ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:49.896 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.894+0000 7f9405d22ec0 1 Processor -- start 2024-09-16T17:03:49.896 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.894+0000 7f9405d22ec0 1 -- start start 2024-09-16T17:03:49.898 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.895+0000 7f9405d22ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x14eb120 0x16060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:49.898 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.895+0000 7f9405d22ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x144f520 con 0x14eb120 2024-09-16T17:03:49.898 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.895+0000 7f93fe19b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x14eb120 0x16060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:49.898 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.895+0000 7f93fe19b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x14eb120 0x16060a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37516/0 (socket says 172.21.15.89:37516) 2024-09-16T17:03:49.898 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.895+0000 7f93fe19b640 1 -- 172.21.15.89:0/3247378800 learned_addr learned my addr 172.21.15.89:0/3247378800 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:49.898 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.895+0000 7f93fe19b640 1 -- 172.21.15.89:0/3247378800 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13ebe10 con 0x14eb120 2024-09-16T17:03:49.898 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.896+0000 7f93fe19b640 1 --2- 172.21.15.89:0/3247378800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x14eb120 0x16060a0 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6804c0f6001f5c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:49.898 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.896+0000 7f93fc998640 1 -- 172.21.15.89:0/3247378800 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f93e800b580 con 0x14eb120 2024-09-16T17:03:49.898 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.896+0000 7f93fc998640 1 -- 172.21.15.89:0/3247378800 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f93e800b6e0 con 0x14eb120 2024-09-16T17:03:49.898 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.896+0000 7f93fc998640 1 -- 172.21.15.89:0/3247378800 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f93e800b980 con 0x14eb120 2024-09-16T17:03:49.899 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.897+0000 7f9405d22ec0 1 -- 172.21.15.89:0/3247378800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x14eb120 msgr2=0x16060a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:49.899 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.897+0000 7f9405d22ec0 1 --2- 172.21.15.89:0/3247378800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x14eb120 0x16060a0 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:49.900 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.897+0000 7f9405d22ec0 1 -- 172.21.15.89:0/3247378800 shutdown_connections 2024-09-16T17:03:49.900 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.897+0000 7f9405d22ec0 1 --2- 172.21.15.89:0/3247378800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x14eb120 0x16060a0 unknown :-1 s=CLOSED pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:49.900 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.897+0000 7f9405d22ec0 1 -- 172.21.15.89:0/3247378800 >> 172.21.15.89:0/3247378800 conn(0x140f770 msgr2=0x14e5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:49.900 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.897+0000 7f9405d22ec0 1 -- 172.21.15.89:0/3247378800 shutdown_connections 2024-09-16T17:03:49.900 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.897+0000 7f9405d22ec0 1 -- 172.21.15.89:0/3247378800 wait complete. 2024-09-16T17:03:49.900 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.898+0000 7f9405d22ec0 1 Processor -- start 2024-09-16T17:03:49.900 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.898+0000 7f9405d22ec0 1 -- start start 2024-09-16T17:03:49.901 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.899+0000 7f9405d22ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x14eb120 0x1612170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:49.901 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.899+0000 7f9405d22ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x144d280 con 0x14eb120 2024-09-16T17:03:49.901 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.899+0000 7f93fe19b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x14eb120 0x1612170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:49.901 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.899+0000 7f93fe19b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x14eb120 0x1612170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37520/0 (socket says 172.21.15.89:37520) 2024-09-16T17:03:49.901 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.899+0000 7f93fe19b640 1 -- 172.21.15.89:0/2521324297 learned_addr learned my addr 172.21.15.89:0/2521324297 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:49.901 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.899+0000 7f93fe19b640 1 -- 172.21.15.89:0/2521324297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13dd920 con 0x14eb120 2024-09-16T17:03:49.902 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.900+0000 7f93fe19b640 1 --2- 172.21.15.89:0/2521324297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x14eb120 0x1612170 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:49.902 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.900+0000 7f93f6ffd640 1 -- 172.21.15.89:0/2521324297 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f93e8012b10 con 0x14eb120 2024-09-16T17:03:49.902 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.900+0000 7f93f6ffd640 1 -- 172.21.15.89:0/2521324297 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f93e8005040 con 0x14eb120 2024-09-16T17:03:49.902 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.900+0000 7f9405d22ec0 1 -- 172.21.15.89:0/2521324297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x13dd380 con 0x14eb120 2024-09-16T17:03:49.903 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.900+0000 7f93f6ffd640 1 -- 172.21.15.89:0/2521324297 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f93e8012da0 con 0x14eb120 2024-09-16T17:03:49.903 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.900+0000 7f9405d22ec0 1 -- 172.21.15.89:0/2521324297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x156d7d0 con 0x14eb120 2024-09-16T17:03:49.904 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.901+0000 7f93f6ffd640 1 -- 172.21.15.89:0/2521324297 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f93e800d040 con 0x14eb120 2024-09-16T17:03:49.904 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.902+0000 7f93f6ffd640 1 --2- 172.21.15.89:0/2521324297 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f93e403d1c0 0x7f93e403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:49.904 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.902+0000 7f93f6ffd640 1 -- 172.21.15.89:0/2521324297 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(701..701 src has 406..701) ==== 3819+0+0 (crc 0 0 0) 0x7f93e800a040 con 0x14eb120 2024-09-16T17:03:49.904 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.902+0000 7f93f6ffd640 1 -- 172.21.15.89:0/2521324297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=702}) -- 0x7f93e40434b0 con 0x14eb120 2024-09-16T17:03:49.904 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.902+0000 7f9405d22ec0 1 --2- 172.21.15.89:0/2521324297 >> v2:172.21.15.177:6806/229775330 conn(0x14ebc40 0x156c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:49.904 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.902+0000 7f93fd99a640 1 --2- 172.21.15.89:0/2521324297 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f93e403d1c0 0x7f93e403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:49.904 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.903+0000 7f93fd99a640 1 --2- 172.21.15.89:0/2521324297 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f93e403d1c0 0x7f93e403f6d0 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:49.905 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.903+0000 7f93fe99c640 1 --2- 172.21.15.89:0/2521324297 >> v2:172.21.15.177:6806/229775330 conn(0x14ebc40 0x156c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:49.908 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.906+0000 7f93fe99c640 1 --2- 172.21.15.89:0/2521324297 >> v2:172.21.15.177:6806/229775330 conn(0x14ebc40 0x156c420 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:49.949 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.939+0000 7f4ee1151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:49.950 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.949+0000 7f4ee1151640 1 Processor -- start 2024-09-16T17:03:49.951 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.949+0000 7f4ee1151640 1 -- start start 2024-09-16T17:03:49.952 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.950+0000 7f4ee1151640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4edc0a2df0 0x7f4edc0a3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:49.952 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.950+0000 7f4ee1151640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4edc0a2460 con 0x7f4edc135510 2024-09-16T17:03:49.953 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.950+0000 7f4ee1151640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f4edc0a3d40 con 0x7f4edc0a2df0 2024-09-16T17:03:49.953 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.950+0000 7f4edad9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4edc0a2df0 0x7f4edc0a3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:49.953 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.950+0000 7f4ed3fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4edc135510 0x7f4edc135920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58292/0 (socket says 172.21.15.89:58292) 2024-09-16T17:03:49.953 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.950+0000 7f4ed3fff640 1 -- 172.21.15.89:0/1217414628 learned_addr learned my addr 172.21.15.89:0/1217414628 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:03:49.953 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.950+0000 7f4edad9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4edc0a2df0 0x7f4edc0a3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37526/0 (socket says 172.21.15.89:37526) 2024-09-16T17:03:49.953 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.950+0000 7f4edad9d640 1 -- 172.21.15.89:0/1217414628 >> v1:172.21.15.89:6789/0 conn(0x7f4edc135510 legacy=0x7f4edc135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:49.953 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.950+0000 7f4edad9d640 1 -- 172.21.15.89:0/1217414628 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4edc0a29a0 con 0x7f4edc0a2df0 2024-09-16T17:03:49.953 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.950+0000 7f4eda59c640 1 -- 172.21.15.89:0/1217414628 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1397899442 0 0) 0x7f4edc0a2460 con 0x7f4edc135510 2024-09-16T17:03:49.953 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.950+0000 7f4edad9d640 1 --2- 172.21.15.89:0/1217414628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0a2df0 0x7f4edc0a3200 crc :-1 s=READY pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c499abd3f75c816f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:49.953 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.951+0000 7f4eda59c640 1 -- 172.21.15.89:0/1217414628 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4ecc009d90 con 0x7f4edc0a2df0 2024-09-16T17:03:49.953 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.951+0000 7f4eda59c640 1 -- 172.21.15.89:0/1217414628 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4ecc00e230 con 0x7f4edc0a2df0 2024-09-16T17:03:49.953 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.951+0000 7f4eda59c640 1 -- 172.21.15.89:0/1217414628 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4ecc00e4d0 con 0x7f4edc0a2df0 2024-09-16T17:03:49.954 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.951+0000 7f4ee1151640 1 -- 172.21.15.89:0/1217414628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0a2df0 msgr2=0x7f4edc0a3200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:49.954 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.951+0000 7f4ee1151640 1 --2- 172.21.15.89:0/1217414628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0a2df0 0x7f4edc0a3200 crc :-1 s=READY pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:49.954 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.951+0000 7f4ee1151640 1 -- 172.21.15.89:0/1217414628 shutdown_connections 2024-09-16T17:03:49.954 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.951+0000 7f4ee1151640 1 --2- 172.21.15.89:0/1217414628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0a2df0 0x7f4edc0a3200 unknown :-1 s=CLOSED pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:49.955 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.951+0000 7f4ee1151640 1 -- 172.21.15.89:0/1217414628 >> 172.21.15.89:0/1217414628 conn(0x7f4edc0a4ad0 msgr2=0x7f4edc0a4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:49.955 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.951+0000 7f4ee1151640 1 -- 172.21.15.89:0/1217414628 shutdown_connections 2024-09-16T17:03:49.955 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.951+0000 7f4ee1151640 1 -- 172.21.15.89:0/1217414628 wait complete. 2024-09-16T17:03:49.955 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.952+0000 7f4ee1151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:49.955 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.953+0000 7f4ee1151640 1 Processor -- start 2024-09-16T17:03:49.955 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.953+0000 7f4ee1151640 1 -- start start 2024-09-16T17:03:49.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.954+0000 7f4ee1151640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0a2df0 0x7f4edc120690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:49.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.954+0000 7f4ee1151640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4edc11fcb0 con 0x7f4edc0a2df0 2024-09-16T17:03:49.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.954+0000 7f4edad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0a2df0 0x7f4edc120690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:49.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.954+0000 7f4edad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0a2df0 0x7f4edc120690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37536/0 (socket says 172.21.15.89:37536) 2024-09-16T17:03:49.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.954+0000 7f4edad9d640 1 -- 172.21.15.89:0/3128582842 learned_addr learned my addr 172.21.15.89:0/3128582842 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:49.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.954+0000 7f4edad9d640 1 -- 172.21.15.89:0/3128582842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4edc120240 con 0x7f4edc0a2df0 2024-09-16T17:03:49.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.955+0000 7f4edad9d640 1 --2- 172.21.15.89:0/3128582842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0a2df0 0x7f4edc120690 crc :-1 s=READY pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:49.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.955+0000 7f4ed37fe640 1 -- 172.21.15.89:0/3128582842 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4ecc013610 con 0x7f4edc0a2df0 2024-09-16T17:03:49.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.955+0000 7f4ed37fe640 1 -- 172.21.15.89:0/3128582842 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4ecc013770 con 0x7f4edc0a2df0 2024-09-16T17:03:49.958 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.955+0000 7f4ee1151640 1 -- 172.21.15.89:0/3128582842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4edc1216f0 con 0x7f4edc0a2df0 2024-09-16T17:03:49.958 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.955+0000 7f4ed37fe640 1 -- 172.21.15.89:0/3128582842 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4ecc013a10 con 0x7f4edc0a2df0 2024-09-16T17:03:49.958 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.955+0000 7f4ee1151640 1 -- 172.21.15.89:0/3128582842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4edc123be0 con 0x7f4edc0a2df0 2024-09-16T17:03:49.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.956+0000 7f4ed37fe640 1 -- 172.21.15.89:0/3128582842 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4ecc013bc0 con 0x7f4edc0a2df0 2024-09-16T17:03:49.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.956+0000 7f4ed37fe640 1 --2- 172.21.15.89:0/3128582842 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f4ebc03e930 0x7f4ebc040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:49.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.956+0000 7f4ed37fe640 1 -- 172.21.15.89:0/3128582842 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(701..701 src has 406..701) ==== 3819+0+0 (crc 0 0 0) 0x7f4ecc018040 con 0x7f4edc0a2df0 2024-09-16T17:03:49.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.956+0000 7f4ee1151640 1 -- 172.21.15.89:0/3128582842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4edc09d430 con 0x7f4edc0a2df0 2024-09-16T17:03:49.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.956+0000 7f4ed37fe640 1 -- 172.21.15.89:0/3128582842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=702}) -- 0x7f4ebc044bc0 con 0x7f4edc0a2df0 2024-09-16T17:03:49.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.956+0000 7f4ed3fff640 1 --2- 172.21.15.89:0/3128582842 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f4ebc03e930 0x7f4ebc040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:49.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.957+0000 7f4ed3fff640 1 --2- 172.21.15.89:0/3128582842 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f4ebc03e930 0x7f4ebc040e40 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:49.963 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:49.961+0000 7f4ed37fe640 1 -- 172.21.15.89:0/3128582842 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f4ecc011570 con 0x7f4edc0a2df0 2024-09-16T17:03:50.137 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:50.136+0000 7f4ee1151640 1 -- 172.21.15.89:0/3128582842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_objects", "val": "100"} v 0) -- 0x7f4edc121ed0 con 0x7f4edc0a2df0 2024-09-16T17:03:50.437 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:50.435+0000 7f4ed37fe640 1 -- 172.21.15.89:0/3128582842 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 v702) ==== 225+0+0 (crc 0 0 0) 0x7f4ecc018bf0 con 0x7f4edc0a2df0 2024-09-16T17:03:50.443 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:50.438+0000 7f93f6ffd640 1 -- 172.21.15.89:0/2521324297 <== mon.0 v2:172.21.15.89:3300/0 6 ==== osd_map(702..702 src has 406..702) ==== 628+0+0 (crc 0 0 0) 0x7f93e80030d0 con 0x14eb120 2024-09-16T17:03:50.443 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:50.438+0000 7f4ed37fe640 1 -- 172.21.15.89:0/3128582842 <== mon.0 v2:172.21.15.89:3300/0 8 ==== osd_map(702..702 src has 406..702) ==== 628+0+0 (crc 0 0 0) 0x7f4ecc012e30 con 0x7f4edc0a2df0 2024-09-16T17:03:50.443 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:50.438+0000 7f93f6ffd640 1 -- 172.21.15.89:0/2521324297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=703}) -- 0x7f93e4043bf0 con 0x14eb120 2024-09-16T17:03:50.444 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:50.438+0000 7f4ed37fe640 1 -- 172.21.15.89:0/3128582842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=703}) -- 0x7f4ebc045b40 con 0x7f4edc0a2df0 2024-09-16T17:03:50.552 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:50.550+0000 7f4ee1151640 1 -- 172.21.15.89:0/3128582842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_objects", "val": "100"} v 0) -- 0x7f4edc0698c0 con 0x7f4edc0a2df0 2024-09-16T17:03:51.452 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.450+0000 7f4ed37fe640 1 -- 172.21.15.89:0/3128582842 <== mon.0 v2:172.21.15.89:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 v703) ==== 225+0+0 (crc 0 0 0) 0x7f4ecc018db0 con 0x7f4edc0a2df0 2024-09-16T17:03:51.452 INFO:tasks.workunit.client.0.smithi089.stderr:set-quota max_objects = 100 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 2024-09-16T17:03:51.455 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.452+0000 7f93f6ffd640 1 -- 172.21.15.89:0/2521324297 <== mon.0 v2:172.21.15.89:3300/0 7 ==== osd_map(703..703 src has 406..703) ==== 628+0+0 (crc 0 0 0) 0x7f93e80077b0 con 0x14eb120 2024-09-16T17:03:51.455 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.452+0000 7f4ed37fe640 1 -- 172.21.15.89:0/3128582842 <== mon.0 v2:172.21.15.89:3300/0 10 ==== osd_map(703..703 src has 406..703) ==== 628+0+0 (crc 0 0 0) 0x7f4ecc017190 con 0x7f4edc0a2df0 2024-09-16T17:03:51.455 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.452+0000 7f93f6ffd640 1 -- 172.21.15.89:0/2521324297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=704}) -- 0x7f93e4043e10 con 0x14eb120 2024-09-16T17:03:51.455 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.452+0000 7f4ee1151640 1 -- 172.21.15.89:0/3128582842 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f4ebc03e930 msgr2=0x7f4ebc040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:51.455 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.452+0000 7f4ee1151640 1 --2- 172.21.15.89:0/3128582842 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f4ebc03e930 0x7f4ebc040e40 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:51.455 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.452+0000 7f4ee1151640 1 -- 172.21.15.89:0/3128582842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0a2df0 msgr2=0x7f4edc120690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:51.455 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.452+0000 7f4ee1151640 1 --2- 172.21.15.89:0/3128582842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0a2df0 0x7f4edc120690 crc :-1 s=READY pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:51.455 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.452+0000 7f4ee1151640 1 -- 172.21.15.89:0/3128582842 shutdown_connections 2024-09-16T17:03:51.455 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.452+0000 7f4ee1151640 1 --2- 172.21.15.89:0/3128582842 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f4ebc03e930 0x7f4ebc040e40 crc :-1 s=CLOSED pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:51.455 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.452+0000 7f4ee1151640 1 --2- 172.21.15.89:0/3128582842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0a2df0 0x7f4edc120690 unknown :-1 s=CLOSED pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:51.455 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.453+0000 7f4ee1151640 1 -- 172.21.15.89:0/3128582842 >> 172.21.15.89:0/3128582842 conn(0x7f4edc0a4ad0 msgr2=0x7f4edc133fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:51.456 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.453+0000 7f4ee1151640 1 -- 172.21.15.89:0/3128582842 shutdown_connections 2024-09-16T17:03:51.456 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.453+0000 7f4ee1151640 1 -- 172.21.15.89:0/3128582842 wait complete. 2024-09-16T17:03:51.468 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 95555 2024-09-16T17:03:51.948 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.945+0000 7f93f6ffd640 1 -- 172.21.15.89:0/2521324297 <== mon.0 v2:172.21.15.89:3300/0 8 ==== osd_map(704..704 src has 406..704) ==== 628+0+0 (crc 0 0 0) 0x7f93e80140b0 con 0x14eb120 2024-09-16T17:03:51.948 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.945+0000 7f93f6ffd640 1 -- 172.21.15.89:0/2521324297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=705}) -- 0x7f93e4044030 con 0x14eb120 2024-09-16T17:03:51.948 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:51.945+0000 7f93f6ffd640 1 -- 172.21.15.89:0/2521324297 --> v2:172.21.15.177:6806/229775330 -- osd_op(unknown.0.0:1 199.5 199:b9ff7440:::onemore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e704) -- 0x7f93e4044220 con 0x14ebc40 2024-09-16T17:03:52.003 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.000+0000 7f93fe99c640 1 -- 172.21.15.89:0/2521324297 <== osd.2 v2:172.21.15.177:6806/229775330 1 ==== osd_op_reply(1 onemore [writefull 0~12875] v704'2 uv2 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f93f000a430 con 0x14ebc40 2024-09-16T17:03:52.003 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.000+0000 7f9405d22ec0 1 -- 172.21.15.89:0/2521324297 >> v2:172.21.15.177:6806/229775330 conn(0x14ebc40 msgr2=0x156c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:52.003 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.001+0000 7f9405d22ec0 1 --2- 172.21.15.89:0/2521324297 >> v2:172.21.15.177:6806/229775330 conn(0x14ebc40 0x156c420 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:52.003 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.001+0000 7f9405d22ec0 1 -- 172.21.15.89:0/2521324297 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f93e403d1c0 msgr2=0x7f93e403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:52.003 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.001+0000 7f9405d22ec0 1 --2- 172.21.15.89:0/2521324297 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f93e403d1c0 0x7f93e403f6d0 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:52.004 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.001+0000 7f9405d22ec0 1 -- 172.21.15.89:0/2521324297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x14eb120 msgr2=0x1612170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:52.004 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.001+0000 7f9405d22ec0 1 --2- 172.21.15.89:0/2521324297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x14eb120 0x1612170 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:52.004 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.001+0000 7f9405d22ec0 1 -- 172.21.15.89:0/2521324297 shutdown_connections 2024-09-16T17:03:52.004 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.001+0000 7f9405d22ec0 1 --2- 172.21.15.89:0/2521324297 >> v2:172.21.15.177:6806/229775330 conn(0x14ebc40 0x156c420 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:52.004 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.001+0000 7f9405d22ec0 1 --2- 172.21.15.89:0/2521324297 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f93e403d1c0 0x7f93e403f6d0 unknown :-1 s=CLOSED pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:52.004 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.001+0000 7f9405d22ec0 1 --2- 172.21.15.89:0/2521324297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x14eb120 0x1612170 unknown :-1 s=CLOSED pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:52.004 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.001+0000 7f9405d22ec0 1 -- 172.21.15.89:0/2521324297 >> 172.21.15.89:0/2521324297 conn(0x140f770 msgr2=0x14e5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:52.004 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.001+0000 7f9405d22ec0 1 -- 172.21.15.89:0/2521324297 shutdown_connections 2024-09-16T17:03:52.004 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.001+0000 7f9405d22ec0 1 -- 172.21.15.89:0/2521324297 wait complete. 2024-09-16T17:03:52.005 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -ne 0 ']' 2024-09-16T17:03:52.006 INFO:tasks.workunit.client.0.smithi089.stderr:+ true 2024-09-16T17:03:52.006 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p ad5c36b8-029a-4232-9d54-ea1601f1a3e9 put twomore /etc/passwd 2024-09-16T17:03:52.043 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.041+0000 7f97d3040ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:52.048 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.046+0000 7f97d3040ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:52.048 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.046+0000 7f97d3040ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:52.049 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.047+0000 7f97d3040ec0 1 Processor -- start 2024-09-16T17:03:52.049 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.047+0000 7f97d3040ec0 1 -- start start 2024-09-16T17:03:52.050 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.048+0000 7f97d3040ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2550120 0x266b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:52.051 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.048+0000 7f97d3040ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x24b4520 con 0x2550120 2024-09-16T17:03:52.051 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.048+0000 7f97cb19b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2550120 0x266b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:52.051 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.048+0000 7f97cb19b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2550120 0x266b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37544/0 (socket says 172.21.15.89:37544) 2024-09-16T17:03:52.051 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.048+0000 7f97cb19b640 1 -- 172.21.15.89:0/3317941503 learned_addr learned my addr 172.21.15.89:0/3317941503 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:52.051 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.048+0000 7f97cb19b640 1 -- 172.21.15.89:0/3317941503 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2450e10 con 0x2550120 2024-09-16T17:03:52.051 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.049+0000 7f97cb19b640 1 --2- 172.21.15.89:0/3317941503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2550120 0x266b0a0 crc :-1 s=READY pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7092082dc467a303 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:52.051 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.049+0000 7f97c9998640 1 -- 172.21.15.89:0/3317941503 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f97b402db60 con 0x2550120 2024-09-16T17:03:52.051 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.049+0000 7f97c9998640 1 -- 172.21.15.89:0/3317941503 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f97b4037370 con 0x2550120 2024-09-16T17:03:52.051 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.049+0000 7f97c9998640 1 -- 172.21.15.89:0/3317941503 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f97b4037610 con 0x2550120 2024-09-16T17:03:52.052 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.049+0000 7f97d3040ec0 1 -- 172.21.15.89:0/3317941503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2550120 msgr2=0x266b0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:52.052 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.049+0000 7f97d3040ec0 1 --2- 172.21.15.89:0/3317941503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2550120 0x266b0a0 crc :-1 s=READY pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:52.052 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.049+0000 7f97d3040ec0 1 -- 172.21.15.89:0/3317941503 shutdown_connections 2024-09-16T17:03:52.052 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.049+0000 7f97d3040ec0 1 --2- 172.21.15.89:0/3317941503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2550120 0x266b0a0 unknown :-1 s=CLOSED pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:52.052 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.049+0000 7f97d3040ec0 1 -- 172.21.15.89:0/3317941503 >> 172.21.15.89:0/3317941503 conn(0x2474770 msgr2=0x254a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:52.053 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.049+0000 7f97d3040ec0 1 -- 172.21.15.89:0/3317941503 shutdown_connections 2024-09-16T17:03:52.053 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.049+0000 7f97d3040ec0 1 -- 172.21.15.89:0/3317941503 wait complete. 2024-09-16T17:03:52.053 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.050+0000 7f97d3040ec0 1 Processor -- start 2024-09-16T17:03:52.053 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.050+0000 7f97d3040ec0 1 -- start start 2024-09-16T17:03:52.054 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.051+0000 7f97d3040ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2550120 0x25d1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:52.054 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.051+0000 7f97d3040ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x24b2280 con 0x2550120 2024-09-16T17:03:52.054 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.051+0000 7f97cb19b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2550120 0x25d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:52.054 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.051+0000 7f97cb19b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2550120 0x25d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37546/0 (socket says 172.21.15.89:37546) 2024-09-16T17:03:52.055 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.051+0000 7f97cb19b640 1 -- 172.21.15.89:0/3808035096 learned_addr learned my addr 172.21.15.89:0/3808035096 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:52.055 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.052+0000 7f97cb19b640 1 -- 172.21.15.89:0/3808035096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2442920 con 0x2550120 2024-09-16T17:03:52.055 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.052+0000 7f97cb19b640 1 --2- 172.21.15.89:0/3808035096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2550120 0x25d1180 crc :-1 s=READY pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:52.055 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.052+0000 7f97c8996640 1 -- 172.21.15.89:0/3808035096 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f97b403f040 con 0x2550120 2024-09-16T17:03:52.055 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.052+0000 7f97c8996640 1 -- 172.21.15.89:0/3808035096 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f97b402db60 con 0x2550120 2024-09-16T17:03:52.055 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.052+0000 7f97d3040ec0 1 -- 172.21.15.89:0/3808035096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2442380 con 0x2550120 2024-09-16T17:03:52.055 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.052+0000 7f97c8996640 1 -- 172.21.15.89:0/3808035096 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f97b4037610 con 0x2550120 2024-09-16T17:03:52.055 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.052+0000 7f97d3040ec0 1 -- 172.21.15.89:0/3808035096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x25d2ad0 con 0x2550120 2024-09-16T17:03:52.056 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.053+0000 7f97c8996640 1 -- 172.21.15.89:0/3808035096 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f97b4039450 con 0x2550120 2024-09-16T17:03:52.056 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.053+0000 7f97c8996640 1 --2- 172.21.15.89:0/3808035096 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f97b003d1c0 0x7f97b003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:52.056 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.053+0000 7f97c8996640 1 -- 172.21.15.89:0/3808035096 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(704..704 src has 406..704) ==== 3819+0+0 (crc 0 0 0) 0x7f97b4032040 con 0x2550120 2024-09-16T17:03:52.056 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.053+0000 7f97d3040ec0 1 --2- 172.21.15.89:0/3808035096 >> v2:172.21.15.177:6807/75130198 conn(0x2550a70 0x2a7b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:52.056 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.053+0000 7f97d3040ec0 1 -- 172.21.15.89:0/3808035096 --> v2:172.21.15.177:6807/75130198 -- osd_op(unknown.0.0:1 199.6 199:7019d845:::twomore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e704) -- 0x25d4b30 con 0x2550a70 2024-09-16T17:03:52.056 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.054+0000 7f97ca99a640 1 --2- 172.21.15.89:0/3808035096 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f97b003d1c0 0x7f97b003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:52.056 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.054+0000 7f97ca99a640 1 --2- 172.21.15.89:0/3808035096 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f97b003d1c0 0x7f97b003f6d0 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:52.056 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.054+0000 7f97cb99c640 1 --2- 172.21.15.89:0/3808035096 >> v2:172.21.15.177:6807/75130198 conn(0x2550a70 0x2a7b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:03:52.058 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.057+0000 7f97cb99c640 1 --2- 172.21.15.89:0/3808035096 >> v2:172.21.15.177:6807/75130198 conn(0x2550a70 0x2a7b1a0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:52.078 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.077+0000 7f97cb99c640 1 -- 172.21.15.89:0/3808035096 <== osd.3 v2:172.21.15.177:6807/75130198 1 ==== osd_op_reply(1 twomore [writefull 0~12875] v704'1 uv1 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f97bc00a430 con 0x2550a70 2024-09-16T17:03:52.078 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.077+0000 7f97d3040ec0 1 -- 172.21.15.89:0/3808035096 >> v2:172.21.15.177:6807/75130198 conn(0x2550a70 msgr2=0x2a7b1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:52.078 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.077+0000 7f97d3040ec0 1 --2- 172.21.15.89:0/3808035096 >> v2:172.21.15.177:6807/75130198 conn(0x2550a70 0x2a7b1a0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:52.079 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.077+0000 7f97d3040ec0 1 -- 172.21.15.89:0/3808035096 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f97b003d1c0 msgr2=0x7f97b003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:52.079 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.077+0000 7f97d3040ec0 1 --2- 172.21.15.89:0/3808035096 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f97b003d1c0 0x7f97b003f6d0 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:52.079 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.077+0000 7f97d3040ec0 1 -- 172.21.15.89:0/3808035096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2550120 msgr2=0x25d1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:52.079 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.077+0000 7f97d3040ec0 1 --2- 172.21.15.89:0/3808035096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2550120 0x25d1180 crc :-1 s=READY pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:52.079 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.077+0000 7f97d3040ec0 1 -- 172.21.15.89:0/3808035096 shutdown_connections 2024-09-16T17:03:52.079 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.077+0000 7f97d3040ec0 1 --2- 172.21.15.89:0/3808035096 >> v2:172.21.15.177:6807/75130198 conn(0x2550a70 0x2a7b1a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:52.079 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.077+0000 7f97d3040ec0 1 --2- 172.21.15.89:0/3808035096 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f97b003d1c0 0x7f97b003f6d0 unknown :-1 s=CLOSED pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:52.079 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.077+0000 7f97d3040ec0 1 --2- 172.21.15.89:0/3808035096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2550120 0x25d1180 unknown :-1 s=CLOSED pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:52.079 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.077+0000 7f97d3040ec0 1 -- 172.21.15.89:0/3808035096 >> 172.21.15.89:0/3808035096 conn(0x2474770 msgr2=0x254a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:52.079 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.077+0000 7f97d3040ec0 1 -- 172.21.15.89:0/3808035096 shutdown_connections 2024-09-16T17:03:52.079 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.077+0000 7f97d3040ec0 1 -- 172.21.15.89:0/3808035096 wait complete. 2024-09-16T17:03:52.081 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph osd pool set-quota ad5c36b8-029a-4232-9d54-ea1601f1a3e9 max_bytes 100 2024-09-16T17:03:52.173 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.162+0000 7f4951a5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:52.173 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.171+0000 7f4951a5c640 1 Processor -- start 2024-09-16T17:03:52.174 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.172+0000 7f4951a5c640 1 -- start start 2024-09-16T17:03:52.175 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.173+0000 7f4951a5c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f494c138880 0x7f494c13aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:52.175 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.173+0000 7f4951a5c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f494c0a2460 con 0x7f494c0a2df0 2024-09-16T17:03:52.175 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.173+0000 7f4951a5c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f494c0a3d40 con 0x7f494c138880 2024-09-16T17:03:52.176 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.173+0000 7f49427fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f494c138880 0x7f494c13aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:52.176 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.173+0000 7f494affd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f494c0a2df0 0x7f494c0a3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:58296/0 (socket says 172.21.15.89:58296) 2024-09-16T17:03:52.176 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.173+0000 7f49427fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f494c138880 0x7f494c13aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37560/0 (socket says 172.21.15.89:37560) 2024-09-16T17:03:52.176 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.173+0000 7f494affd640 1 -- 172.21.15.89:0/2495546917 learned_addr learned my addr 172.21.15.89:0/2495546917 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:03:52.176 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.173+0000 7f49427fc640 1 -- 172.21.15.89:0/2495546917 >> v1:172.21.15.89:6789/0 conn(0x7f494c0a2df0 legacy=0x7f494c0a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:52.176 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.173+0000 7f49427fc640 1 -- 172.21.15.89:0/2495546917 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494c0a29a0 con 0x7f494c138880 2024-09-16T17:03:52.176 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.173+0000 7f494a7fc640 1 -- 172.21.15.89:0/2495546917 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4197595517 0 0) 0x7f494c0a2460 con 0x7f494c0a2df0 2024-09-16T17:03:52.176 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.173+0000 7f49427fc640 1 --2- 172.21.15.89:0/2495546917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c138880 0x7f494c13aca0 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1487f29c00724bce server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:52.176 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.173+0000 7f494a7fc640 1 -- 172.21.15.89:0/2495546917 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4934009d90 con 0x7f494c138880 2024-09-16T17:03:52.176 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.173+0000 7f494a7fc640 1 -- 172.21.15.89:0/2495546917 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f493400e230 con 0x7f494c138880 2024-09-16T17:03:52.176 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.173+0000 7f494a7fc640 1 -- 172.21.15.89:0/2495546917 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f493400e4d0 con 0x7f494c138880 2024-09-16T17:03:52.177 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.174+0000 7f4951a5c640 1 -- 172.21.15.89:0/2495546917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c138880 msgr2=0x7f494c13aca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:52.177 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.174+0000 7f4951a5c640 1 --2- 172.21.15.89:0/2495546917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c138880 0x7f494c13aca0 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:52.177 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.174+0000 7f4951a5c640 1 -- 172.21.15.89:0/2495546917 shutdown_connections 2024-09-16T17:03:52.178 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.174+0000 7f4951a5c640 1 --2- 172.21.15.89:0/2495546917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c138880 0x7f494c13aca0 unknown :-1 s=CLOSED pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:52.178 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.174+0000 7f4951a5c640 1 -- 172.21.15.89:0/2495546917 >> 172.21.15.89:0/2495546917 conn(0x7f494c0a4ad0 msgr2=0x7f494c0a4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:52.178 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.174+0000 7f4951a5c640 1 -- 172.21.15.89:0/2495546917 shutdown_connections 2024-09-16T17:03:52.178 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.174+0000 7f4951a5c640 1 -- 172.21.15.89:0/2495546917 wait complete. 2024-09-16T17:03:52.178 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.174+0000 7f4951a5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:52.178 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.176+0000 7f4951a5c640 1 Processor -- start 2024-09-16T17:03:52.178 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.176+0000 7f4951a5c640 1 -- start start 2024-09-16T17:03:52.180 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.177+0000 7f4951a5c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c0a2df0 0x7f494c1205c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:52.180 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.177+0000 7f4951a5c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f494c121f50 con 0x7f494c0a2df0 2024-09-16T17:03:52.180 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.177+0000 7f494affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c0a2df0 0x7f494c1205c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:52.180 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.177+0000 7f494affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c0a2df0 0x7f494c1205c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37562/0 (socket says 172.21.15.89:37562) 2024-09-16T17:03:52.180 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.177+0000 7f494affd640 1 -- 172.21.15.89:0/1586936537 learned_addr learned my addr 172.21.15.89:0/1586936537 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:03:52.180 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.177+0000 7f494affd640 1 -- 172.21.15.89:0/1586936537 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494c120070 con 0x7f494c0a2df0 2024-09-16T17:03:52.180 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.177+0000 7f494affd640 1 --2- 172.21.15.89:0/1586936537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c0a2df0 0x7f494c1205c0 crc :-1 s=READY pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:52.180 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.178+0000 7f4948ff9640 1 -- 172.21.15.89:0/1586936537 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f493c004b80 con 0x7f494c0a2df0 2024-09-16T17:03:52.180 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.178+0000 7f4948ff9640 1 -- 172.21.15.89:0/1586936537 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f493c004ce0 con 0x7f494c0a2df0 2024-09-16T17:03:52.180 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.178+0000 7f4951a5c640 1 -- 172.21.15.89:0/1586936537 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494c0a5dd0 con 0x7f494c0a2df0 2024-09-16T17:03:52.180 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.178+0000 7f4948ff9640 1 -- 172.21.15.89:0/1586936537 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f493c007120 con 0x7f494c0a2df0 2024-09-16T17:03:52.180 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.178+0000 7f4951a5c640 1 -- 172.21.15.89:0/1586936537 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f494c11fcd0 con 0x7f494c0a2df0 2024-09-16T17:03:52.181 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.179+0000 7f4948ff9640 1 -- 172.21.15.89:0/1586936537 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f493c0072d0 con 0x7f494c0a2df0 2024-09-16T17:03:52.181 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.179+0000 7f4951a5c640 1 -- 172.21.15.89:0/1586936537 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f494c09c8a0 con 0x7f494c0a2df0 2024-09-16T17:03:52.181 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.179+0000 7f4948ff9640 1 --2- 172.21.15.89:0/1586936537 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f492c03e960 0x7f492c040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:03:52.181 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.179+0000 7f4948ff9640 1 -- 172.21.15.89:0/1586936537 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(704..704 src has 406..704) ==== 3819+0+0 (crc 0 0 0) 0x7f493c04fc20 con 0x7f494c0a2df0 2024-09-16T17:03:52.182 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.179+0000 7f49427fc640 1 --2- 172.21.15.89:0/1586936537 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f492c03e960 0x7f492c040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:03:52.182 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.180+0000 7f49427fc640 1 --2- 172.21.15.89:0/1586936537 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f492c03e960 0x7f492c040e70 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:03:52.186 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.184+0000 7f4948ff9640 1 -- 172.21.15.89:0/1586936537 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f493c00f230 con 0x7f494c0a2df0 2024-09-16T17:03:52.370 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.368+0000 7f4951a5c640 1 -- 172.21.15.89:0/1586936537 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_bytes", "val": "100"} v 0) -- 0x7f494c0698c0 con 0x7f494c0a2df0 2024-09-16T17:03:52.948 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:52.946+0000 7f4948ff9640 1 -- 172.21.15.89:0/1586936537 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 v705) ==== 221+0+0 (crc 0 0 0) 0x7f493c00a0c0 con 0x7f494c0a2df0 2024-09-16T17:03:53.070 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:53.068+0000 7f4951a5c640 1 -- 172.21.15.89:0/1586936537 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_bytes", "val": "100"} v 0) -- 0x7f494c122eb0 con 0x7f494c0a2df0 2024-09-16T17:03:53.952 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:53.950+0000 7f4948ff9640 1 -- 172.21.15.89:0/1586936537 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 v706) ==== 221+0+0 (crc 0 0 0) 0x7f493c00a7b0 con 0x7f494c0a2df0 2024-09-16T17:03:53.952 INFO:tasks.workunit.client.0.smithi089.stderr:set-quota max_bytes = 100 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 2024-09-16T17:03:53.956 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:53.954+0000 7f4951a5c640 1 -- 172.21.15.89:0/1586936537 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f492c03e960 msgr2=0x7f492c040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:53.956 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:53.954+0000 7f4951a5c640 1 --2- 172.21.15.89:0/1586936537 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f492c03e960 0x7f492c040e70 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:53.956 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:53.954+0000 7f4951a5c640 1 -- 172.21.15.89:0/1586936537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c0a2df0 msgr2=0x7f494c1205c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:03:53.956 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:53.954+0000 7f4951a5c640 1 --2- 172.21.15.89:0/1586936537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c0a2df0 0x7f494c1205c0 crc :-1 s=READY pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:53.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:53.954+0000 7f4951a5c640 1 -- 172.21.15.89:0/1586936537 shutdown_connections 2024-09-16T17:03:53.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:53.954+0000 7f4951a5c640 1 --2- 172.21.15.89:0/1586936537 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f492c03e960 0x7f492c040e70 unknown :-1 s=CLOSED pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:53.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:53.954+0000 7f4951a5c640 1 --2- 172.21.15.89:0/1586936537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c0a2df0 0x7f494c1205c0 unknown :-1 s=CLOSED pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:03:53.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:53.954+0000 7f4951a5c640 1 -- 172.21.15.89:0/1586936537 >> 172.21.15.89:0/1586936537 conn(0x7f494c0a4ad0 msgr2=0x7f494c135420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:03:53.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:53.954+0000 7f4951a5c640 1 -- 172.21.15.89:0/1586936537 shutdown_connections 2024-09-16T17:03:53.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:03:53.954+0000 7f4951a5c640 1 -- 172.21.15.89:0/1586936537 wait complete. 2024-09-16T17:03:53.974 INFO:tasks.workunit.client.0.smithi089.stderr:+ sleep 30 2024-09-16T17:04:23.977 INFO:tasks.workunit.client.0.smithi089.stderr:+ pid=95647 2024-09-16T17:04:23.977 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph osd pool set-quota ad5c36b8-029a-4232-9d54-ea1601f1a3e9 max_bytes 0 2024-09-16T17:04:23.977 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p ad5c36b8-029a-4232-9d54-ea1601f1a3e9 put two /etc/passwd 2024-09-16T17:04:24.019 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.018+0000 7efef1763ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:24.024 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.023+0000 7efef1763ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:24.024 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.023+0000 7efef1763ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:24.025 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.024+0000 7efef1763ec0 1 Processor -- start 2024-09-16T17:04:24.025 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.024+0000 7efef1763ec0 1 -- start start 2024-09-16T17:04:24.027 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.025+0000 7efef1763ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1dfcd90 0x1df9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:24.027 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.025+0000 7efef1763ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x1cd2520 con 0x1dfcd90 2024-09-16T17:04:24.027 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.025+0000 7efee9b9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1dfcd90 0x1df9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:24.027 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.025+0000 7efee9b9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1dfcd90 0x1df9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41094/0 (socket says 172.21.15.89:41094) 2024-09-16T17:04:24.027 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.025+0000 7efee9b9b640 1 -- 172.21.15.89:0/3415315025 learned_addr learned my addr 172.21.15.89:0/3415315025 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:04:24.027 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.026+0000 7efee9b9b640 1 -- 172.21.15.89:0/3415315025 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c6ee10 con 0x1dfcd90 2024-09-16T17:04:24.027 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.026+0000 7efee9b9b640 1 --2- 172.21.15.89:0/3415315025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1dfcd90 0x1df9950 crc :-1 s=READY pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed079104e3693fb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:24.027 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.026+0000 7efee37fe640 1 -- 172.21.15.89:0/3415315025 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efed800d3f0 con 0x1dfcd90 2024-09-16T17:04:24.027 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.026+0000 7efee37fe640 1 -- 172.21.15.89:0/3415315025 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efed8008040 con 0x1dfcd90 2024-09-16T17:04:24.027 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.026+0000 7efee37fe640 1 -- 172.21.15.89:0/3415315025 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efed800d680 con 0x1dfcd90 2024-09-16T17:04:24.028 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.027+0000 7efef1763ec0 1 -- 172.21.15.89:0/3415315025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1dfcd90 msgr2=0x1df9950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:24.028 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.027+0000 7efef1763ec0 1 --2- 172.21.15.89:0/3415315025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1dfcd90 0x1df9950 crc :-1 s=READY pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:24.028 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.027+0000 7efef1763ec0 1 -- 172.21.15.89:0/3415315025 shutdown_connections 2024-09-16T17:04:24.029 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.027+0000 7efef1763ec0 1 --2- 172.21.15.89:0/3415315025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1dfcd90 0x1df9950 unknown :-1 s=CLOSED pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:24.029 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.027+0000 7efef1763ec0 1 -- 172.21.15.89:0/3415315025 >> 172.21.15.89:0/3415315025 conn(0x1c92770 msgr2=0x1d70ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:24.029 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.027+0000 7efef1763ec0 1 -- 172.21.15.89:0/3415315025 shutdown_connections 2024-09-16T17:04:24.029 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.027+0000 7efef1763ec0 1 -- 172.21.15.89:0/3415315025 wait complete. 2024-09-16T17:04:24.029 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.028+0000 7efef1763ec0 1 Processor -- start 2024-09-16T17:04:24.029 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.028+0000 7efef1763ec0 1 -- start start 2024-09-16T17:04:24.031 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.029+0000 7efef1763ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1dfcd90 0x1e974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:24.031 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.029+0000 7efef1763ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x1cd0280 con 0x1dfcd90 2024-09-16T17:04:24.031 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.029+0000 7efee9b9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1dfcd90 0x1e974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:24.031 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.029+0000 7efee9b9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1dfcd90 0x1e974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41106/0 (socket says 172.21.15.89:41106) 2024-09-16T17:04:24.031 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.029+0000 7efee9b9b640 1 -- 172.21.15.89:0/1183272986 learned_addr learned my addr 172.21.15.89:0/1183272986 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:04:24.031 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.030+0000 7efee9b9b640 1 -- 172.21.15.89:0/1183272986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c60920 con 0x1dfcd90 2024-09-16T17:04:24.031 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.030+0000 7efee9b9b640 1 --2- 172.21.15.89:0/1183272986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1dfcd90 0x1e974d0 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:24.032 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.030+0000 7efee27fc640 1 -- 172.21.15.89:0/1183272986 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efed8013950 con 0x1dfcd90 2024-09-16T17:04:24.032 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.030+0000 7efee27fc640 1 -- 172.21.15.89:0/1183272986 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efed8013ab0 con 0x1dfcd90 2024-09-16T17:04:24.032 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.030+0000 7efee27fc640 1 -- 172.21.15.89:0/1183272986 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efed8013d50 con 0x1dfcd90 2024-09-16T17:04:24.032 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.030+0000 7efef1763ec0 1 -- 172.21.15.89:0/1183272986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1c60380 con 0x1dfcd90 2024-09-16T17:04:24.032 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.030+0000 7efef1763ec0 1 -- 172.21.15.89:0/1183272986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1dec880 con 0x1dfcd90 2024-09-16T17:04:24.032 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.031+0000 7efee27fc640 1 -- 172.21.15.89:0/1183272986 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7efed8010410 con 0x1dfcd90 2024-09-16T17:04:24.033 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.032+0000 7efee27fc640 1 --2- 172.21.15.89:0/1183272986 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7efed003d1c0 0x7efed003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:24.033 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.032+0000 7efee27fc640 1 -- 172.21.15.89:0/1183272986 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(708..708 src has 406..708) ==== 3819+0+0 (crc 0 0 0) 0x7efed8018040 con 0x1dfcd90 2024-09-16T17:04:24.033 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.032+0000 7efee27fc640 1 -- 172.21.15.89:0/1183272986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7efed0043560 con 0x1dfcd90 2024-09-16T17:04:24.033 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.032+0000 7efef1763ec0 1 --2- 172.21.15.89:0/1183272986 >> v2:172.21.15.177:6807/75130198 conn(0x1e030e0 0x1e942c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:24.033 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.032+0000 7efee939a640 1 --2- 172.21.15.89:0/1183272986 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7efed003d1c0 0x7efed003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:24.034 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.033+0000 7efee939a640 1 --2- 172.21.15.89:0/1183272986 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7efed003d1c0 0x7efed003f6d0 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:24.034 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.033+0000 7efeea39c640 1 --2- 172.21.15.89:0/1183272986 >> v2:172.21.15.177:6807/75130198 conn(0x1e030e0 0x1e942c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:04:24.038 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.037+0000 7efeea39c640 1 --2- 172.21.15.89:0/1183272986 >> v2:172.21.15.177:6807/75130198 conn(0x1e030e0 0x1e942c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:24.077 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.068+0000 7fd4c2751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:24.078 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.078+0000 7fd4c2751640 1 Processor -- start 2024-09-16T17:04:24.079 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.078+0000 7fd4c2751640 1 -- start start 2024-09-16T17:04:24.081 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.079+0000 7fd4c2751640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd4bc072fe0 0x7fd4bc1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:24.081 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.079+0000 7fd4c2751640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4bc09fc50 con 0x7fd4bc130a10 2024-09-16T17:04:24.081 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.079+0000 7fd4c2751640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7fd4bc0a3380 con 0x7fd4bc072fe0 2024-09-16T17:04:24.082 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.079+0000 7fd4bbfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd4bc072fe0 0x7fd4bc1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:24.082 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.079+0000 7fd4bb7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd4bc130a10 0x7fd4bc071830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:43370/0 (socket says 172.21.15.89:43370) 2024-09-16T17:04:24.082 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.079+0000 7fd4bbfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd4bc072fe0 0x7fd4bc1304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41114/0 (socket says 172.21.15.89:41114) 2024-09-16T17:04:24.082 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.079+0000 7fd4bb7fe640 1 -- 172.21.15.89:0/1146546205 learned_addr learned my addr 172.21.15.89:0/1146546205 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:04:24.082 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.079+0000 7fd4bbfff640 1 -- 172.21.15.89:0/1146546205 >> v1:172.21.15.89:6789/0 conn(0x7fd4bc130a10 legacy=0x7fd4bc071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:24.082 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.079+0000 7fd4baffd640 1 -- 172.21.15.89:0/1146546205 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544558054 0 0) 0x7fd4bc09fc50 con 0x7fd4bc130a10 2024-09-16T17:04:24.082 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.079+0000 7fd4bbfff640 1 -- 172.21.15.89:0/1146546205 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4bc0748d0 con 0x7fd4bc072fe0 2024-09-16T17:04:24.082 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.079+0000 7fd4bbfff640 1 --2- 172.21.15.89:0/1146546205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4bc072fe0 0x7fd4bc1304d0 crc :-1 s=READY pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d91dd8c508aa8c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:24.082 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.079+0000 7fd4baffd640 1 -- 172.21.15.89:0/1146546205 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd4ac009d90 con 0x7fd4bc072fe0 2024-09-16T17:04:24.082 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.080+0000 7fd4baffd640 1 -- 172.21.15.89:0/1146546205 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd4ac00e230 con 0x7fd4bc072fe0 2024-09-16T17:04:24.082 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.080+0000 7fd4baffd640 1 -- 172.21.15.89:0/1146546205 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd4ac00e4d0 con 0x7fd4bc072fe0 2024-09-16T17:04:24.082 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.080+0000 7fd4c2751640 1 -- 172.21.15.89:0/1146546205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4bc072fe0 msgr2=0x7fd4bc1304d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:24.083 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.080+0000 7fd4c2751640 1 --2- 172.21.15.89:0/1146546205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4bc072fe0 0x7fd4bc1304d0 crc :-1 s=READY pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:24.083 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.080+0000 7fd4c2751640 1 -- 172.21.15.89:0/1146546205 shutdown_connections 2024-09-16T17:04:24.083 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.080+0000 7fd4c2751640 1 --2- 172.21.15.89:0/1146546205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4bc072fe0 0x7fd4bc1304d0 unknown :-1 s=CLOSED pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:24.083 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.080+0000 7fd4c2751640 1 -- 172.21.15.89:0/1146546205 >> 172.21.15.89:0/1146546205 conn(0x7fd4bc0a3b90 msgr2=0x7fd4bc0a23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:24.083 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.080+0000 7fd4c2751640 1 -- 172.21.15.89:0/1146546205 shutdown_connections 2024-09-16T17:04:24.083 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.080+0000 7fd4c2751640 1 -- 172.21.15.89:0/1146546205 wait complete. 2024-09-16T17:04:24.083 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.081+0000 7fd4c2751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:24.083 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.082+0000 7fd4c2751640 1 Processor -- start 2024-09-16T17:04:24.083 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.082+0000 7fd4c2751640 1 -- start start 2024-09-16T17:04:24.085 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.083+0000 7fd4c2751640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4bc072fe0 0x7fd4bc11f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:24.085 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.083+0000 7fd4c2751640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd4bc0a22b0 con 0x7fd4bc072fe0 2024-09-16T17:04:24.085 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.083+0000 7fd4bbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4bc072fe0 0x7fd4bc11f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:24.085 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.083+0000 7fd4bbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4bc072fe0 0x7fd4bc11f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41122/0 (socket says 172.21.15.89:41122) 2024-09-16T17:04:24.085 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.083+0000 7fd4bbfff640 1 -- 172.21.15.89:0/2161771326 learned_addr learned my addr 172.21.15.89:0/2161771326 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:04:24.085 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.083+0000 7fd4bbfff640 1 -- 172.21.15.89:0/2161771326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4bc1232c0 con 0x7fd4bc072fe0 2024-09-16T17:04:24.085 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.084+0000 7fd4bbfff640 1 --2- 172.21.15.89:0/2161771326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4bc072fe0 0x7fd4bc11f410 crc :-1 s=READY pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:24.085 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.084+0000 7fd4b8ff9640 1 -- 172.21.15.89:0/2161771326 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd4ac013610 con 0x7fd4bc072fe0 2024-09-16T17:04:24.085 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.084+0000 7fd4b8ff9640 1 -- 172.21.15.89:0/2161771326 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd4ac013770 con 0x7fd4bc072fe0 2024-09-16T17:04:24.086 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.084+0000 7fd4c2751640 1 -- 172.21.15.89:0/2161771326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4bc1223c0 con 0x7fd4bc072fe0 2024-09-16T17:04:24.086 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.084+0000 7fd4b8ff9640 1 -- 172.21.15.89:0/2161771326 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd4ac013a10 con 0x7fd4bc072fe0 2024-09-16T17:04:24.086 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.084+0000 7fd4c2751640 1 -- 172.21.15.89:0/2161771326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4bc120d60 con 0x7fd4bc072fe0 2024-09-16T17:04:24.087 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.085+0000 7fd4b8ff9640 1 -- 172.21.15.89:0/2161771326 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd4ac013bc0 con 0x7fd4bc072fe0 2024-09-16T17:04:24.087 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.085+0000 7fd4b8ff9640 1 --2- 172.21.15.89:0/2161771326 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fd4a803e930 0x7fd4a8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:24.087 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.085+0000 7fd4c2751640 1 -- 172.21.15.89:0/2161771326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4bc0a2d50 con 0x7fd4bc072fe0 2024-09-16T17:04:24.087 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.085+0000 7fd4b8ff9640 1 -- 172.21.15.89:0/2161771326 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(708..708 src has 406..708) ==== 3819+0+0 (crc 0 0 0) 0x7fd4ac018040 con 0x7fd4bc072fe0 2024-09-16T17:04:24.087 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.085+0000 7fd4b8ff9640 1 -- 172.21.15.89:0/2161771326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7fd4a8044bc0 con 0x7fd4bc072fe0 2024-09-16T17:04:24.087 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.085+0000 7fd4bb7fe640 1 --2- 172.21.15.89:0/2161771326 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fd4a803e930 0x7fd4a8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:24.087 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.086+0000 7fd4bb7fe640 1 --2- 172.21.15.89:0/2161771326 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fd4a803e930 0x7fd4a8040e40 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:24.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.090+0000 7fd4b8ff9640 1 -- 172.21.15.89:0/2161771326 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fd4ac011570 con 0x7fd4bc072fe0 2024-09-16T17:04:24.268 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.267+0000 7fd4c2751640 1 -- 172.21.15.89:0/2161771326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_bytes", "val": "0"} v 0) -- 0x7fd4bc09fe80 con 0x7fd4bc072fe0 2024-09-16T17:04:24.443 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.442+0000 7fd4b8ff9640 1 -- 172.21.15.89:0/2161771326 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 v709) ==== 217+0+0 (crc 0 0 0) 0x7fd4ac018a50 con 0x7fd4bc072fe0 2024-09-16T17:04:24.446 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.445+0000 7efee27fc640 1 -- 172.21.15.89:0/1183272986 <== mon.0 v2:172.21.15.89:3300/0 6 ==== osd_map(709..709 src has 406..709) ==== 628+0+0 (crc 0 0 0) 0x7efed8011d50 con 0x1dfcd90 2024-09-16T17:04:24.446 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.445+0000 7efee27fc640 1 -- 172.21.15.89:0/1183272986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=710}) -- 0x7efed0043ca0 con 0x1dfcd90 2024-09-16T17:04:24.446 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.445+0000 7fd4b8ff9640 1 -- 172.21.15.89:0/2161771326 <== mon.0 v2:172.21.15.89:3300/0 8 ==== osd_map(709..709 src has 406..709) ==== 628+0+0 (crc 0 0 0) 0x7fd4ac017190 con 0x7fd4bc072fe0 2024-09-16T17:04:24.446 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.445+0000 7fd4b8ff9640 1 -- 172.21.15.89:0/2161771326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=710}) -- 0x7fd4a8045a90 con 0x7fd4bc072fe0 2024-09-16T17:04:24.561 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:24.560+0000 7fd4c2751640 1 -- 172.21.15.89:0/2161771326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_bytes", "val": "0"} v 0) -- 0x7fd4bc0a26c0 con 0x7fd4bc072fe0 2024-09-16T17:04:25.458 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.457+0000 7fd4b8ff9640 1 -- 172.21.15.89:0/2161771326 <== mon.0 v2:172.21.15.89:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 v710) ==== 217+0+0 (crc 0 0 0) 0x7fd4ac011380 con 0x7fd4bc072fe0 2024-09-16T17:04:25.458 INFO:tasks.workunit.client.0.smithi089.stderr:set-quota max_bytes = 0 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 2024-09-16T17:04:25.461 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.459+0000 7fd4c2751640 1 -- 172.21.15.89:0/2161771326 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fd4a803e930 msgr2=0x7fd4a8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:25.461 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.459+0000 7fd4c2751640 1 --2- 172.21.15.89:0/2161771326 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fd4a803e930 0x7fd4a8040e40 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:25.461 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.459+0000 7fd4c2751640 1 -- 172.21.15.89:0/2161771326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4bc072fe0 msgr2=0x7fd4bc11f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:25.461 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.459+0000 7fd4c2751640 1 --2- 172.21.15.89:0/2161771326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4bc072fe0 0x7fd4bc11f410 crc :-1 s=READY pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:25.461 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.459+0000 7fd4c2751640 1 -- 172.21.15.89:0/2161771326 shutdown_connections 2024-09-16T17:04:25.461 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.459+0000 7fd4c2751640 1 --2- 172.21.15.89:0/2161771326 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fd4a803e930 0x7fd4a8040e40 unknown :-1 s=CLOSED pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:25.461 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.459+0000 7fd4c2751640 1 --2- 172.21.15.89:0/2161771326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4bc072fe0 0x7fd4bc11f410 unknown :-1 s=CLOSED pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:25.461 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.459+0000 7fd4c2751640 1 -- 172.21.15.89:0/2161771326 >> 172.21.15.89:0/2161771326 conn(0x7fd4bc0a3b90 msgr2=0x7fd4bc1302a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:25.461 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.459+0000 7fd4c2751640 1 -- 172.21.15.89:0/2161771326 shutdown_connections 2024-09-16T17:04:25.461 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.459+0000 7efee27fc640 1 -- 172.21.15.89:0/1183272986 <== mon.0 v2:172.21.15.89:3300/0 7 ==== osd_map(710..710 src has 406..710) ==== 628+0+0 (crc 0 0 0) 0x7efed8009220 con 0x1dfcd90 2024-09-16T17:04:25.462 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.459+0000 7fd4c2751640 1 -- 172.21.15.89:0/2161771326 wait complete. 2024-09-16T17:04:25.462 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.460+0000 7efee27fc640 1 -- 172.21.15.89:0/1183272986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=711}) -- 0x7efed0043ca0 con 0x1dfcd90 2024-09-16T17:04:25.475 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph osd pool set-quota ad5c36b8-029a-4232-9d54-ea1601f1a3e9 max_objects 0 2024-09-16T17:04:25.582 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.573+0000 7f1a9c8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:25.583 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.582+0000 7f1a9c8fd640 1 Processor -- start 2024-09-16T17:04:25.583 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.582+0000 7f1a9c8fd640 1 -- start start 2024-09-16T17:04:25.585 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.583+0000 7f1a9c8fd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1a9809e9b0 0x7f1a98137040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:25.585 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.583+0000 7f1a9c8fd640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a9806eec0 con 0x7f1a98070300 2024-09-16T17:04:25.585 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.583+0000 7f1a9c8fd640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f1a9806fef0 con 0x7f1a9809e9b0 2024-09-16T17:04:25.585 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.583+0000 7f1a9659c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1a98070300 0x7f1a9809e2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:43372/0 (socket says 172.21.15.89:43372) 2024-09-16T17:04:25.585 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.583+0000 7f1a9659c640 1 -- 172.21.15.89:0/1756283048 learned_addr learned my addr 172.21.15.89:0/1756283048 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:04:25.585 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.583+0000 7f1a95d9b640 1 --2- 172.21.15.89:0/1756283048 >> v2:172.21.15.89:3300/0 conn(0x7f1a9809e9b0 0x7f1a98137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:25.585 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.584+0000 7f1a95d9b640 1 -- 172.21.15.89:0/1756283048 >> v1:172.21.15.89:6789/0 conn(0x7f1a98070300 legacy=0x7f1a9809e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:25.585 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.584+0000 7f1a95d9b640 1 -- 172.21.15.89:0/1756283048 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9809fde0 con 0x7f1a9809e9b0 2024-09-16T17:04:25.586 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.584+0000 7f1a95d9b640 1 --2- 172.21.15.89:0/1756283048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a9809e9b0 0x7f1a98137040 crc :-1 s=READY pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7328c9312cbcdc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:25.586 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.584+0000 7f1a9559a640 1 -- 172.21.15.89:0/1756283048 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a8c009d80 con 0x7f1a9809e9b0 2024-09-16T17:04:25.586 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.584+0000 7f1a9559a640 1 -- 172.21.15.89:0/1756283048 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1a8c00f340 con 0x7f1a9809e9b0 2024-09-16T17:04:25.586 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.584+0000 7f1a9559a640 1 -- 172.21.15.89:0/1756283048 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a8c00f5e0 con 0x7f1a9809e9b0 2024-09-16T17:04:25.587 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.585+0000 7f1a9c8fd640 1 -- 172.21.15.89:0/1756283048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a9809e9b0 msgr2=0x7f1a98137040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:25.587 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.585+0000 7f1a9c8fd640 1 --2- 172.21.15.89:0/1756283048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a9809e9b0 0x7f1a98137040 crc :-1 s=READY pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:25.587 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.585+0000 7f1a9c8fd640 1 -- 172.21.15.89:0/1756283048 shutdown_connections 2024-09-16T17:04:25.587 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.585+0000 7f1a9c8fd640 1 --2- 172.21.15.89:0/1756283048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a9809e9b0 0x7f1a98137040 unknown :-1 s=CLOSED pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:25.587 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.585+0000 7f1a9c8fd640 1 -- 172.21.15.89:0/1756283048 >> 172.21.15.89:0/1756283048 conn(0x7f1a980a1530 msgr2=0x7f1a980a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:25.587 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.585+0000 7f1a9c8fd640 1 -- 172.21.15.89:0/1756283048 shutdown_connections 2024-09-16T17:04:25.587 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.585+0000 7f1a9c8fd640 1 -- 172.21.15.89:0/1756283048 wait complete. 2024-09-16T17:04:25.587 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.585+0000 7f1a9c8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:25.588 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.587+0000 7f1a9c8fd640 1 Processor -- start 2024-09-16T17:04:25.588 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.587+0000 7f1a9c8fd640 1 -- start start 2024-09-16T17:04:25.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.588+0000 7f1a9c8fd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a98070300 0x7f1a981c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:25.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.588+0000 7f1a9c8fd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1a98121a90 con 0x7f1a98070300 2024-09-16T17:04:25.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.588+0000 7f1a9659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a98070300 0x7f1a981c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:25.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.588+0000 7f1a9659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a98070300 0x7f1a981c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41144/0 (socket says 172.21.15.89:41144) 2024-09-16T17:04:25.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.588+0000 7f1a9659c640 1 -- 172.21.15.89:0/4291708453 learned_addr learned my addr 172.21.15.89:0/4291708453 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:04:25.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.588+0000 7f1a9659c640 1 -- 172.21.15.89:0/4291708453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a98132e20 con 0x7f1a98070300 2024-09-16T17:04:25.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.588+0000 7f1a9659c640 1 --2- 172.21.15.89:0/4291708453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a98070300 0x7f1a981c5e80 crc :-1 s=READY pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:25.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.588+0000 7f1a86ffd640 1 -- 172.21.15.89:0/4291708453 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a88005a60 con 0x7f1a98070300 2024-09-16T17:04:25.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.588+0000 7f1a86ffd640 1 -- 172.21.15.89:0/4291708453 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1a88005bc0 con 0x7f1a98070300 2024-09-16T17:04:25.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.588+0000 7f1a86ffd640 1 -- 172.21.15.89:0/4291708453 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a88005e60 con 0x7f1a98070300 2024-09-16T17:04:25.591 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.588+0000 7f1a9c8fd640 1 -- 172.21.15.89:0/4291708453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a98073320 con 0x7f1a98070300 2024-09-16T17:04:25.591 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.588+0000 7f1a9c8fd640 1 -- 172.21.15.89:0/4291708453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a98125590 con 0x7f1a98070300 2024-09-16T17:04:25.591 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.589+0000 7f1a86ffd640 1 -- 172.21.15.89:0/4291708453 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1a880070b0 con 0x7f1a98070300 2024-09-16T17:04:25.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.589+0000 7f1a9c8fd640 1 -- 172.21.15.89:0/4291708453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a980008d0 con 0x7f1a98070300 2024-09-16T17:04:25.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.590+0000 7f1a86ffd640 1 --2- 172.21.15.89:0/4291708453 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f1a7803e930 0x7f1a78040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:25.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.590+0000 7f1a86ffd640 1 -- 172.21.15.89:0/4291708453 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(710..710 src has 406..710) ==== 3819+0+0 (crc 0 0 0) 0x7f1a8804fb20 con 0x7f1a98070300 2024-09-16T17:04:25.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.590+0000 7f1a86ffd640 1 -- 172.21.15.89:0/4291708453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=711}) -- 0x7f1a78044bc0 con 0x7f1a98070300 2024-09-16T17:04:25.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.590+0000 7f1a95d9b640 1 --2- 172.21.15.89:0/4291708453 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f1a7803e930 0x7f1a78040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:25.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.590+0000 7f1a95d9b640 1 --2- 172.21.15.89:0/4291708453 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f1a7803e930 0x7f1a78040e40 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:25.595 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.595+0000 7f1a86ffd640 1 -- 172.21.15.89:0/4291708453 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f1a8800f230 con 0x7f1a98070300 2024-09-16T17:04:25.769 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:25.768+0000 7f1a9c8fd640 1 -- 172.21.15.89:0/4291708453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_objects", "val": "0"} v 0) -- 0x7f1a98123950 con 0x7f1a98070300 2024-09-16T17:04:26.459 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.458+0000 7f1a86ffd640 1 -- 172.21.15.89:0/4291708453 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 v711) ==== 221+0+0 (crc 0 0 0) 0x7f1a8800d610 con 0x7f1a98070300 2024-09-16T17:04:26.461 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.460+0000 7efee27fc640 1 -- 172.21.15.89:0/1183272986 <== mon.0 v2:172.21.15.89:3300/0 8 ==== osd_map(711..711 src has 406..711) ==== 628+0+0 (crc 0 0 0) 0x7efed804ee10 con 0x1dfcd90 2024-09-16T17:04:26.462 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.460+0000 7f1a86ffd640 1 -- 172.21.15.89:0/4291708453 <== mon.0 v2:172.21.15.89:3300/0 8 ==== osd_map(711..711 src has 406..711) ==== 628+0+0 (crc 0 0 0) 0x7f1a8800d9b0 con 0x7f1a98070300 2024-09-16T17:04:26.462 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.461+0000 7f1a86ffd640 1 -- 172.21.15.89:0/4291708453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=712}) -- 0x7f1a78045a90 con 0x7f1a98070300 2024-09-16T17:04:26.462 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.461+0000 7efee27fc640 1 -- 172.21.15.89:0/1183272986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=712}) -- 0x7efed0043ca0 con 0x1dfcd90 2024-09-16T17:04:26.575 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.574+0000 7f1a9c8fd640 1 -- 172.21.15.89:0/4291708453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_objects", "val": "0"} v 0) -- 0x7f1a981251d0 con 0x7f1a98070300 2024-09-16T17:04:26.956 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.954+0000 7f1a86ffd640 1 -- 172.21.15.89:0/4291708453 <== mon.0 v2:172.21.15.89:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 v712) ==== 221+0+0 (crc 0 0 0) 0x7f1a8800d7f0 con 0x7f1a98070300 2024-09-16T17:04:26.956 INFO:tasks.workunit.client.0.smithi089.stderr:set-quota max_objects = 0 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 2024-09-16T17:04:26.956 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.954+0000 7f1a86ffd640 1 -- 172.21.15.89:0/4291708453 <== mon.0 v2:172.21.15.89:3300/0 10 ==== osd_map(712..712 src has 406..712) ==== 628+0+0 (crc 0 0 0) 0x7f1a88021cf0 con 0x7f1a98070300 2024-09-16T17:04:26.956 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.954+0000 7efee27fc640 1 -- 172.21.15.89:0/1183272986 <== mon.0 v2:172.21.15.89:3300/0 9 ==== osd_map(712..712 src has 406..712) ==== 628+0+0 (crc 0 0 0) 0x7efed800cc10 con 0x1dfcd90 2024-09-16T17:04:26.956 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.954+0000 7f1a86ffd640 1 -- 172.21.15.89:0/4291708453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=713}) -- 0x7f1a78045bb0 con 0x7f1a98070300 2024-09-16T17:04:26.956 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.955+0000 7efee27fc640 1 -- 172.21.15.89:0/1183272986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=713}) -- 0x7efed0043ca0 con 0x1dfcd90 2024-09-16T17:04:26.956 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.955+0000 7efee27fc640 1 -- 172.21.15.89:0/1183272986 --> v2:172.21.15.177:6807/75130198 -- osd_op(unknown.0.0:1 199.6 199:6b5d76a5:::two:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x7efed0044010 con 0x1e030e0 2024-09-16T17:04:26.958 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.957+0000 7f1a9c8fd640 1 -- 172.21.15.89:0/4291708453 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f1a7803e930 msgr2=0x7f1a78040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:26.958 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.957+0000 7f1a9c8fd640 1 --2- 172.21.15.89:0/4291708453 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f1a7803e930 0x7f1a78040e40 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:26.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.957+0000 7f1a9c8fd640 1 -- 172.21.15.89:0/4291708453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a98070300 msgr2=0x7f1a981c5e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:26.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.957+0000 7f1a9c8fd640 1 --2- 172.21.15.89:0/4291708453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a98070300 0x7f1a981c5e80 crc :-1 s=READY pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:26.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.957+0000 7f1a9c8fd640 1 -- 172.21.15.89:0/4291708453 shutdown_connections 2024-09-16T17:04:26.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.957+0000 7f1a9c8fd640 1 --2- 172.21.15.89:0/4291708453 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f1a7803e930 0x7f1a78040e40 unknown :-1 s=CLOSED pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:26.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.957+0000 7f1a9c8fd640 1 --2- 172.21.15.89:0/4291708453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a98070300 0x7f1a981c5e80 unknown :-1 s=CLOSED pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:26.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.957+0000 7f1a9c8fd640 1 -- 172.21.15.89:0/4291708453 >> 172.21.15.89:0/4291708453 conn(0x7f1a980a1530 msgr2=0x7f1a9809ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:26.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.957+0000 7f1a9c8fd640 1 -- 172.21.15.89:0/4291708453 shutdown_connections 2024-09-16T17:04:26.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:26.957+0000 7f1a9c8fd640 1 -- 172.21.15.89:0/4291708453 wait complete. 2024-09-16T17:04:26.976 INFO:tasks.workunit.client.0.smithi089.stderr:+ wait 95647 2024-09-16T17:04:27.017 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.016+0000 7efeea39c640 1 -- 172.21.15.89:0/1183272986 <== osd.3 v2:172.21.15.177:6807/75130198 1 ==== osd_op_reply(1 two [writefull 0~12875] v712'2 uv2 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7efedc00a430 con 0x1e030e0 2024-09-16T17:04:27.017 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.016+0000 7efef1763ec0 1 -- 172.21.15.89:0/1183272986 >> v2:172.21.15.177:6807/75130198 conn(0x1e030e0 msgr2=0x1e942c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:27.018 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.016+0000 7efef1763ec0 1 --2- 172.21.15.89:0/1183272986 >> v2:172.21.15.177:6807/75130198 conn(0x1e030e0 0x1e942c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:27.018 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.016+0000 7efef1763ec0 1 -- 172.21.15.89:0/1183272986 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7efed003d1c0 msgr2=0x7efed003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:27.018 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.016+0000 7efef1763ec0 1 --2- 172.21.15.89:0/1183272986 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7efed003d1c0 0x7efed003f6d0 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:27.018 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.016+0000 7efef1763ec0 1 -- 172.21.15.89:0/1183272986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1dfcd90 msgr2=0x1e974d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:27.018 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.016+0000 7efef1763ec0 1 --2- 172.21.15.89:0/1183272986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1dfcd90 0x1e974d0 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:27.018 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.016+0000 7efef1763ec0 1 -- 172.21.15.89:0/1183272986 shutdown_connections 2024-09-16T17:04:27.018 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.016+0000 7efef1763ec0 1 --2- 172.21.15.89:0/1183272986 >> v2:172.21.15.177:6807/75130198 conn(0x1e030e0 0x1e942c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:27.018 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.016+0000 7efef1763ec0 1 --2- 172.21.15.89:0/1183272986 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7efed003d1c0 0x7efed003f6d0 unknown :-1 s=CLOSED pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:27.018 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.016+0000 7efef1763ec0 1 --2- 172.21.15.89:0/1183272986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1dfcd90 0x1e974d0 unknown :-1 s=CLOSED pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:27.018 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.016+0000 7efef1763ec0 1 -- 172.21.15.89:0/1183272986 >> 172.21.15.89:0/1183272986 conn(0x1c92770 msgr2=0x1d70ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:27.018 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.016+0000 7efef1763ec0 1 -- 172.21.15.89:0/1183272986 shutdown_connections 2024-09-16T17:04:27.018 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.016+0000 7efef1763ec0 1 -- 172.21.15.89:0/1183272986 wait complete. 2024-09-16T17:04:27.019 INFO:tasks.workunit.client.0.smithi089.stderr:+ '[' 0 -ne 0 ']' 2024-09-16T17:04:27.019 INFO:tasks.workunit.client.0.smithi089.stderr:+ true 2024-09-16T17:04:27.019 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p ad5c36b8-029a-4232-9d54-ea1601f1a3e9 put three /etc/passwd 2024-09-16T17:04:27.055 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.054+0000 7f3a14240ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:27.060 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.059+0000 7f3a14240ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:27.060 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.059+0000 7f3a14240ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:27.060 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.060+0000 7f3a14240ec0 1 Processor -- start 2024-09-16T17:04:27.061 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.060+0000 7f3a14240ec0 1 -- start start 2024-09-16T17:04:27.063 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.061+0000 7f3a14240ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x168a810 0x16786f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:27.063 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.061+0000 7f3a14240ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x15f7520 con 0x168a810 2024-09-16T17:04:27.063 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.061+0000 7f3a077fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x168a810 0x16786f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:27.063 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.061+0000 7f3a077fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x168a810 0x16786f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41160/0 (socket says 172.21.15.89:41160) 2024-09-16T17:04:27.063 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.061+0000 7f3a077fe640 1 -- 172.21.15.89:0/600689414 learned_addr learned my addr 172.21.15.89:0/600689414 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:04:27.063 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.061+0000 7f3a077fe640 1 -- 172.21.15.89:0/600689414 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1593e10 con 0x168a810 2024-09-16T17:04:27.063 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.061+0000 7f3a077fe640 1 --2- 172.21.15.89:0/600689414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x168a810 0x16786f0 crc :-1 s=READY pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cbce3b6b74d96b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:27.063 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.061+0000 7f3a067fc640 1 -- 172.21.15.89:0/600689414 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f39f800c490 con 0x168a810 2024-09-16T17:04:27.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.061+0000 7f3a067fc640 1 -- 172.21.15.89:0/600689414 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f39f800c5f0 con 0x168a810 2024-09-16T17:04:27.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.061+0000 7f3a067fc640 1 -- 172.21.15.89:0/600689414 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f39f800c890 con 0x168a810 2024-09-16T17:04:27.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.062+0000 7f3a14240ec0 1 -- 172.21.15.89:0/600689414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x168a810 msgr2=0x16786f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:27.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.062+0000 7f3a14240ec0 1 --2- 172.21.15.89:0/600689414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x168a810 0x16786f0 crc :-1 s=READY pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:27.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.062+0000 7f3a14240ec0 1 -- 172.21.15.89:0/600689414 shutdown_connections 2024-09-16T17:04:27.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.062+0000 7f3a14240ec0 1 --2- 172.21.15.89:0/600689414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x168a810 0x16786f0 unknown :-1 s=CLOSED pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:27.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.062+0000 7f3a14240ec0 1 -- 172.21.15.89:0/600689414 >> 172.21.15.89:0/600689414 conn(0x15b7770 msgr2=0x168e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:27.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.062+0000 7f3a14240ec0 1 -- 172.21.15.89:0/600689414 shutdown_connections 2024-09-16T17:04:27.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.062+0000 7f3a14240ec0 1 -- 172.21.15.89:0/600689414 wait complete. 2024-09-16T17:04:27.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.063+0000 7f3a14240ec0 1 Processor -- start 2024-09-16T17:04:27.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.063+0000 7f3a14240ec0 1 -- start start 2024-09-16T17:04:27.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.064+0000 7f3a14240ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x168a810 0x17116f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:27.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.064+0000 7f3a14240ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x15f5280 con 0x168a810 2024-09-16T17:04:27.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.064+0000 7f3a077fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x168a810 0x17116f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:27.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.064+0000 7f3a077fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x168a810 0x17116f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41172/0 (socket says 172.21.15.89:41172) 2024-09-16T17:04:27.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.064+0000 7f3a077fe640 1 -- 172.21.15.89:0/3636559675 learned_addr learned my addr 172.21.15.89:0/3636559675 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:04:27.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.064+0000 7f3a077fe640 1 -- 172.21.15.89:0/3636559675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1585920 con 0x168a810 2024-09-16T17:04:27.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.064+0000 7f3a077fe640 1 --2- 172.21.15.89:0/3636559675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x168a810 0x17116f0 crc :-1 s=READY pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:27.067 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.064+0000 7f3a057fa640 1 -- 172.21.15.89:0/3636559675 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f39f80111e0 con 0x168a810 2024-09-16T17:04:27.067 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.065+0000 7f3a057fa640 1 -- 172.21.15.89:0/3636559675 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f39f80117a0 con 0x168a810 2024-09-16T17:04:27.067 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.065+0000 7f3a14240ec0 1 -- 172.21.15.89:0/3636559675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1585380 con 0x168a810 2024-09-16T17:04:27.067 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.065+0000 7f3a057fa640 1 -- 172.21.15.89:0/3636559675 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f39f8011910 con 0x168a810 2024-09-16T17:04:27.067 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.065+0000 7f3a14240ec0 1 -- 172.21.15.89:0/3636559675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1715410 con 0x168a810 2024-09-16T17:04:27.068 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.065+0000 7f3a057fa640 1 -- 172.21.15.89:0/3636559675 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f39f8011ac0 con 0x168a810 2024-09-16T17:04:27.068 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.066+0000 7f3a057fa640 1 --2- 172.21.15.89:0/3636559675 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f39e803d1c0 0x7f39e803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:27.068 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.066+0000 7f3a057fa640 1 -- 172.21.15.89:0/3636559675 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(712..712 src has 406..712) ==== 3819+0+0 (crc 0 0 0) 0x7f39f80501b0 con 0x168a810 2024-09-16T17:04:27.068 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.066+0000 7f3a14240ec0 1 --2- 172.21.15.89:0/3636559675 >> v2:172.21.15.177:6807/75130198 conn(0x1693830 0x1723a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:27.068 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.066+0000 7f3a14240ec0 1 -- 172.21.15.89:0/3636559675 --> v2:172.21.15.177:6807/75130198 -- osd_op(unknown.0.0:1 199.3 199:c57798d7:::three:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x1714fa0 con 0x1693830 2024-09-16T17:04:27.068 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.066+0000 7f39fffff640 1 --2- 172.21.15.89:0/3636559675 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f39e803d1c0 0x7f39e803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:27.068 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.067+0000 7f39fffff640 1 --2- 172.21.15.89:0/3636559675 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f39e803d1c0 0x7f39e803f6d0 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:27.068 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.067+0000 7f3a0cb9c640 1 --2- 172.21.15.89:0/3636559675 >> v2:172.21.15.177:6807/75130198 conn(0x1693830 0x1723a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:04:27.071 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.070+0000 7f3a0cb9c640 1 --2- 172.21.15.89:0/3636559675 >> v2:172.21.15.177:6807/75130198 conn(0x1693830 0x1723a90 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:27.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.090+0000 7f3a0cb9c640 1 -- 172.21.15.89:0/3636559675 <== osd.3 v2:172.21.15.177:6807/75130198 1 ==== osd_op_reply(1 three [writefull 0~12875] v712'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3a0000a430 con 0x1693830 2024-09-16T17:04:27.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.090+0000 7f3a14240ec0 1 -- 172.21.15.89:0/3636559675 >> v2:172.21.15.177:6807/75130198 conn(0x1693830 msgr2=0x1723a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:27.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.090+0000 7f3a14240ec0 1 --2- 172.21.15.89:0/3636559675 >> v2:172.21.15.177:6807/75130198 conn(0x1693830 0x1723a90 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:27.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.090+0000 7f3a14240ec0 1 -- 172.21.15.89:0/3636559675 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f39e803d1c0 msgr2=0x7f39e803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:27.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.090+0000 7f3a14240ec0 1 --2- 172.21.15.89:0/3636559675 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f39e803d1c0 0x7f39e803f6d0 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:27.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.090+0000 7f3a14240ec0 1 -- 172.21.15.89:0/3636559675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x168a810 msgr2=0x17116f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:27.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.090+0000 7f3a14240ec0 1 --2- 172.21.15.89:0/3636559675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x168a810 0x17116f0 crc :-1 s=READY pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:27.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.090+0000 7f3a14240ec0 1 -- 172.21.15.89:0/3636559675 shutdown_connections 2024-09-16T17:04:27.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.090+0000 7f3a14240ec0 1 --2- 172.21.15.89:0/3636559675 >> v2:172.21.15.177:6807/75130198 conn(0x1693830 0x1723a90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:27.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.090+0000 7f3a14240ec0 1 --2- 172.21.15.89:0/3636559675 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f39e803d1c0 0x7f39e803f6d0 unknown :-1 s=CLOSED pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:27.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.090+0000 7f3a14240ec0 1 --2- 172.21.15.89:0/3636559675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x168a810 0x17116f0 unknown :-1 s=CLOSED pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:27.092 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.090+0000 7f3a14240ec0 1 -- 172.21.15.89:0/3636559675 >> 172.21.15.89:0/3636559675 conn(0x15b7770 msgr2=0x168e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:27.092 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.090+0000 7f3a14240ec0 1 -- 172.21.15.89:0/3636559675 shutdown_connections 2024-09-16T17:04:27.092 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.090+0000 7f3a14240ec0 1 -- 172.21.15.89:0/3636559675 wait complete. 2024-09-16T17:04:27.093 INFO:tasks.workunit.client.0.smithi089.stderr:++ uuidgen 2024-09-16T17:04:27.093 INFO:tasks.workunit.client.0.smithi089.stderr:+ pp=07ad86ee-368a-4990-9f3d-cf7d02f63ba0 2024-09-16T17:04:27.094 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph osd pool create 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 12 2024-09-16T17:04:27.184 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.176+0000 7f2c29657640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:27.185 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.184+0000 7f2c29657640 1 Processor -- start 2024-09-16T17:04:27.185 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.184+0000 7f2c29657640 1 -- start start 2024-09-16T17:04:27.187 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.185+0000 7f2c29657640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2c24138880 0x7f2c2413aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:27.187 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.185+0000 7f2c29657640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c240a2460 con 0x7f2c240a2df0 2024-09-16T17:04:27.187 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.185+0000 7f2c29657640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f2c240a3d40 con 0x7f2c24138880 2024-09-16T17:04:27.187 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.185+0000 7f2c22ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2c240a2df0 0x7f2c240a3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:43390/0 (socket says 172.21.15.89:43390) 2024-09-16T17:04:27.187 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.185+0000 7f2c22ffd640 1 -- 172.21.15.89:0/254336842 learned_addr learned my addr 172.21.15.89:0/254336842 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:04:27.187 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.185+0000 7f2c227fc640 1 --2- 172.21.15.89:0/254336842 >> v2:172.21.15.89:3300/0 conn(0x7f2c24138880 0x7f2c2413aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:27.187 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.186+0000 7f2c227fc640 1 -- 172.21.15.89:0/254336842 >> v1:172.21.15.89:6789/0 conn(0x7f2c240a2df0 legacy=0x7f2c240a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:27.187 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.186+0000 7f2c227fc640 1 -- 172.21.15.89:0/254336842 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c240a29a0 con 0x7f2c24138880 2024-09-16T17:04:27.188 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.186+0000 7f2c21ffb640 1 -- 172.21.15.89:0/254336842 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 182840968 0 0) 0x7f2c240a2460 con 0x7f2c240a2df0 2024-09-16T17:04:27.188 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.186+0000 7f2c227fc640 1 --2- 172.21.15.89:0/254336842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c24138880 0x7f2c2413aca0 crc :-1 s=READY pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be8ff662c0c5a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:27.188 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.186+0000 7f2c21ffb640 1 -- 172.21.15.89:0/254336842 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2c18009d90 con 0x7f2c24138880 2024-09-16T17:04:27.188 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.186+0000 7f2c21ffb640 1 -- 172.21.15.89:0/254336842 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2c1800e230 con 0x7f2c24138880 2024-09-16T17:04:27.188 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.186+0000 7f2c21ffb640 1 -- 172.21.15.89:0/254336842 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2c1800e4d0 con 0x7f2c24138880 2024-09-16T17:04:27.189 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.187+0000 7f2c29657640 1 -- 172.21.15.89:0/254336842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c24138880 msgr2=0x7f2c2413aca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:27.189 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.187+0000 7f2c29657640 1 --2- 172.21.15.89:0/254336842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c24138880 0x7f2c2413aca0 crc :-1 s=READY pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:27.189 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.187+0000 7f2c29657640 1 -- 172.21.15.89:0/254336842 shutdown_connections 2024-09-16T17:04:27.189 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.187+0000 7f2c29657640 1 --2- 172.21.15.89:0/254336842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c24138880 0x7f2c2413aca0 unknown :-1 s=CLOSED pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:27.189 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.187+0000 7f2c29657640 1 -- 172.21.15.89:0/254336842 >> 172.21.15.89:0/254336842 conn(0x7f2c240a4ad0 msgr2=0x7f2c240a4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:27.189 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.187+0000 7f2c29657640 1 -- 172.21.15.89:0/254336842 shutdown_connections 2024-09-16T17:04:27.189 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.187+0000 7f2c29657640 1 -- 172.21.15.89:0/254336842 wait complete. 2024-09-16T17:04:27.189 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.187+0000 7f2c29657640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:27.190 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.189+0000 7f2c29657640 1 Processor -- start 2024-09-16T17:04:27.190 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.189+0000 7f2c29657640 1 -- start start 2024-09-16T17:04:27.191 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.190+0000 7f2c29657640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c240a2df0 0x7f2c241205c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:27.191 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.190+0000 7f2c29657640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2c24121f50 con 0x7f2c240a2df0 2024-09-16T17:04:27.192 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.190+0000 7f2c22ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c240a2df0 0x7f2c241205c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:27.192 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.190+0000 7f2c22ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c240a2df0 0x7f2c241205c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41200/0 (socket says 172.21.15.89:41200) 2024-09-16T17:04:27.192 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.190+0000 7f2c22ffd640 1 -- 172.21.15.89:0/4153805927 learned_addr learned my addr 172.21.15.89:0/4153805927 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:04:27.192 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.190+0000 7f2c22ffd640 1 -- 172.21.15.89:0/4153805927 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c24120070 con 0x7f2c240a2df0 2024-09-16T17:04:27.192 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.190+0000 7f2c22ffd640 1 --2- 172.21.15.89:0/4153805927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c240a2df0 0x7f2c241205c0 crc :-1 s=READY pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:27.192 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.190+0000 7f2c0b7fe640 1 -- 172.21.15.89:0/4153805927 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2c14004bc0 con 0x7f2c240a2df0 2024-09-16T17:04:27.192 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.190+0000 7f2c0b7fe640 1 -- 172.21.15.89:0/4153805927 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2c14004d20 con 0x7f2c240a2df0 2024-09-16T17:04:27.192 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.190+0000 7f2c29657640 1 -- 172.21.15.89:0/4153805927 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c240a5dd0 con 0x7f2c240a2df0 2024-09-16T17:04:27.193 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.190+0000 7f2c0b7fe640 1 -- 172.21.15.89:0/4153805927 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2c14007120 con 0x7f2c240a2df0 2024-09-16T17:04:27.193 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.190+0000 7f2c29657640 1 -- 172.21.15.89:0/4153805927 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c2411fcd0 con 0x7f2c240a2df0 2024-09-16T17:04:27.193 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.191+0000 7f2c29657640 1 -- 172.21.15.89:0/4153805927 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c2409c8a0 con 0x7f2c240a2df0 2024-09-16T17:04:27.194 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.191+0000 7f2c0b7fe640 1 -- 172.21.15.89:0/4153805927 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2c140072d0 con 0x7f2c240a2df0 2024-09-16T17:04:27.194 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.192+0000 7f2c0b7fe640 1 --2- 172.21.15.89:0/4153805927 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2c1003e960 0x7f2c10040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:27.194 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.192+0000 7f2c0b7fe640 1 -- 172.21.15.89:0/4153805927 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(712..712 src has 406..712) ==== 3819+0+0 (crc 0 0 0) 0x7f2c140503f0 con 0x7f2c240a2df0 2024-09-16T17:04:27.194 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.192+0000 7f2c227fc640 1 --2- 172.21.15.89:0/4153805927 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2c1003e960 0x7f2c10040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:27.194 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.192+0000 7f2c227fc640 1 --2- 172.21.15.89:0/4153805927 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2c1003e960 0x7f2c10040e70 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:27.200 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.197+0000 7f2c0b7fe640 1 -- 172.21.15.89:0/4153805927 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f2c140066b0 con 0x7f2c240a2df0 2024-09-16T17:04:27.375 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.374+0000 7f2c29657640 1 -- 172.21.15.89:0/4153805927 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "pg_num": 12} v 0) -- 0x7f2c240698c0 con 0x7f2c240a2df0 2024-09-16T17:04:27.968 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:27.967+0000 7f2c0b7fe640 1 -- 172.21.15.89:0/4153805927 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "pg_num": 12}]=0 pool '07ad86ee-368a-4990-9f3d-cf7d02f63ba0' created v713) ==== 176+0+0 (crc 0 0 0) 0x7f2c140060b0 con 0x7f2c240a2df0 2024-09-16T17:04:28.105 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.104+0000 7f2c29657640 1 -- 172.21.15.89:0/4153805927 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "pg_num": 12} v 0) -- 0x7f2c24122eb0 con 0x7f2c240a2df0 2024-09-16T17:04:28.105 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.104+0000 7f2c0b7fe640 1 -- 172.21.15.89:0/4153805927 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "pg_num": 12}]=0 pool '07ad86ee-368a-4990-9f3d-cf7d02f63ba0' already exists v713) ==== 183+0+0 (crc 0 0 0) 0x7f2c14006290 con 0x7f2c240a2df0 2024-09-16T17:04:28.105 INFO:tasks.workunit.client.0.smithi089.stderr:pool '07ad86ee-368a-4990-9f3d-cf7d02f63ba0' already exists 2024-09-16T17:04:28.108 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.107+0000 7f2c29657640 1 -- 172.21.15.89:0/4153805927 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2c1003e960 msgr2=0x7f2c10040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:28.108 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.107+0000 7f2c29657640 1 --2- 172.21.15.89:0/4153805927 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2c1003e960 0x7f2c10040e70 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:28.108 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.107+0000 7f2c29657640 1 -- 172.21.15.89:0/4153805927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c240a2df0 msgr2=0x7f2c241205c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:28.108 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.107+0000 7f2c29657640 1 --2- 172.21.15.89:0/4153805927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c240a2df0 0x7f2c241205c0 crc :-1 s=READY pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:28.108 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.107+0000 7f2c29657640 1 -- 172.21.15.89:0/4153805927 shutdown_connections 2024-09-16T17:04:28.108 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.107+0000 7f2c29657640 1 --2- 172.21.15.89:0/4153805927 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2c1003e960 0x7f2c10040e70 unknown :-1 s=CLOSED pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:28.108 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.107+0000 7f2c29657640 1 --2- 172.21.15.89:0/4153805927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c240a2df0 0x7f2c241205c0 unknown :-1 s=CLOSED pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:28.108 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.107+0000 7f2c29657640 1 -- 172.21.15.89:0/4153805927 >> 172.21.15.89:0/4153805927 conn(0x7f2c240a4ad0 msgr2=0x7f2c24135420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:28.108 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.107+0000 7f2c29657640 1 -- 172.21.15.89:0/4153805927 shutdown_connections 2024-09-16T17:04:28.109 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.107+0000 7f2c29657640 1 -- 172.21.15.89:0/4153805927 wait complete. 2024-09-16T17:04:28.117 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph osd pool application enable 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 rados 2024-09-16T17:04:28.208 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.199+0000 7f2fd6551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:28.209 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.208+0000 7f2fd6551640 1 Processor -- start 2024-09-16T17:04:28.209 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.208+0000 7f2fd6551640 1 -- start start 2024-09-16T17:04:28.211 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.209+0000 7f2fd6551640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2fd0070300 0x7f2fd009e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:28.211 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.209+0000 7f2fd6551640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fd006eec0 con 0x7f2fd009e7e0 2024-09-16T17:04:28.211 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.209+0000 7f2fd6551640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f2fd006fef0 con 0x7f2fd0070300 2024-09-16T17:04:28.211 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.210+0000 7f2fcffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2fd0070300 0x7f2fd009e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:28.211 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.210+0000 7f2fcffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2fd0070300 0x7f2fd009e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41212/0 (socket says 172.21.15.89:41212) 2024-09-16T17:04:28.212 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.210+0000 7f2fcffff640 1 -- 172.21.15.89:0/3831162268 learned_addr learned my addr 172.21.15.89:0/3831162268 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:04:28.212 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.210+0000 7f2fcf7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2fd009e7e0 0x7f2fd0131e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:43396/0 (socket says 172.21.15.89:43396) 2024-09-16T17:04:28.212 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.210+0000 7f2fcffff640 1 -- 172.21.15.89:0/3831162268 >> v1:172.21.15.89:6789/0 conn(0x7f2fd009e7e0 legacy=0x7f2fd0131e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:28.212 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.210+0000 7f2fceffd640 1 -- 172.21.15.89:0/3831162268 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1797370918 0 0) 0x7f2fd006eec0 con 0x7f2fd009e7e0 2024-09-16T17:04:28.212 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.210+0000 7f2fcffff640 1 -- 172.21.15.89:0/3831162268 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd009fde0 con 0x7f2fd0070300 2024-09-16T17:04:28.212 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.210+0000 7f2fcffff640 1 --2- 172.21.15.89:0/3831162268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fd0070300 0x7f2fd009e2a0 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacda3eb9a55a0f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:28.212 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.210+0000 7f2fceffd640 1 -- 172.21.15.89:0/3831162268 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2fc0009e40 con 0x7f2fd0070300 2024-09-16T17:04:28.212 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.210+0000 7f2fceffd640 1 -- 172.21.15.89:0/3831162268 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2fc000e230 con 0x7f2fd0070300 2024-09-16T17:04:28.212 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.210+0000 7f2fceffd640 1 -- 172.21.15.89:0/3831162268 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2fc000e4d0 con 0x7f2fd0070300 2024-09-16T17:04:28.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.211+0000 7f2fd6551640 1 -- 172.21.15.89:0/3831162268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fd0070300 msgr2=0x7f2fd009e2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:28.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.211+0000 7f2fd6551640 1 --2- 172.21.15.89:0/3831162268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fd0070300 0x7f2fd009e2a0 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:28.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.211+0000 7f2fd6551640 1 -- 172.21.15.89:0/3831162268 shutdown_connections 2024-09-16T17:04:28.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.211+0000 7f2fd6551640 1 --2- 172.21.15.89:0/3831162268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fd0070300 0x7f2fd009e2a0 unknown :-1 s=CLOSED pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:28.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.211+0000 7f2fd6551640 1 -- 172.21.15.89:0/3831162268 >> 172.21.15.89:0/3831162268 conn(0x7f2fd00a1530 msgr2=0x7f2fd00a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:28.214 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.211+0000 7f2fd6551640 1 -- 172.21.15.89:0/3831162268 shutdown_connections 2024-09-16T17:04:28.214 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.211+0000 7f2fd6551640 1 -- 172.21.15.89:0/3831162268 wait complete. 2024-09-16T17:04:28.214 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.211+0000 7f2fd6551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:28.214 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.212+0000 7f2fd6551640 1 Processor -- start 2024-09-16T17:04:28.214 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.213+0000 7f2fd6551640 1 -- start start 2024-09-16T17:04:28.215 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.214+0000 7f2fd6551640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fd0070300 0x7f2fd01392e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:28.215 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.214+0000 7f2fd6551640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd0129860 con 0x7f2fd0070300 2024-09-16T17:04:28.215 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.214+0000 7f2fcffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fd0070300 0x7f2fd01392e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:28.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.214+0000 7f2fcffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fd0070300 0x7f2fd01392e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41224/0 (socket says 172.21.15.89:41224) 2024-09-16T17:04:28.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.214+0000 7f2fcffff640 1 -- 172.21.15.89:0/3349031695 learned_addr learned my addr 172.21.15.89:0/3349031695 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:04:28.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.214+0000 7f2fcffff640 1 -- 172.21.15.89:0/3349031695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd0073160 con 0x7f2fd0070300 2024-09-16T17:04:28.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.214+0000 7f2fcffff640 1 --2- 172.21.15.89:0/3349031695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fd0070300 0x7f2fd01392e0 crc :-1 s=READY pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:28.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.214+0000 7f2fccff9640 1 -- 172.21.15.89:0/3349031695 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2fc000ee10 con 0x7f2fd0070300 2024-09-16T17:04:28.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.214+0000 7f2fccff9640 1 -- 172.21.15.89:0/3349031695 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2fc0015420 con 0x7f2fd0070300 2024-09-16T17:04:28.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.214+0000 7f2fd6551640 1 -- 172.21.15.89:0/3349031695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd0129490 con 0x7f2fd0070300 2024-09-16T17:04:28.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.214+0000 7f2fccff9640 1 -- 172.21.15.89:0/3349031695 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2fc00156c0 con 0x7f2fd0070300 2024-09-16T17:04:28.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.214+0000 7f2fd6551640 1 -- 172.21.15.89:0/3349031695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd01291c0 con 0x7f2fd0070300 2024-09-16T17:04:28.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.215+0000 7f2fccff9640 1 -- 172.21.15.89:0/3349031695 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2fc0015870 con 0x7f2fd0070300 2024-09-16T17:04:28.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.216+0000 7f2fccff9640 1 --2- 172.21.15.89:0/3349031695 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2fbc03e930 0x7f2fbc040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:28.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.216+0000 7f2fd6551640 1 -- 172.21.15.89:0/3349031695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fd0070860 con 0x7f2fd0070300 2024-09-16T17:04:28.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.216+0000 7f2fccff9640 1 -- 172.21.15.89:0/3349031695 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(713..713 src has 406..713) ==== 4194+0+0 (crc 0 0 0) 0x7f2fc00510f0 con 0x7f2fd0070300 2024-09-16T17:04:28.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.216+0000 7f2fcf7fe640 1 --2- 172.21.15.89:0/3349031695 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2fbc03e930 0x7f2fbc040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:28.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.216+0000 7f2fcf7fe640 1 --2- 172.21.15.89:0/3349031695 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2fbc03e930 0x7f2fbc040e40 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:28.222 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.221+0000 7f2fccff9640 1 -- 172.21.15.89:0/3349031695 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f2fc0014c60 con 0x7f2fd0070300 2024-09-16T17:04:28.397 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.396+0000 7f2fd6551640 1 -- 172.21.15.89:0/3349031695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "app": "rados"} v 0) -- 0x7f2fd0073160 con 0x7f2fd0070300 2024-09-16T17:04:28.972 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:28.971+0000 7f2fccff9640 1 -- 172.21.15.89:0/3349031695 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "app": "rados"}]=0 enabled application 'rados' on pool '07ad86ee-368a-4990-9f3d-cf7d02f63ba0' v714) ==== 213+0+0 (crc 0 0 0) 0x7f2fd0073160 con 0x7f2fd0070300 2024-09-16T17:04:29.127 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:29.126+0000 7f2fd6551640 1 -- 172.21.15.89:0/3349031695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "app": "rados"} v 0) -- 0x7f2fd0073160 con 0x7f2fd0070300 2024-09-16T17:04:29.976 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:29.974+0000 7f2fccff9640 1 -- 172.21.15.89:0/3349031695 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "app": "rados"}]=0 enabled application 'rados' on pool '07ad86ee-368a-4990-9f3d-cf7d02f63ba0' v715) ==== 213+0+0 (crc 0 0 0) 0x7f2fd0073160 con 0x7f2fd0070300 2024-09-16T17:04:29.976 INFO:tasks.workunit.client.0.smithi089.stderr:enabled application 'rados' on pool '07ad86ee-368a-4990-9f3d-cf7d02f63ba0' 2024-09-16T17:04:29.979 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:29.978+0000 7f2fd6551640 1 -- 172.21.15.89:0/3349031695 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2fbc03e930 msgr2=0x7f2fbc040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:29.979 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:29.978+0000 7f2fd6551640 1 --2- 172.21.15.89:0/3349031695 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2fbc03e930 0x7f2fbc040e40 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:29.979 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:29.978+0000 7f2fd6551640 1 -- 172.21.15.89:0/3349031695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fd0070300 msgr2=0x7f2fd01392e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:29.979 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:29.978+0000 7f2fd6551640 1 --2- 172.21.15.89:0/3349031695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fd0070300 0x7f2fd01392e0 crc :-1 s=READY pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:29.979 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:29.978+0000 7f2fd6551640 1 -- 172.21.15.89:0/3349031695 shutdown_connections 2024-09-16T17:04:29.979 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:29.978+0000 7f2fd6551640 1 --2- 172.21.15.89:0/3349031695 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f2fbc03e930 0x7f2fbc040e40 unknown :-1 s=CLOSED pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:29.979 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:29.978+0000 7f2fd6551640 1 --2- 172.21.15.89:0/3349031695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fd0070300 0x7f2fd01392e0 unknown :-1 s=CLOSED pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:29.979 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:29.978+0000 7f2fd6551640 1 -- 172.21.15.89:0/3349031695 >> 172.21.15.89:0/3349031695 conn(0x7f2fd00a1530 msgr2=0x7f2fd009cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:29.979 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:29.978+0000 7f2fd6551640 1 -- 172.21.15.89:0/3349031695 shutdown_connections 2024-09-16T17:04:29.980 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:29.978+0000 7f2fd6551640 1 -- 172.21.15.89:0/3349031695 wait complete. 2024-09-16T17:04:29.992 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph osd pool set-quota 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 max_objects 10 2024-09-16T17:04:30.098 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.088+0000 7ff5a669c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:30.099 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.098+0000 7ff5a669c640 1 Processor -- start 2024-09-16T17:04:30.099 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.098+0000 7ff5a669c640 1 -- start start 2024-09-16T17:04:30.101 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.099+0000 7ff5a669c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff5a009e9b0 0x7ff5a0137040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:30.101 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.099+0000 7ff5a669c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5a006eec0 con 0x7ff5a0070300 2024-09-16T17:04:30.101 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.099+0000 7ff5a669c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7ff5a006fef0 con 0x7ff5a009e9b0 2024-09-16T17:04:30.101 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.099+0000 7ff59f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff5a009e9b0 0x7ff5a0137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:30.101 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.099+0000 7ff59ffff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff5a0070300 0x7ff5a009e2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:57010/0 (socket says 172.21.15.89:57010) 2024-09-16T17:04:30.101 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.099+0000 7ff59ffff640 1 -- 172.21.15.89:0/2192366309 learned_addr learned my addr 172.21.15.89:0/2192366309 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:04:30.101 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.099+0000 7ff59f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff5a009e9b0 0x7ff5a0137040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50372/0 (socket says 172.21.15.89:50372) 2024-09-16T17:04:30.101 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.099+0000 7ff59f7fe640 1 -- 172.21.15.89:0/2192366309 >> v1:172.21.15.89:6789/0 conn(0x7ff5a0070300 legacy=0x7ff5a009e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:30.102 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.099+0000 7ff59f7fe640 1 -- 172.21.15.89:0/2192366309 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a009fde0 con 0x7ff5a009e9b0 2024-09-16T17:04:30.102 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.099+0000 7ff59effd640 1 -- 172.21.15.89:0/2192366309 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2997981577 0 0) 0x7ff5a006eec0 con 0x7ff5a0070300 2024-09-16T17:04:30.102 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.100+0000 7ff59f7fe640 1 --2- 172.21.15.89:0/2192366309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5a009e9b0 0x7ff5a0137040 crc :-1 s=READY pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70950ba5500cca11 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:30.102 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.100+0000 7ff59effd640 1 -- 172.21.15.89:0/2192366309 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff59400ad10 con 0x7ff5a009e9b0 2024-09-16T17:04:30.102 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.100+0000 7ff59effd640 1 -- 172.21.15.89:0/2192366309 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff59400ae70 con 0x7ff5a009e9b0 2024-09-16T17:04:30.102 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.100+0000 7ff59effd640 1 -- 172.21.15.89:0/2192366309 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff59400f470 con 0x7ff5a009e9b0 2024-09-16T17:04:30.103 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.100+0000 7ff5a669c640 1 -- 172.21.15.89:0/2192366309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5a009e9b0 msgr2=0x7ff5a0137040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:30.103 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.100+0000 7ff5a669c640 1 --2- 172.21.15.89:0/2192366309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5a009e9b0 0x7ff5a0137040 crc :-1 s=READY pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:30.103 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.101+0000 7ff5a669c640 1 -- 172.21.15.89:0/2192366309 shutdown_connections 2024-09-16T17:04:30.103 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.101+0000 7ff5a669c640 1 --2- 172.21.15.89:0/2192366309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5a009e9b0 0x7ff5a0137040 unknown :-1 s=CLOSED pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:30.103 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.101+0000 7ff5a669c640 1 -- 172.21.15.89:0/2192366309 >> 172.21.15.89:0/2192366309 conn(0x7ff5a00a1530 msgr2=0x7ff5a00a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:30.103 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.101+0000 7ff5a669c640 1 -- 172.21.15.89:0/2192366309 shutdown_connections 2024-09-16T17:04:30.103 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.101+0000 7ff5a669c640 1 -- 172.21.15.89:0/2192366309 wait complete. 2024-09-16T17:04:30.104 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.101+0000 7ff5a669c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:04:30.104 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.102+0000 7ff5a669c640 1 Processor -- start 2024-09-16T17:04:30.104 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.102+0000 7ff5a669c640 1 -- start start 2024-09-16T17:04:30.105 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.103+0000 7ff5a669c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5a0070300 0x7ff5a011ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:30.105 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.103+0000 7ff5a669c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a0132e60 con 0x7ff5a0070300 2024-09-16T17:04:30.105 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.103+0000 7ff59ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5a0070300 0x7ff5a011ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:30.106 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.103+0000 7ff59ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5a0070300 0x7ff5a011ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50388/0 (socket says 172.21.15.89:50388) 2024-09-16T17:04:30.106 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.103+0000 7ff59ffff640 1 -- 172.21.15.89:0/2178976096 learned_addr learned my addr 172.21.15.89:0/2178976096 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:04:30.106 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.104+0000 7ff59ffff640 1 -- 172.21.15.89:0/2178976096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a0073040 con 0x7ff5a0070300 2024-09-16T17:04:30.106 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.104+0000 7ff59ffff640 1 --2- 172.21.15.89:0/2178976096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5a0070300 0x7ff5a011ee20 crc :-1 s=READY pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:30.106 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.104+0000 7ff59cff9640 1 -- 172.21.15.89:0/2178976096 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff59000ebb0 con 0x7ff5a0070300 2024-09-16T17:04:30.106 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.104+0000 7ff59cff9640 1 -- 172.21.15.89:0/2178976096 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff59000ed10 con 0x7ff5a0070300 2024-09-16T17:04:30.106 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.104+0000 7ff59cff9640 1 -- 172.21.15.89:0/2178976096 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff590004840 con 0x7ff5a0070300 2024-09-16T17:04:30.106 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.104+0000 7ff5a669c640 1 -- 172.21.15.89:0/2178976096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a0122db0 con 0x7ff5a0070300 2024-09-16T17:04:30.106 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.104+0000 7ff5a669c640 1 -- 172.21.15.89:0/2178976096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a0120850 con 0x7ff5a0070300 2024-09-16T17:04:30.107 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.105+0000 7ff59cff9640 1 -- 172.21.15.89:0/2178976096 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff5900049f0 con 0x7ff5a0070300 2024-09-16T17:04:30.107 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.105+0000 7ff59cff9640 1 --2- 172.21.15.89:0/2178976096 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff58c03e910 0x7ff58c040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:04:30.107 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.105+0000 7ff5a669c640 1 -- 172.21.15.89:0/2178976096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a0121080 con 0x7ff5a0070300 2024-09-16T17:04:30.108 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.105+0000 7ff59cff9640 1 -- 172.21.15.89:0/2178976096 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(715..715 src has 406..715) ==== 4207+0+0 (crc 0 0 0) 0x7ff590052940 con 0x7ff5a0070300 2024-09-16T17:04:30.108 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.106+0000 7ff59f7fe640 1 --2- 172.21.15.89:0/2178976096 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff58c03e910 0x7ff58c040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:04:30.108 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.106+0000 7ff59f7fe640 1 --2- 172.21.15.89:0/2178976096 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff58c03e910 0x7ff58c040e20 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:04:30.111 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.111+0000 7ff59cff9640 1 -- 172.21.15.89:0/2178976096 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7ff5900103d0 con 0x7ff5a0070300 2024-09-16T17:04:30.290 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.289+0000 7ff5a669c640 1 -- 172.21.15.89:0/2178976096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "field": "max_objects", "val": "10"} v 0) -- 0x7ff5a006d040 con 0x7ff5a0070300 2024-09-16T17:04:30.977 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:30.976+0000 7ff59cff9640 1 -- 172.21.15.89:0/2178976096 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 v716) ==== 223+0+0 (crc 0 0 0) 0x7ff590001930 con 0x7ff5a0070300 2024-09-16T17:04:31.109 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:31.108+0000 7ff5a669c640 1 -- 172.21.15.89:0/2178976096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "field": "max_objects", "val": "10"} v 0) -- 0x7ff5a0121670 con 0x7ff5a0070300 2024-09-16T17:04:31.985 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:31.984+0000 7ff59cff9640 1 -- 172.21.15.89:0/2178976096 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 v717) ==== 223+0+0 (crc 0 0 0) 0x7ff59000b2c0 con 0x7ff5a0070300 2024-09-16T17:04:31.985 INFO:tasks.workunit.client.0.smithi089.stderr:set-quota max_objects = 10 for pool 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 2024-09-16T17:04:31.987 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:31.986+0000 7ff5a669c640 1 -- 172.21.15.89:0/2178976096 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff58c03e910 msgr2=0x7ff58c040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:31.987 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:31.986+0000 7ff5a669c640 1 --2- 172.21.15.89:0/2178976096 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff58c03e910 0x7ff58c040e20 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:31.988 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:31.986+0000 7ff5a669c640 1 -- 172.21.15.89:0/2178976096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5a0070300 msgr2=0x7ff5a011ee20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:04:31.988 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:31.986+0000 7ff5a669c640 1 --2- 172.21.15.89:0/2178976096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5a0070300 0x7ff5a011ee20 crc :-1 s=READY pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:31.988 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:31.986+0000 7ff5a669c640 1 -- 172.21.15.89:0/2178976096 shutdown_connections 2024-09-16T17:04:31.988 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:31.986+0000 7ff5a669c640 1 --2- 172.21.15.89:0/2178976096 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ff58c03e910 0x7ff58c040e20 unknown :-1 s=CLOSED pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:31.988 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:31.986+0000 7ff5a669c640 1 --2- 172.21.15.89:0/2178976096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5a0070300 0x7ff5a011ee20 unknown :-1 s=CLOSED pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:04:31.988 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:31.986+0000 7ff5a669c640 1 -- 172.21.15.89:0/2178976096 >> 172.21.15.89:0/2178976096 conn(0x7ff5a00a1530 msgr2=0x7ff5a01b7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:04:31.988 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:31.986+0000 7ff5a669c640 1 -- 172.21.15.89:0/2178976096 shutdown_connections 2024-09-16T17:04:31.988 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:04:31.986+0000 7ff5a669c640 1 -- 172.21.15.89:0/2178976096 wait complete. 2024-09-16T17:04:31.999 INFO:tasks.workunit.client.0.smithi089.stderr:+ sleep 30 2024-09-16T17:05:02.001 INFO:tasks.workunit.client.0.smithi089.stderr:++ seq 1 10 2024-09-16T17:05:02.002 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:05:02.002 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 put obj1 /etc/passwd 2024-09-16T17:05:02.047 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.046+0000 7f81dc0ebec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.053 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.052+0000 7f81dc0ebec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.053 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.052+0000 7f81dc0ebec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.054 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.052+0000 7f81dc0ebec0 1 Processor -- start 2024-09-16T17:05:02.054 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.052+0000 7f81dc0ebec0 1 -- start start 2024-09-16T17:05:02.057 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.053+0000 7f81dc0ebec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7a8810 0x7ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.057 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.053+0000 7f81dc0ebec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x715520 con 0x7a8810 2024-09-16T17:05:02.057 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.054+0000 7f81cf7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7a8810 0x7ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.057 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.054+0000 7f81cf7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7a8810 0x7ae020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52670/0 (socket says 172.21.15.89:52670) 2024-09-16T17:05:02.057 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.054+0000 7f81cf7fe640 1 -- 172.21.15.89:0/157485233 learned_addr learned my addr 172.21.15.89:0/157485233 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.058 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.054+0000 7f81cf7fe640 1 -- 172.21.15.89:0/157485233 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x6b1e10 con 0x7a8810 2024-09-16T17:05:02.058 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.054+0000 7f81cf7fe640 1 --2- 172.21.15.89:0/157485233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7a8810 0x7ae020 crc :-1 s=READY pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71784a045aa76f70 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.058 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.054+0000 7f81ce7fc640 1 -- 172.21.15.89:0/157485233 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f81c002dc90 con 0x7a8810 2024-09-16T17:05:02.058 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.054+0000 7f81ce7fc640 1 -- 172.21.15.89:0/157485233 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f81c002de90 con 0x7a8810 2024-09-16T17:05:02.058 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.054+0000 7f81ce7fc640 1 -- 172.21.15.89:0/157485233 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f81c000a170 con 0x7a8810 2024-09-16T17:05:02.058 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.055+0000 7f81dc0ebec0 1 -- 172.21.15.89:0/157485233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7a8810 msgr2=0x7ae020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.059 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.055+0000 7f81dc0ebec0 1 --2- 172.21.15.89:0/157485233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7a8810 0x7ae020 crc :-1 s=READY pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.059 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.055+0000 7f81dc0ebec0 1 -- 172.21.15.89:0/157485233 shutdown_connections 2024-09-16T17:05:02.059 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.055+0000 7f81dc0ebec0 1 --2- 172.21.15.89:0/157485233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7a8810 0x7ae020 unknown :-1 s=CLOSED pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.059 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.055+0000 7f81dc0ebec0 1 -- 172.21.15.89:0/157485233 >> 172.21.15.89:0/157485233 conn(0x6d5770 msgr2=0x7ac670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.059 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.055+0000 7f81dc0ebec0 1 -- 172.21.15.89:0/157485233 shutdown_connections 2024-09-16T17:05:02.059 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.055+0000 7f81dc0ebec0 1 -- 172.21.15.89:0/157485233 wait complete. 2024-09-16T17:05:02.059 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.056+0000 7f81dc0ebec0 1 Processor -- start 2024-09-16T17:05:02.060 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.056+0000 7f81dc0ebec0 1 -- start start 2024-09-16T17:05:02.063 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.057+0000 7f81dc0ebec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7a8810 0x8d7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.057+0000 7f81dc0ebec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x713280 con 0x7a8810 2024-09-16T17:05:02.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.057+0000 7f81cf7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7a8810 0x8d7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.057+0000 7f81cf7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7a8810 0x8d7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52680/0 (socket says 172.21.15.89:52680) 2024-09-16T17:05:02.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.057+0000 7f81cf7fe640 1 -- 172.21.15.89:0/3052598583 learned_addr learned my addr 172.21.15.89:0/3052598583 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.057+0000 7f81cf7fe640 1 -- 172.21.15.89:0/3052598583 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x6a3920 con 0x7a8810 2024-09-16T17:05:02.064 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.057+0000 7f81cf7fe640 1 --2- 172.21.15.89:0/3052598583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7a8810 0x8d7b80 crc :-1 s=READY pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.065 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.058+0000 7f81cd7fa640 1 -- 172.21.15.89:0/3052598583 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f81c0009820 con 0x7a8810 2024-09-16T17:05:02.065 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.058+0000 7f81cd7fa640 1 -- 172.21.15.89:0/3052598583 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f81c0009980 con 0x7a8810 2024-09-16T17:05:02.065 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.058+0000 7f81dc0ebec0 1 -- 172.21.15.89:0/3052598583 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x6a3380 con 0x7a8810 2024-09-16T17:05:02.065 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.058+0000 7f81cd7fa640 1 -- 172.21.15.89:0/3052598583 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f81c0009c20 con 0x7a8810 2024-09-16T17:05:02.065 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.058+0000 7f81dc0ebec0 1 -- 172.21.15.89:0/3052598583 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x8cb7d0 con 0x7a8810 2024-09-16T17:05:02.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.059+0000 7f81cd7fa640 1 -- 172.21.15.89:0/3052598583 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f81c00393f0 con 0x7a8810 2024-09-16T17:05:02.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.059+0000 7f81cd7fa640 1 --2- 172.21.15.89:0/3052598583 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f81b003d1c0 0x7f81b003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.059+0000 7f81cd7fa640 1 -- 172.21.15.89:0/3052598583 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(718..718 src has 406..718) ==== 4207+0+0 (crc 0 0 0) 0x7f81c0032040 con 0x7a8810 2024-09-16T17:05:02.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.059+0000 7f81dc0ebec0 1 --2- 172.21.15.89:0/3052598583 >> v2:172.21.15.177:6807/75130198 conn(0x7b1660 0x8ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.059+0000 7f81dc0ebec0 1 -- 172.21.15.89:0/3052598583 --> v2:172.21.15.177:6807/75130198 -- osd_op(unknown.0.0:1 200.7 200:ff7b1f36:::obj1:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e718) -- 0x8cc780 con 0x7b1660 2024-09-16T17:05:02.066 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.059+0000 7f81c6ffd640 1 --2- 172.21.15.89:0/3052598583 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f81b003d1c0 0x7f81b003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.067 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.060+0000 7f81c6ffd640 1 --2- 172.21.15.89:0/3052598583 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f81b003d1c0 0x7f81b003f6d0 crc :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.067 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.060+0000 7f81d4c40640 1 --2- 172.21.15.89:0/3052598583 >> v2:172.21.15.177:6807/75130198 conn(0x7b1660 0x8ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:05:02.067 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.063+0000 7f81d4c40640 1 --2- 172.21.15.89:0/3052598583 >> v2:172.21.15.177:6807/75130198 conn(0x7b1660 0x8ca210 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.090 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.087+0000 7f81d4c40640 1 -- 172.21.15.89:0/3052598583 <== osd.3 v2:172.21.15.177:6807/75130198 1 ==== osd_op_reply(1 obj1 [writefull 0~12875] v718'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f81c800a430 con 0x7b1660 2024-09-16T17:05:02.090 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.087+0000 7f81dc0ebec0 1 -- 172.21.15.89:0/3052598583 >> v2:172.21.15.177:6807/75130198 conn(0x7b1660 msgr2=0x8ca210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.090 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.087+0000 7f81dc0ebec0 1 --2- 172.21.15.89:0/3052598583 >> v2:172.21.15.177:6807/75130198 conn(0x7b1660 0x8ca210 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.090 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.087+0000 7f81dc0ebec0 1 -- 172.21.15.89:0/3052598583 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f81b003d1c0 msgr2=0x7f81b003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.087+0000 7f81dc0ebec0 1 --2- 172.21.15.89:0/3052598583 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f81b003d1c0 0x7f81b003f6d0 crc :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.087+0000 7f81dc0ebec0 1 -- 172.21.15.89:0/3052598583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7a8810 msgr2=0x8d7b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.087+0000 7f81dc0ebec0 1 --2- 172.21.15.89:0/3052598583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7a8810 0x8d7b80 crc :-1 s=READY pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.087+0000 7f81dc0ebec0 1 -- 172.21.15.89:0/3052598583 shutdown_connections 2024-09-16T17:05:02.091 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.087+0000 7f81dc0ebec0 1 --2- 172.21.15.89:0/3052598583 >> v2:172.21.15.177:6807/75130198 conn(0x7b1660 0x8ca210 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.092 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.087+0000 7f81dc0ebec0 1 --2- 172.21.15.89:0/3052598583 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f81b003d1c0 0x7f81b003f6d0 unknown :-1 s=CLOSED pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.092 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.087+0000 7f81dc0ebec0 1 --2- 172.21.15.89:0/3052598583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7a8810 0x8d7b80 unknown :-1 s=CLOSED pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.092 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.087+0000 7f81dc0ebec0 1 -- 172.21.15.89:0/3052598583 >> 172.21.15.89:0/3052598583 conn(0x6d5770 msgr2=0x7ac2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.092 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.087+0000 7f81dc0ebec0 1 -- 172.21.15.89:0/3052598583 shutdown_connections 2024-09-16T17:05:02.092 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.087+0000 7f81dc0ebec0 1 -- 172.21.15.89:0/3052598583 wait complete. 2024-09-16T17:05:02.093 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:05:02.093 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 put obj2 /etc/passwd 2024-09-16T17:05:02.130 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.129+0000 7fb6d8d76ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.135 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.134+0000 7fb6d8d76ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.135 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.134+0000 7fb6d8d76ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.136 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.135+0000 7fb6d8d76ec0 1 Processor -- start 2024-09-16T17:05:02.136 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.135+0000 7fb6d8d76ec0 1 -- start start 2024-09-16T17:05:02.139 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.136+0000 7fb6d8d76ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1accd90 0x1acdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.139 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.136+0000 7fb6d8d76ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x19a2520 con 0x1accd90 2024-09-16T17:05:02.140 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.136+0000 7fb6d179b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1accd90 0x1acdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.140 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.136+0000 7fb6d179b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1accd90 0x1acdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52694/0 (socket says 172.21.15.89:52694) 2024-09-16T17:05:02.140 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.136+0000 7fb6d179b640 1 -- 172.21.15.89:0/3321734866 learned_addr learned my addr 172.21.15.89:0/3321734866 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.140 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.136+0000 7fb6d179b640 1 -- 172.21.15.89:0/3321734866 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x193ee10 con 0x1accd90 2024-09-16T17:05:02.140 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.136+0000 7fb6d179b640 1 --2- 172.21.15.89:0/3321734866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1accd90 0x1acdb70 crc :-1 s=READY pgs=12930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b34bfc1db6a11f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.140 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.136+0000 7fb6caffd640 1 -- 172.21.15.89:0/3321734866 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb6c400b580 con 0x1accd90 2024-09-16T17:05:02.141 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.136+0000 7fb6caffd640 1 -- 172.21.15.89:0/3321734866 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb6c400b6e0 con 0x1accd90 2024-09-16T17:05:02.141 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.136+0000 7fb6caffd640 1 -- 172.21.15.89:0/3321734866 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb6c400b980 con 0x1accd90 2024-09-16T17:05:02.141 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.137+0000 7fb6d8d76ec0 1 -- 172.21.15.89:0/3321734866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1accd90 msgr2=0x1acdb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.141 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.137+0000 7fb6d8d76ec0 1 --2- 172.21.15.89:0/3321734866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1accd90 0x1acdb70 crc :-1 s=READY pgs=12930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.141 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.137+0000 7fb6d8d76ec0 1 -- 172.21.15.89:0/3321734866 shutdown_connections 2024-09-16T17:05:02.141 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.137+0000 7fb6d8d76ec0 1 --2- 172.21.15.89:0/3321734866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1accd90 0x1acdb70 unknown :-1 s=CLOSED pgs=12930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.142 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.137+0000 7fb6d8d76ec0 1 -- 172.21.15.89:0/3321734866 >> 172.21.15.89:0/3321734866 conn(0x1962770 msgr2=0x1aca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.142 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.137+0000 7fb6d8d76ec0 1 -- 172.21.15.89:0/3321734866 shutdown_connections 2024-09-16T17:05:02.142 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.137+0000 7fb6d8d76ec0 1 -- 172.21.15.89:0/3321734866 wait complete. 2024-09-16T17:05:02.142 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.138+0000 7fb6d8d76ec0 1 Processor -- start 2024-09-16T17:05:02.142 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.138+0000 7fb6d8d76ec0 1 -- start start 2024-09-16T17:05:02.146 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.139+0000 7fb6d8d76ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1accd90 0x1ab8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.146 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.139+0000 7fb6d8d76ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x19a0280 con 0x1accd90 2024-09-16T17:05:02.146 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.139+0000 7fb6d179b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1accd90 0x1ab8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.146 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.139+0000 7fb6d179b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1accd90 0x1ab8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52710/0 (socket says 172.21.15.89:52710) 2024-09-16T17:05:02.146 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.139+0000 7fb6d179b640 1 -- 172.21.15.89:0/2966036271 learned_addr learned my addr 172.21.15.89:0/2966036271 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.147 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.140+0000 7fb6d179b640 1 -- 172.21.15.89:0/2966036271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1930920 con 0x1accd90 2024-09-16T17:05:02.147 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.140+0000 7fb6d179b640 1 --2- 172.21.15.89:0/2966036271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1accd90 0x1ab8470 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.147 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.140+0000 7fb6c9ffb640 1 -- 172.21.15.89:0/2966036271 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb6c40128e0 con 0x1accd90 2024-09-16T17:05:02.147 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.140+0000 7fb6c9ffb640 1 -- 172.21.15.89:0/2966036271 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb6c4005040 con 0x1accd90 2024-09-16T17:05:02.147 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.140+0000 7fb6d8d76ec0 1 -- 172.21.15.89:0/2966036271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1930380 con 0x1accd90 2024-09-16T17:05:02.147 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.140+0000 7fb6c9ffb640 1 -- 172.21.15.89:0/2966036271 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb6c4012b70 con 0x1accd90 2024-09-16T17:05:02.147 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.140+0000 7fb6d8d76ec0 1 -- 172.21.15.89:0/2966036271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1a41790 con 0x1accd90 2024-09-16T17:05:02.148 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.141+0000 7fb6c9ffb640 1 -- 172.21.15.89:0/2966036271 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb6c400d040 con 0x1accd90 2024-09-16T17:05:02.148 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.141+0000 7fb6c9ffb640 1 --2- 172.21.15.89:0/2966036271 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fb6b803d1c0 0x7fb6b803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.148 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.141+0000 7fb6c9ffb640 1 -- 172.21.15.89:0/2966036271 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(718..718 src has 406..718) ==== 4207+0+0 (crc 0 0 0) 0x7fb6c400a040 con 0x1accd90 2024-09-16T17:05:02.148 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.141+0000 7fb6d8d76ec0 1 --2- 172.21.15.89:0/2966036271 >> v2:172.21.15.177:6807/75130198 conn(0x1ad30e0 0x1b652d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.148 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.142+0000 7fb6d8d76ec0 1 -- 172.21.15.89:0/2966036271 --> v2:172.21.15.177:6807/75130198 -- osd_op(unknown.0.0:1 200.8 200:104778fc:::obj2:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e718) -- 0x1abb260 con 0x1ad30e0 2024-09-16T17:05:02.148 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.142+0000 7fb6d0f9a640 1 --2- 172.21.15.89:0/2966036271 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fb6b803d1c0 0x7fb6b803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.149 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.142+0000 7fb6d0f9a640 1 --2- 172.21.15.89:0/2966036271 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fb6b803d1c0 0x7fb6b803f6d0 crc :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.149 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.143+0000 7fb6d1f9c640 1 --2- 172.21.15.89:0/2966036271 >> v2:172.21.15.177:6807/75130198 conn(0x1ad30e0 0x1b652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:05:02.149 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.147+0000 7fb6d1f9c640 1 --2- 172.21.15.89:0/2966036271 >> v2:172.21.15.177:6807/75130198 conn(0x1ad30e0 0x1b652d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.170 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.167+0000 7fb6d1f9c640 1 -- 172.21.15.89:0/2966036271 <== osd.3 v2:172.21.15.177:6807/75130198 1 ==== osd_op_reply(1 obj2 [writefull 0~12875] v718'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb6bc00a430 con 0x1ad30e0 2024-09-16T17:05:02.170 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.167+0000 7fb6d8d76ec0 1 -- 172.21.15.89:0/2966036271 >> v2:172.21.15.177:6807/75130198 conn(0x1ad30e0 msgr2=0x1b652d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.170 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.167+0000 7fb6d8d76ec0 1 --2- 172.21.15.89:0/2966036271 >> v2:172.21.15.177:6807/75130198 conn(0x1ad30e0 0x1b652d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.170 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.167+0000 7fb6d8d76ec0 1 -- 172.21.15.89:0/2966036271 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fb6b803d1c0 msgr2=0x7fb6b803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.170 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.167+0000 7fb6d8d76ec0 1 --2- 172.21.15.89:0/2966036271 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fb6b803d1c0 0x7fb6b803f6d0 crc :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.170 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.167+0000 7fb6d8d76ec0 1 -- 172.21.15.89:0/2966036271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1accd90 msgr2=0x1ab8470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.171 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.167+0000 7fb6d8d76ec0 1 --2- 172.21.15.89:0/2966036271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1accd90 0x1ab8470 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.171 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.167+0000 7fb6d8d76ec0 1 -- 172.21.15.89:0/2966036271 shutdown_connections 2024-09-16T17:05:02.171 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.167+0000 7fb6d8d76ec0 1 --2- 172.21.15.89:0/2966036271 >> v2:172.21.15.177:6807/75130198 conn(0x1ad30e0 0x1b652d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.171 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.167+0000 7fb6d8d76ec0 1 --2- 172.21.15.89:0/2966036271 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fb6b803d1c0 0x7fb6b803f6d0 unknown :-1 s=CLOSED pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.171 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.167+0000 7fb6d8d76ec0 1 --2- 172.21.15.89:0/2966036271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1accd90 0x1ab8470 unknown :-1 s=CLOSED pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.171 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.167+0000 7fb6d8d76ec0 1 -- 172.21.15.89:0/2966036271 >> 172.21.15.89:0/2966036271 conn(0x1962770 msgr2=0x1aca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.172 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.167+0000 7fb6d8d76ec0 1 -- 172.21.15.89:0/2966036271 shutdown_connections 2024-09-16T17:05:02.172 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.168+0000 7fb6d8d76ec0 1 -- 172.21.15.89:0/2966036271 wait complete. 2024-09-16T17:05:02.172 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:05:02.173 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 put obj3 /etc/passwd 2024-09-16T17:05:02.207 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.206+0000 7fc537c2fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.212 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.211+0000 7fc537c2fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.212 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.211+0000 7fc537c2fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.212+0000 7fc537c2fec0 1 Processor -- start 2024-09-16T17:05:02.213 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.212+0000 7fc537c2fec0 1 -- start start 2024-09-16T17:05:02.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.213+0000 7fc537c2fec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1835d90 0x1832950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.213+0000 7fc537c2fec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x170b520 con 0x1835d90 2024-09-16T17:05:02.216 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.213+0000 7fc52affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1835d90 0x1832950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.213+0000 7fc52affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1835d90 0x1832950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52736/0 (socket says 172.21.15.89:52736) 2024-09-16T17:05:02.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.213+0000 7fc52affd640 1 -- 172.21.15.89:0/149964109 learned_addr learned my addr 172.21.15.89:0/149964109 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.213+0000 7fc52affd640 1 -- 172.21.15.89:0/149964109 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x16a7e10 con 0x1835d90 2024-09-16T17:05:02.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.213+0000 7fc52affd640 1 --2- 172.21.15.89:0/149964109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1835d90 0x1832950 crc :-1 s=READY pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cadf0550c44bfb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.213+0000 7fc529ffb640 1 -- 172.21.15.89:0/149964109 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc51c00c490 con 0x1835d90 2024-09-16T17:05:02.217 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.214+0000 7fc529ffb640 1 -- 172.21.15.89:0/149964109 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc51c00c5f0 con 0x1835d90 2024-09-16T17:05:02.218 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.214+0000 7fc529ffb640 1 -- 172.21.15.89:0/149964109 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc51c00c890 con 0x1835d90 2024-09-16T17:05:02.218 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.214+0000 7fc537c2fec0 1 -- 172.21.15.89:0/149964109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1835d90 msgr2=0x1832950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.218 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.214+0000 7fc537c2fec0 1 --2- 172.21.15.89:0/149964109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1835d90 0x1832950 crc :-1 s=READY pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.218 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.214+0000 7fc537c2fec0 1 -- 172.21.15.89:0/149964109 shutdown_connections 2024-09-16T17:05:02.218 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.214+0000 7fc537c2fec0 1 --2- 172.21.15.89:0/149964109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1835d90 0x1832950 unknown :-1 s=CLOSED pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.218 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.214+0000 7fc537c2fec0 1 -- 172.21.15.89:0/149964109 >> 172.21.15.89:0/149964109 conn(0x16cb770 msgr2=0x18337a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.218 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.214+0000 7fc537c2fec0 1 -- 172.21.15.89:0/149964109 shutdown_connections 2024-09-16T17:05:02.219 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.214+0000 7fc537c2fec0 1 -- 172.21.15.89:0/149964109 wait complete. 2024-09-16T17:05:02.219 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.215+0000 7fc537c2fec0 1 Processor -- start 2024-09-16T17:05:02.219 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.215+0000 7fc537c2fec0 1 -- start start 2024-09-16T17:05:02.222 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.216+0000 7fc537c2fec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1835d90 0x1826dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.223 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.216+0000 7fc537c2fec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x1709280 con 0x1835d90 2024-09-16T17:05:02.223 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.216+0000 7fc52affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1835d90 0x1826dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.223 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.216+0000 7fc52affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1835d90 0x1826dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52740/0 (socket says 172.21.15.89:52740) 2024-09-16T17:05:02.223 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.216+0000 7fc52affd640 1 -- 172.21.15.89:0/210857529 learned_addr learned my addr 172.21.15.89:0/210857529 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.223 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.216+0000 7fc52affd640 1 -- 172.21.15.89:0/210857529 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1699920 con 0x1835d90 2024-09-16T17:05:02.223 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.216+0000 7fc52affd640 1 --2- 172.21.15.89:0/210857529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1835d90 0x1826dc0 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.224 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.217+0000 7fc528ff9640 1 -- 172.21.15.89:0/210857529 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc51c0111e0 con 0x1835d90 2024-09-16T17:05:02.224 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.217+0000 7fc528ff9640 1 -- 172.21.15.89:0/210857529 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc51c011830 con 0x1835d90 2024-09-16T17:05:02.224 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.217+0000 7fc537c2fec0 1 -- 172.21.15.89:0/210857529 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1699380 con 0x1835d90 2024-09-16T17:05:02.224 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.217+0000 7fc528ff9640 1 -- 172.21.15.89:0/210857529 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc51c0119a0 con 0x1835d90 2024-09-16T17:05:02.224 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.217+0000 7fc537c2fec0 1 -- 172.21.15.89:0/210857529 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x17a2f10 con 0x1835d90 2024-09-16T17:05:02.224 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.218+0000 7fc528ff9640 1 -- 172.21.15.89:0/210857529 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc51c011b90 con 0x1835d90 2024-09-16T17:05:02.225 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.218+0000 7fc528ff9640 1 --2- 172.21.15.89:0/210857529 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc50c03d1c0 0x7fc50c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.225 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.218+0000 7fc528ff9640 1 -- 172.21.15.89:0/210857529 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(718..718 src has 406..718) ==== 4207+0+0 (crc 0 0 0) 0x7fc51c050240 con 0x1835d90 2024-09-16T17:05:02.225 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.218+0000 7fc537c2fec0 1 --2- 172.21.15.89:0/210857529 >> v2:172.21.15.89:6803/245700216 conn(0x183c0e0 0x18d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.225 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.218+0000 7fc537c2fec0 1 -- 172.21.15.89:0/210857529 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:1 200.1 200:8dd16f86:::obj3:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e718) -- 0x18cf2e0 con 0x183c0e0 2024-09-16T17:05:02.225 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.218+0000 7fc5227fc640 1 --2- 172.21.15.89:0/210857529 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc50c03d1c0 0x7fc50c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.225 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.219+0000 7fc5227fc640 1 --2- 172.21.15.89:0/210857529 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc50c03d1c0 0x7fc50c03f6d0 crc :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.225 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.219+0000 7fc52b7fe640 1 --2- 172.21.15.89:0/210857529 >> v2:172.21.15.89:6803/245700216 conn(0x183c0e0 0x18d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:05:02.226 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.222+0000 7fc52b7fe640 1 --2- 172.21.15.89:0/210857529 >> v2:172.21.15.89:6803/245700216 conn(0x183c0e0 0x18d0d20 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.246 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.243+0000 7fc52b7fe640 1 -- 172.21.15.89:0/210857529 <== osd.1 v2:172.21.15.89:6803/245700216 1 ==== osd_op_reply(1 obj3 [writefull 0~12875] v718'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc52400a430 con 0x183c0e0 2024-09-16T17:05:02.246 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.243+0000 7fc537c2fec0 1 -- 172.21.15.89:0/210857529 >> v2:172.21.15.89:6803/245700216 conn(0x183c0e0 msgr2=0x18d0d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.246 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.243+0000 7fc537c2fec0 1 --2- 172.21.15.89:0/210857529 >> v2:172.21.15.89:6803/245700216 conn(0x183c0e0 0x18d0d20 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.246 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.244+0000 7fc537c2fec0 1 -- 172.21.15.89:0/210857529 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc50c03d1c0 msgr2=0x7fc50c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.246 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.244+0000 7fc537c2fec0 1 --2- 172.21.15.89:0/210857529 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc50c03d1c0 0x7fc50c03f6d0 crc :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.246 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.244+0000 7fc537c2fec0 1 -- 172.21.15.89:0/210857529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1835d90 msgr2=0x1826dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.246 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.244+0000 7fc537c2fec0 1 --2- 172.21.15.89:0/210857529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1835d90 0x1826dc0 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.247 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.244+0000 7fc537c2fec0 1 -- 172.21.15.89:0/210857529 shutdown_connections 2024-09-16T17:05:02.247 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.244+0000 7fc537c2fec0 1 --2- 172.21.15.89:0/210857529 >> v2:172.21.15.89:6803/245700216 conn(0x183c0e0 0x18d0d20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.247 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.244+0000 7fc537c2fec0 1 --2- 172.21.15.89:0/210857529 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc50c03d1c0 0x7fc50c03f6d0 unknown :-1 s=CLOSED pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.247 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.244+0000 7fc537c2fec0 1 --2- 172.21.15.89:0/210857529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1835d90 0x1826dc0 unknown :-1 s=CLOSED pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.247 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.244+0000 7fc537c2fec0 1 -- 172.21.15.89:0/210857529 >> 172.21.15.89:0/210857529 conn(0x16cb770 msgr2=0x17a8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.247 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.244+0000 7fc537c2fec0 1 -- 172.21.15.89:0/210857529 shutdown_connections 2024-09-16T17:05:02.248 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.244+0000 7fc537c2fec0 1 -- 172.21.15.89:0/210857529 wait complete. 2024-09-16T17:05:02.248 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:05:02.248 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 put obj4 /etc/passwd 2024-09-16T17:05:02.284 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.283+0000 7ffba7312ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.289 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.288+0000 7ffba7312ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.289 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.288+0000 7ffba7312ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.290 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.289+0000 7ffba7312ec0 1 Processor -- start 2024-09-16T17:05:02.290 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.289+0000 7ffba7312ec0 1 -- start start 2024-09-16T17:05:02.297 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.290+0000 7ffba7312ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1b4c450 0x1c68160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.297 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.290+0000 7ffba7312ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x1ab1520 con 0x1b4c450 2024-09-16T17:05:02.298 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.290+0000 7ffb9f63f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1b4c450 0x1c68160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.298 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.290+0000 7ffb9f63f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1b4c450 0x1c68160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52758/0 (socket says 172.21.15.89:52758) 2024-09-16T17:05:02.298 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.290+0000 7ffb9f63f640 1 -- 172.21.15.89:0/2327811250 learned_addr learned my addr 172.21.15.89:0/2327811250 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.298 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.290+0000 7ffb9f63f640 1 -- 172.21.15.89:0/2327811250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1a4de10 con 0x1b4c450 2024-09-16T17:05:02.298 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.290+0000 7ffb9f63f640 1 --2- 172.21.15.89:0/2327811250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1b4c450 0x1c68160 crc :-1 s=READY pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a624d7f161297646 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.298 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.290+0000 7ffb9de3c640 1 -- 172.21.15.89:0/2327811250 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffb9000c5e0 con 0x1b4c450 2024-09-16T17:05:02.299 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.290+0000 7ffb9de3c640 1 -- 172.21.15.89:0/2327811250 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffb9000c740 con 0x1b4c450 2024-09-16T17:05:02.299 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.290+0000 7ffb9de3c640 1 -- 172.21.15.89:0/2327811250 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffb9000c9e0 con 0x1b4c450 2024-09-16T17:05:02.299 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.291+0000 7ffba7312ec0 1 -- 172.21.15.89:0/2327811250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1b4c450 msgr2=0x1c68160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.299 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.291+0000 7ffba7312ec0 1 --2- 172.21.15.89:0/2327811250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1b4c450 0x1c68160 crc :-1 s=READY pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.299 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.291+0000 7ffba7312ec0 1 -- 172.21.15.89:0/2327811250 shutdown_connections 2024-09-16T17:05:02.300 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.291+0000 7ffba7312ec0 1 --2- 172.21.15.89:0/2327811250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1b4c450 0x1c68160 unknown :-1 s=CLOSED pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.300 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.291+0000 7ffba7312ec0 1 -- 172.21.15.89:0/2327811250 >> 172.21.15.89:0/2327811250 conn(0x1a71770 msgr2=0x1b47050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.300 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.291+0000 7ffba7312ec0 1 -- 172.21.15.89:0/2327811250 shutdown_connections 2024-09-16T17:05:02.300 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.291+0000 7ffba7312ec0 1 -- 172.21.15.89:0/2327811250 wait complete. 2024-09-16T17:05:02.301 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.292+0000 7ffba7312ec0 1 Processor -- start 2024-09-16T17:05:02.301 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.292+0000 7ffba7312ec0 1 -- start start 2024-09-16T17:05:02.301 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.293+0000 7ffba7312ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1b4c450 0x1c74230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.302 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.293+0000 7ffba7312ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x1aaf280 con 0x1b4c450 2024-09-16T17:05:02.302 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.293+0000 7ffb9f63f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1b4c450 0x1c74230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.302 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.293+0000 7ffb9f63f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1b4c450 0x1c74230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52764/0 (socket says 172.21.15.89:52764) 2024-09-16T17:05:02.302 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.293+0000 7ffb9f63f640 1 -- 172.21.15.89:0/116527610 learned_addr learned my addr 172.21.15.89:0/116527610 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.302 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.293+0000 7ffb9f63f640 1 -- 172.21.15.89:0/116527610 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1a3f920 con 0x1b4c450 2024-09-16T17:05:02.303 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.293+0000 7ffb9f63f640 1 --2- 172.21.15.89:0/116527610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1b4c450 0x1c74230 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.303 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.293+0000 7ffb9ce3a640 1 -- 172.21.15.89:0/116527610 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffb90013a10 con 0x1b4c450 2024-09-16T17:05:02.303 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.293+0000 7ffb9ce3a640 1 -- 172.21.15.89:0/116527610 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffb90013b70 con 0x1b4c450 2024-09-16T17:05:02.303 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.293+0000 7ffba7312ec0 1 -- 172.21.15.89:0/116527610 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1a3f380 con 0x1b4c450 2024-09-16T17:05:02.303 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.293+0000 7ffb9ce3a640 1 -- 172.21.15.89:0/116527610 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffb90013ce0 con 0x1b4c450 2024-09-16T17:05:02.304 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.293+0000 7ffba7312ec0 1 -- 172.21.15.89:0/116527610 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1bcf810 con 0x1b4c450 2024-09-16T17:05:02.304 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.294+0000 7ffb9ce3a640 1 -- 172.21.15.89:0/116527610 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ffb90010400 con 0x1b4c450 2024-09-16T17:05:02.304 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.295+0000 7ffb9ce3a640 1 --2- 172.21.15.89:0/116527610 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ffb7803d1c0 0x7ffb7803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.304 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.295+0000 7ffb9ce3a640 1 -- 172.21.15.89:0/116527610 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(718..718 src has 406..718) ==== 4207+0+0 (crc 0 0 0) 0x7ffb90008040 con 0x1b4c450 2024-09-16T17:05:02.305 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.295+0000 7ffba7312ec0 1 --2- 172.21.15.89:0/116527610 >> v2:172.21.15.177:6807/75130198 conn(0x1b4cf70 0x1bce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.305 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.295+0000 7ffba7312ec0 1 -- 172.21.15.89:0/116527610 --> v2:172.21.15.177:6807/75130198 -- osd_op(unknown.0.0:1 200.0 200:0ee9ae15:::obj4:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e718) -- 0x1bd20a0 con 0x1b4cf70 2024-09-16T17:05:02.305 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.295+0000 7ffb9ee3e640 1 --2- 172.21.15.89:0/116527610 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ffb7803d1c0 0x7ffb7803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.305 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.295+0000 7ffb9ee3e640 1 --2- 172.21.15.89:0/116527610 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ffb7803d1c0 0x7ffb7803f6d0 crc :-1 s=READY pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.305 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.296+0000 7ffb9fe40640 1 --2- 172.21.15.89:0/116527610 >> v2:172.21.15.177:6807/75130198 conn(0x1b4cf70 0x1bce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:05:02.306 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.303+0000 7ffb9fe40640 1 --2- 172.21.15.89:0/116527610 >> v2:172.21.15.177:6807/75130198 conn(0x1b4cf70 0x1bce680 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.324 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.322+0000 7ffb9fe40640 1 -- 172.21.15.89:0/116527610 <== osd.3 v2:172.21.15.177:6807/75130198 1 ==== osd_op_reply(1 obj4 [writefull 0~12875] v718'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ffb8800a430 con 0x1b4cf70 2024-09-16T17:05:02.325 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.322+0000 7ffba7312ec0 1 -- 172.21.15.89:0/116527610 >> v2:172.21.15.177:6807/75130198 conn(0x1b4cf70 msgr2=0x1bce680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.325 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.322+0000 7ffba7312ec0 1 --2- 172.21.15.89:0/116527610 >> v2:172.21.15.177:6807/75130198 conn(0x1b4cf70 0x1bce680 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.325 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.322+0000 7ffba7312ec0 1 -- 172.21.15.89:0/116527610 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ffb7803d1c0 msgr2=0x7ffb7803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.325 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.322+0000 7ffba7312ec0 1 --2- 172.21.15.89:0/116527610 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ffb7803d1c0 0x7ffb7803f6d0 crc :-1 s=READY pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.325 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.322+0000 7ffba7312ec0 1 -- 172.21.15.89:0/116527610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1b4c450 msgr2=0x1c74230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.325 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.322+0000 7ffba7312ec0 1 --2- 172.21.15.89:0/116527610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1b4c450 0x1c74230 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.325 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.322+0000 7ffba7312ec0 1 -- 172.21.15.89:0/116527610 shutdown_connections 2024-09-16T17:05:02.326 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.322+0000 7ffba7312ec0 1 --2- 172.21.15.89:0/116527610 >> v2:172.21.15.177:6807/75130198 conn(0x1b4cf70 0x1bce680 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.326 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.322+0000 7ffba7312ec0 1 --2- 172.21.15.89:0/116527610 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7ffb7803d1c0 0x7ffb7803f6d0 unknown :-1 s=CLOSED pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.326 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.322+0000 7ffba7312ec0 1 --2- 172.21.15.89:0/116527610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1b4c450 0x1c74230 unknown :-1 s=CLOSED pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.326 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.322+0000 7ffba7312ec0 1 -- 172.21.15.89:0/116527610 >> 172.21.15.89:0/116527610 conn(0x1a71770 msgr2=0x1b4c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.326 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.322+0000 7ffba7312ec0 1 -- 172.21.15.89:0/116527610 shutdown_connections 2024-09-16T17:05:02.326 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.322+0000 7ffba7312ec0 1 -- 172.21.15.89:0/116527610 wait complete. 2024-09-16T17:05:02.327 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:05:02.327 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 put obj5 /etc/passwd 2024-09-16T17:05:02.361 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.360+0000 7f7f5704fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.366 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.365+0000 7f7f5704fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.366 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.365+0000 7f7f5704fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.367 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.366+0000 7f7f5704fec0 1 Processor -- start 2024-09-16T17:05:02.367 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.366+0000 7f7f5704fec0 1 -- start start 2024-09-16T17:05:02.370 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.367+0000 7f7f5704fec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1921c60 0x1920420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.370 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.367+0000 7f7f5704fec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x17f7520 con 0x1921c60 2024-09-16T17:05:02.370 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.367+0000 7f7f4f19b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1921c60 0x1920420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.371 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.367+0000 7f7f4f19b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1921c60 0x1920420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52778/0 (socket says 172.21.15.89:52778) 2024-09-16T17:05:02.371 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.367+0000 7f7f4f19b640 1 -- 172.21.15.89:0/846946661 learned_addr learned my addr 172.21.15.89:0/846946661 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.371 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.367+0000 7f7f4f19b640 1 -- 172.21.15.89:0/846946661 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1793e10 con 0x1921c60 2024-09-16T17:05:02.371 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.367+0000 7f7f4f19b640 1 --2- 172.21.15.89:0/846946661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1921c60 0x1920420 crc :-1 s=READY pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18bb67070be4f9c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.372 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.367+0000 7f7f4d998640 1 -- 172.21.15.89:0/846946661 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7f3800b580 con 0x1921c60 2024-09-16T17:05:02.372 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.367+0000 7f7f4d998640 1 -- 172.21.15.89:0/846946661 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7f3800b6e0 con 0x1921c60 2024-09-16T17:05:02.372 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.367+0000 7f7f4d998640 1 -- 172.21.15.89:0/846946661 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7f3800b980 con 0x1921c60 2024-09-16T17:05:02.372 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.368+0000 7f7f5704fec0 1 -- 172.21.15.89:0/846946661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1921c60 msgr2=0x1920420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.372 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.368+0000 7f7f5704fec0 1 --2- 172.21.15.89:0/846946661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1921c60 0x1920420 crc :-1 s=READY pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.373 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.368+0000 7f7f5704fec0 1 -- 172.21.15.89:0/846946661 shutdown_connections 2024-09-16T17:05:02.373 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.368+0000 7f7f5704fec0 1 --2- 172.21.15.89:0/846946661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1921c60 0x1920420 unknown :-1 s=CLOSED pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.373 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.368+0000 7f7f5704fec0 1 -- 172.21.15.89:0/846946661 >> 172.21.15.89:0/846946661 conn(0x17b7770 msgr2=0x1924b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.373 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.368+0000 7f7f5704fec0 1 -- 172.21.15.89:0/846946661 shutdown_connections 2024-09-16T17:05:02.373 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.368+0000 7f7f5704fec0 1 -- 172.21.15.89:0/846946661 wait complete. 2024-09-16T17:05:02.374 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.369+0000 7f7f5704fec0 1 Processor -- start 2024-09-16T17:05:02.374 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.369+0000 7f7f5704fec0 1 -- start start 2024-09-16T17:05:02.379 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.370+0000 7f7f5704fec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1921c60 0x190d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.379 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.370+0000 7f7f5704fec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x17f5280 con 0x1921c60 2024-09-16T17:05:02.379 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.370+0000 7f7f4f19b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1921c60 0x190d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.379 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.370+0000 7f7f4f19b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1921c60 0x190d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52788/0 (socket says 172.21.15.89:52788) 2024-09-16T17:05:02.379 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.370+0000 7f7f4f19b640 1 -- 172.21.15.89:0/2433701676 learned_addr learned my addr 172.21.15.89:0/2433701676 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.380 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.370+0000 7f7f4f19b640 1 -- 172.21.15.89:0/2433701676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1785920 con 0x1921c60 2024-09-16T17:05:02.380 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.370+0000 7f7f4f19b640 1 --2- 172.21.15.89:0/2433701676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1921c60 0x190d470 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.380 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.371+0000 7f7f4c996640 1 -- 172.21.15.89:0/2433701676 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7f380129c0 con 0x1921c60 2024-09-16T17:05:02.380 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.371+0000 7f7f4c996640 1 -- 172.21.15.89:0/2433701676 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7f38005040 con 0x1921c60 2024-09-16T17:05:02.380 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.371+0000 7f7f5704fec0 1 -- 172.21.15.89:0/2433701676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1785380 con 0x1921c60 2024-09-16T17:05:02.381 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.371+0000 7f7f4c996640 1 -- 172.21.15.89:0/2433701676 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7f38012c50 con 0x1921c60 2024-09-16T17:05:02.381 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.371+0000 7f7f5704fec0 1 -- 172.21.15.89:0/2433701676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x190ec10 con 0x1921c60 2024-09-16T17:05:02.381 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.372+0000 7f7f4c996640 1 -- 172.21.15.89:0/2433701676 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f7f3800d040 con 0x1921c60 2024-09-16T17:05:02.381 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.372+0000 7f7f4c996640 1 --2- 172.21.15.89:0/2433701676 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f7f3403d1c0 0x7f7f3403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.381 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.372+0000 7f7f4c996640 1 -- 172.21.15.89:0/2433701676 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(718..718 src has 406..718) ==== 4207+0+0 (crc 0 0 0) 0x7f7f3800a040 con 0x1921c60 2024-09-16T17:05:02.381 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.372+0000 7f7f5704fec0 1 --2- 172.21.15.89:0/2433701676 >> v2:172.21.15.177:6807/75130198 conn(0x19280e0 0x19ba420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.382 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.372+0000 7f7f5704fec0 1 -- 172.21.15.89:0/2433701676 --> v2:172.21.15.177:6807/75130198 -- osd_op(unknown.0.0:1 200.3 200:c52c9666:::obj5:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e718) -- 0x19102e0 con 0x19280e0 2024-09-16T17:05:02.382 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.372+0000 7f7f4e99a640 1 --2- 172.21.15.89:0/2433701676 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f7f3403d1c0 0x7f7f3403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.382 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.373+0000 7f7f4e99a640 1 --2- 172.21.15.89:0/2433701676 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f7f3403d1c0 0x7f7f3403f6d0 crc :-1 s=READY pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.382 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.373+0000 7f7f4f99c640 1 --2- 172.21.15.89:0/2433701676 >> v2:172.21.15.177:6807/75130198 conn(0x19280e0 0x19ba420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:05:02.382 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.375+0000 7f7f4f99c640 1 --2- 172.21.15.89:0/2433701676 >> v2:172.21.15.177:6807/75130198 conn(0x19280e0 0x19ba420 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.398 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.396+0000 7f7f4f99c640 1 -- 172.21.15.89:0/2433701676 <== osd.3 v2:172.21.15.177:6807/75130198 1 ==== osd_op_reply(1 obj5 [writefull 0~12875] v718'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7f4000a430 con 0x19280e0 2024-09-16T17:05:02.398 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.396+0000 7f7f5704fec0 1 -- 172.21.15.89:0/2433701676 >> v2:172.21.15.177:6807/75130198 conn(0x19280e0 msgr2=0x19ba420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.398 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.396+0000 7f7f5704fec0 1 --2- 172.21.15.89:0/2433701676 >> v2:172.21.15.177:6807/75130198 conn(0x19280e0 0x19ba420 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.399 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.396+0000 7f7f5704fec0 1 -- 172.21.15.89:0/2433701676 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f7f3403d1c0 msgr2=0x7f7f3403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.399 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.396+0000 7f7f5704fec0 1 --2- 172.21.15.89:0/2433701676 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f7f3403d1c0 0x7f7f3403f6d0 crc :-1 s=READY pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.399 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.396+0000 7f7f5704fec0 1 -- 172.21.15.89:0/2433701676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1921c60 msgr2=0x190d470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.399 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.396+0000 7f7f5704fec0 1 --2- 172.21.15.89:0/2433701676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1921c60 0x190d470 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.399 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.396+0000 7f7f5704fec0 1 -- 172.21.15.89:0/2433701676 shutdown_connections 2024-09-16T17:05:02.399 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.396+0000 7f7f5704fec0 1 --2- 172.21.15.89:0/2433701676 >> v2:172.21.15.177:6807/75130198 conn(0x19280e0 0x19ba420 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.400 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.396+0000 7f7f5704fec0 1 --2- 172.21.15.89:0/2433701676 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f7f3403d1c0 0x7f7f3403f6d0 unknown :-1 s=CLOSED pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.400 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.396+0000 7f7f5704fec0 1 --2- 172.21.15.89:0/2433701676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1921c60 0x190d470 unknown :-1 s=CLOSED pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.400 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.396+0000 7f7f5704fec0 1 -- 172.21.15.89:0/2433701676 >> 172.21.15.89:0/2433701676 conn(0x17b7770 msgr2=0x1924b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.400 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.396+0000 7f7f5704fec0 1 -- 172.21.15.89:0/2433701676 shutdown_connections 2024-09-16T17:05:02.400 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.396+0000 7f7f5704fec0 1 -- 172.21.15.89:0/2433701676 wait complete. 2024-09-16T17:05:02.401 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:05:02.401 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 put obj6 /etc/passwd 2024-09-16T17:05:02.435 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.434+0000 7fd012cfeec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.440 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.439+0000 7fd012cfeec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.441 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.440+0000 7fd012cfeec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.441 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.440+0000 7fd012cfeec0 1 Processor -- start 2024-09-16T17:05:02.442 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.440+0000 7fd012cfeec0 1 -- start start 2024-09-16T17:05:02.448 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.441+0000 7fd012cfeec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xf3a810 0x105da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.448 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.441+0000 7fd012cfeec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0xea7520 con 0xf3a810 2024-09-16T17:05:02.448 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.441+0000 7fd00b19b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xf3a810 0x105da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.448 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.441+0000 7fd00b19b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xf3a810 0x105da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52798/0 (socket says 172.21.15.89:52798) 2024-09-16T17:05:02.449 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.441+0000 7fd00b19b640 1 -- 172.21.15.89:0/2093665850 learned_addr learned my addr 172.21.15.89:0/2093665850 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.449 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.442+0000 7fd00b19b640 1 -- 172.21.15.89:0/2093665850 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xe43e10 con 0xf3a810 2024-09-16T17:05:02.449 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.442+0000 7fd00b19b640 1 --2- 172.21.15.89:0/2093665850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xf3a810 0x105da50 crc :-1 s=READY pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb33c3a03a175db server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.449 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.442+0000 7fd009998640 1 -- 172.21.15.89:0/2093665850 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcff400b500 con 0xf3a810 2024-09-16T17:05:02.449 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.442+0000 7fd009998640 1 -- 172.21.15.89:0/2093665850 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcff400b660 con 0xf3a810 2024-09-16T17:05:02.450 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.442+0000 7fd009998640 1 -- 172.21.15.89:0/2093665850 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcff400b900 con 0xf3a810 2024-09-16T17:05:02.450 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.442+0000 7fd012cfeec0 1 -- 172.21.15.89:0/2093665850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xf3a810 msgr2=0x105da50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.450 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.442+0000 7fd012cfeec0 1 --2- 172.21.15.89:0/2093665850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xf3a810 0x105da50 crc :-1 s=READY pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.450 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.442+0000 7fd012cfeec0 1 -- 172.21.15.89:0/2093665850 shutdown_connections 2024-09-16T17:05:02.450 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.442+0000 7fd012cfeec0 1 --2- 172.21.15.89:0/2093665850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xf3a810 0x105da50 unknown :-1 s=CLOSED pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.451 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.442+0000 7fd012cfeec0 1 -- 172.21.15.89:0/2093665850 >> 172.21.15.89:0/2093665850 conn(0xe67770 msgr2=0xf3e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.451 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.443+0000 7fd012cfeec0 1 -- 172.21.15.89:0/2093665850 shutdown_connections 2024-09-16T17:05:02.451 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.443+0000 7fd012cfeec0 1 -- 172.21.15.89:0/2093665850 wait complete. 2024-09-16T17:05:02.451 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.443+0000 7fd012cfeec0 1 Processor -- start 2024-09-16T17:05:02.451 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.443+0000 7fd012cfeec0 1 -- start start 2024-09-16T17:05:02.451 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.444+0000 7fd012cfeec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xf3a810 0xfc2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.452 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.444+0000 7fd012cfeec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0xea5280 con 0xf3a810 2024-09-16T17:05:02.452 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.444+0000 7fd00b19b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xf3a810 0xfc2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.452 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.444+0000 7fd00b19b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xf3a810 0xfc2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52810/0 (socket says 172.21.15.89:52810) 2024-09-16T17:05:02.452 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.444+0000 7fd00b19b640 1 -- 172.21.15.89:0/1658067081 learned_addr learned my addr 172.21.15.89:0/1658067081 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.452 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.445+0000 7fd00b19b640 1 -- 172.21.15.89:0/1658067081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xe35920 con 0xf3a810 2024-09-16T17:05:02.452 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.445+0000 7fd00b19b640 1 --2- 172.21.15.89:0/1658067081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xf3a810 0xfc2330 crc :-1 s=READY pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.453 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.445+0000 7fd008996640 1 -- 172.21.15.89:0/1658067081 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcff40110b0 con 0xf3a810 2024-09-16T17:05:02.453 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.445+0000 7fd008996640 1 -- 172.21.15.89:0/1658067081 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcff4011210 con 0xf3a810 2024-09-16T17:05:02.453 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.445+0000 7fd012cfeec0 1 -- 172.21.15.89:0/1658067081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xe35380 con 0xf3a810 2024-09-16T17:05:02.453 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.445+0000 7fd008996640 1 -- 172.21.15.89:0/1658067081 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcff4011b80 con 0xf3a810 2024-09-16T17:05:02.453 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.445+0000 7fd012cfeec0 1 -- 172.21.15.89:0/1658067081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0xfc5210 con 0xf3a810 2024-09-16T17:05:02.455 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.451+0000 7fd008996640 1 -- 172.21.15.89:0/1658067081 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fcff4011d30 con 0xf3a810 2024-09-16T17:05:02.455 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.451+0000 7fd008996640 1 --2- 172.21.15.89:0/1658067081 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fcff003d1c0 0x7fcff003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.455 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.451+0000 7fd008996640 1 -- 172.21.15.89:0/1658067081 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(718..718 src has 406..718) ==== 4207+0+0 (crc 0 0 0) 0x7fcff40504b0 con 0xf3a810 2024-09-16T17:05:02.456 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.451+0000 7fd012cfeec0 1 --2- 172.21.15.89:0/1658067081 >> v2:172.21.15.89:6803/245700216 conn(0xf43830 0xfd3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.456 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.451+0000 7fd012cfeec0 1 -- 172.21.15.89:0/1658067081 --> v2:172.21.15.89:6803/245700216 -- osd_op(unknown.0.0:1 200.4 200:233a42c1:::obj6:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e718) -- 0xfc4cc0 con 0xf43830 2024-09-16T17:05:02.456 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.451+0000 7fd00a99a640 1 --2- 172.21.15.89:0/1658067081 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fcff003d1c0 0x7fcff003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.456 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.452+0000 7fd00a99a640 1 --2- 172.21.15.89:0/1658067081 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fcff003d1c0 0x7fcff003f6d0 crc :-1 s=READY pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.456 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.452+0000 7fd00b99c640 1 --2- 172.21.15.89:0/1658067081 >> v2:172.21.15.89:6803/245700216 conn(0xf43830 0xfd3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:05:02.456 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.454+0000 7fd00b99c640 1 --2- 172.21.15.89:0/1658067081 >> v2:172.21.15.89:6803/245700216 conn(0xf43830 0xfd3520 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.474 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.471+0000 7fd00b99c640 1 -- 172.21.15.89:0/1658067081 <== osd.1 v2:172.21.15.89:6803/245700216 1 ==== osd_op_reply(1 obj6 [writefull 0~12875] v718'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcffc00a430 con 0xf43830 2024-09-16T17:05:02.474 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.471+0000 7fd012cfeec0 1 -- 172.21.15.89:0/1658067081 >> v2:172.21.15.89:6803/245700216 conn(0xf43830 msgr2=0xfd3520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.475 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.471+0000 7fd012cfeec0 1 --2- 172.21.15.89:0/1658067081 >> v2:172.21.15.89:6803/245700216 conn(0xf43830 0xfd3520 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.475 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.471+0000 7fd012cfeec0 1 -- 172.21.15.89:0/1658067081 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fcff003d1c0 msgr2=0x7fcff003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.475 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.471+0000 7fd012cfeec0 1 --2- 172.21.15.89:0/1658067081 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fcff003d1c0 0x7fcff003f6d0 crc :-1 s=READY pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.475 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.471+0000 7fd012cfeec0 1 -- 172.21.15.89:0/1658067081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xf3a810 msgr2=0xfc2330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.471+0000 7fd012cfeec0 1 --2- 172.21.15.89:0/1658067081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xf3a810 0xfc2330 crc :-1 s=READY pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.471+0000 7fd012cfeec0 1 -- 172.21.15.89:0/1658067081 shutdown_connections 2024-09-16T17:05:02.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.471+0000 7fd012cfeec0 1 --2- 172.21.15.89:0/1658067081 >> v2:172.21.15.89:6803/245700216 conn(0xf43830 0xfd3520 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.471+0000 7fd012cfeec0 1 --2- 172.21.15.89:0/1658067081 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fcff003d1c0 0x7fcff003f6d0 unknown :-1 s=CLOSED pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.471+0000 7fd012cfeec0 1 --2- 172.21.15.89:0/1658067081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xf3a810 0xfc2330 unknown :-1 s=CLOSED pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.477 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.471+0000 7fd012cfeec0 1 -- 172.21.15.89:0/1658067081 >> 172.21.15.89:0/1658067081 conn(0xe67770 msgr2=0xf3e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.477 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.472+0000 7fd012cfeec0 1 -- 172.21.15.89:0/1658067081 shutdown_connections 2024-09-16T17:05:02.477 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.472+0000 7fd012cfeec0 1 -- 172.21.15.89:0/1658067081 wait complete. 2024-09-16T17:05:02.478 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:05:02.478 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 put obj7 /etc/passwd 2024-09-16T17:05:02.512 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.511+0000 7f42f3632ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.517 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.516+0000 7f42f3632ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.517 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.516+0000 7f42f3632ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.518 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.516+0000 7f42f3632ec0 1 Processor -- start 2024-09-16T17:05:02.518 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.516+0000 7f42f3632ec0 1 -- start start 2024-09-16T17:05:02.525 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.517+0000 7f42f3632ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x12e5120 0x1377aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.525 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.517+0000 7f42f3632ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x1249520 con 0x12e5120 2024-09-16T17:05:02.525 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.518+0000 7f42eb63f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x12e5120 0x1377aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.525 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.518+0000 7f42eb63f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x12e5120 0x1377aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52816/0 (socket says 172.21.15.89:52816) 2024-09-16T17:05:02.525 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.518+0000 7f42eb63f640 1 -- 172.21.15.89:0/2199633010 learned_addr learned my addr 172.21.15.89:0/2199633010 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.526 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.518+0000 7f42eb63f640 1 -- 172.21.15.89:0/2199633010 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x11e5e10 con 0x12e5120 2024-09-16T17:05:02.526 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.518+0000 7f42eb63f640 1 --2- 172.21.15.89:0/2199633010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x12e5120 0x1377aa0 crc :-1 s=READY pgs=12950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d479eb2bd0e115 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.526 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.518+0000 7f42e9e3c640 1 -- 172.21.15.89:0/2199633010 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f42d400b580 con 0x12e5120 2024-09-16T17:05:02.526 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.518+0000 7f42e9e3c640 1 -- 172.21.15.89:0/2199633010 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f42d400b6e0 con 0x12e5120 2024-09-16T17:05:02.526 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.518+0000 7f42e9e3c640 1 -- 172.21.15.89:0/2199633010 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f42d400b980 con 0x12e5120 2024-09-16T17:05:02.526 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.519+0000 7f42f3632ec0 1 -- 172.21.15.89:0/2199633010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x12e5120 msgr2=0x1377aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.527 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.519+0000 7f42f3632ec0 1 --2- 172.21.15.89:0/2199633010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x12e5120 0x1377aa0 crc :-1 s=READY pgs=12950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.527 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.519+0000 7f42f3632ec0 1 -- 172.21.15.89:0/2199633010 shutdown_connections 2024-09-16T17:05:02.527 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.519+0000 7f42f3632ec0 1 --2- 172.21.15.89:0/2199633010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x12e5120 0x1377aa0 unknown :-1 s=CLOSED pgs=12950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.527 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.519+0000 7f42f3632ec0 1 -- 172.21.15.89:0/2199633010 >> 172.21.15.89:0/2199633010 conn(0x1209770 msgr2=0x12e1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.527 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.519+0000 7f42f3632ec0 1 -- 172.21.15.89:0/2199633010 shutdown_connections 2024-09-16T17:05:02.527 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.519+0000 7f42f3632ec0 1 -- 172.21.15.89:0/2199633010 wait complete. 2024-09-16T17:05:02.528 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.520+0000 7f42f3632ec0 1 Processor -- start 2024-09-16T17:05:02.528 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.520+0000 7f42f3632ec0 1 -- start start 2024-09-16T17:05:02.528 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.521+0000 7f42f3632ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x12e5120 0x1375ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.528 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.521+0000 7f42f3632ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x1247280 con 0x12e5120 2024-09-16T17:05:02.528 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.521+0000 7f42eb63f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x12e5120 0x1375ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.528 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.521+0000 7f42eb63f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x12e5120 0x1375ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52832/0 (socket says 172.21.15.89:52832) 2024-09-16T17:05:02.529 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.521+0000 7f42eb63f640 1 -- 172.21.15.89:0/3695110913 learned_addr learned my addr 172.21.15.89:0/3695110913 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.529 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.521+0000 7f42eb63f640 1 -- 172.21.15.89:0/3695110913 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x11d7920 con 0x12e5120 2024-09-16T17:05:02.529 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.521+0000 7f42eb63f640 1 --2- 172.21.15.89:0/3695110913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x12e5120 0x1375ba0 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.529 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.521+0000 7f42e8e3a640 1 -- 172.21.15.89:0/3695110913 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f42d40128e0 con 0x12e5120 2024-09-16T17:05:02.529 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.521+0000 7f42e8e3a640 1 -- 172.21.15.89:0/3695110913 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f42d4005040 con 0x12e5120 2024-09-16T17:05:02.529 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.521+0000 7f42e8e3a640 1 -- 172.21.15.89:0/3695110913 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f42d4012b70 con 0x12e5120 2024-09-16T17:05:02.529 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.521+0000 7f42f3632ec0 1 -- 172.21.15.89:0/3695110913 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x11d7380 con 0x12e5120 2024-09-16T17:05:02.530 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.521+0000 7f42f3632ec0 1 -- 172.21.15.89:0/3695110913 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x13668b0 con 0x12e5120 2024-09-16T17:05:02.530 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.522+0000 7f42e8e3a640 1 -- 172.21.15.89:0/3695110913 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f42d400d040 con 0x12e5120 2024-09-16T17:05:02.530 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.523+0000 7f42e8e3a640 1 --2- 172.21.15.89:0/3695110913 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f42d003d170 0x7f42d003f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.530 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.523+0000 7f42e8e3a640 1 -- 172.21.15.89:0/3695110913 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(718..718 src has 406..718) ==== 4207+0+0 (crc 0 0 0) 0x7f42d400a040 con 0x12e5120 2024-09-16T17:05:02.530 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.523+0000 7f42f3632ec0 1 --2- 172.21.15.89:0/3695110913 >> v2:172.21.15.89:6801/3499031688 conn(0x12e5c40 0x12dc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.530 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.523+0000 7f42f3632ec0 1 -- 172.21.15.89:0/3695110913 --> v2:172.21.15.89:6801/3499031688 -- osd_op(unknown.0.0:1 200.9 200:9a09113a:::obj7:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e718) -- 0x13678f0 con 0x12e5c40 2024-09-16T17:05:02.531 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.523+0000 7f42eae3e640 1 --2- 172.21.15.89:0/3695110913 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f42d003d170 0x7f42d003f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.531 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.523+0000 7f42eae3e640 1 --2- 172.21.15.89:0/3695110913 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f42d003d170 0x7f42d003f680 crc :-1 s=READY pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.531 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.524+0000 7f42ebe40640 1 --2- 172.21.15.89:0/3695110913 >> v2:172.21.15.89:6801/3499031688 conn(0x12e5c40 0x12dc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:05:02.531 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.527+0000 7f42ebe40640 1 --2- 172.21.15.89:0/3695110913 >> v2:172.21.15.89:6801/3499031688 conn(0x12e5c40 0x12dc3e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.549 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.546+0000 7f42ebe40640 1 -- 172.21.15.89:0/3695110913 <== osd.0 v2:172.21.15.89:6801/3499031688 1 ==== osd_op_reply(1 obj7 [writefull 0~12875] v718'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f42dc00a430 con 0x12e5c40 2024-09-16T17:05:02.549 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.546+0000 7f42f3632ec0 1 -- 172.21.15.89:0/3695110913 >> v2:172.21.15.89:6801/3499031688 conn(0x12e5c40 msgr2=0x12dc3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.549 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.546+0000 7f42f3632ec0 1 --2- 172.21.15.89:0/3695110913 >> v2:172.21.15.89:6801/3499031688 conn(0x12e5c40 0x12dc3e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.550 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.546+0000 7f42f3632ec0 1 -- 172.21.15.89:0/3695110913 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f42d003d170 msgr2=0x7f42d003f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.550 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.547+0000 7f42f3632ec0 1 --2- 172.21.15.89:0/3695110913 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f42d003d170 0x7f42d003f680 crc :-1 s=READY pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.550 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.547+0000 7f42f3632ec0 1 -- 172.21.15.89:0/3695110913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x12e5120 msgr2=0x1375ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.550 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.547+0000 7f42f3632ec0 1 --2- 172.21.15.89:0/3695110913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x12e5120 0x1375ba0 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.551 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.547+0000 7f42f3632ec0 1 -- 172.21.15.89:0/3695110913 shutdown_connections 2024-09-16T17:05:02.551 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.547+0000 7f42f3632ec0 1 --2- 172.21.15.89:0/3695110913 >> v2:172.21.15.89:6801/3499031688 conn(0x12e5c40 0x12dc3e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.551 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.547+0000 7f42f3632ec0 1 --2- 172.21.15.89:0/3695110913 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f42d003d170 0x7f42d003f680 unknown :-1 s=CLOSED pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.551 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.547+0000 7f42f3632ec0 1 --2- 172.21.15.89:0/3695110913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x12e5120 0x1375ba0 unknown :-1 s=CLOSED pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.551 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.547+0000 7f42f3632ec0 1 -- 172.21.15.89:0/3695110913 >> 172.21.15.89:0/3695110913 conn(0x1209770 msgr2=0x1377750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.552 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.547+0000 7f42f3632ec0 1 -- 172.21.15.89:0/3695110913 shutdown_connections 2024-09-16T17:05:02.552 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.547+0000 7f42f3632ec0 1 -- 172.21.15.89:0/3695110913 wait complete. 2024-09-16T17:05:02.553 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:05:02.553 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 put obj8 /etc/passwd 2024-09-16T17:05:02.586 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.585+0000 7f021f976ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.591 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.590+0000 7f021f976ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.591 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.590+0000 7f021f976ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.591+0000 7f021f976ec0 1 Processor -- start 2024-09-16T17:05:02.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.591+0000 7f021f976ec0 1 -- start start 2024-09-16T17:05:02.599 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.591+0000 7f021f976ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x20d5810 0x20c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.599 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.592+0000 7f021f976ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x2042520 con 0x20d5810 2024-09-16T17:05:02.599 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.592+0000 7f0213fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x20d5810 0x20c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.599 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.592+0000 7f0213fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x20d5810 0x20c36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52838/0 (socket says 172.21.15.89:52838) 2024-09-16T17:05:02.599 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.592+0000 7f0213fff640 1 -- 172.21.15.89:0/2668244595 learned_addr learned my addr 172.21.15.89:0/2668244595 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.600 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.592+0000 7f0213fff640 1 -- 172.21.15.89:0/2668244595 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1fdee10 con 0x20d5810 2024-09-16T17:05:02.600 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.592+0000 7f0213fff640 1 --2- 172.21.15.89:0/2668244595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x20d5810 0x20c36f0 crc :-1 s=READY pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152a62524e90fab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.600 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.592+0000 7f02127fc640 1 -- 172.21.15.89:0/2668244595 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f020402d980 con 0x20d5810 2024-09-16T17:05:02.600 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.592+0000 7f02127fc640 1 -- 172.21.15.89:0/2668244595 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f020402db80 con 0x20d5810 2024-09-16T17:05:02.600 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.592+0000 7f02127fc640 1 -- 172.21.15.89:0/2668244595 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f020402de20 con 0x20d5810 2024-09-16T17:05:02.600 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.593+0000 7f021f976ec0 1 -- 172.21.15.89:0/2668244595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x20d5810 msgr2=0x20c36f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.601 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.593+0000 7f021f976ec0 1 --2- 172.21.15.89:0/2668244595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x20d5810 0x20c36f0 crc :-1 s=READY pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.601 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.593+0000 7f021f976ec0 1 -- 172.21.15.89:0/2668244595 shutdown_connections 2024-09-16T17:05:02.601 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.593+0000 7f021f976ec0 1 --2- 172.21.15.89:0/2668244595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x20d5810 0x20c36f0 unknown :-1 s=CLOSED pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.601 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.593+0000 7f021f976ec0 1 -- 172.21.15.89:0/2668244595 >> 172.21.15.89:0/2668244595 conn(0x2002770 msgr2=0x20d9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.601 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.593+0000 7f021f976ec0 1 -- 172.21.15.89:0/2668244595 shutdown_connections 2024-09-16T17:05:02.601 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.593+0000 7f021f976ec0 1 -- 172.21.15.89:0/2668244595 wait complete. 2024-09-16T17:05:02.602 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.594+0000 7f021f976ec0 1 Processor -- start 2024-09-16T17:05:02.602 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.594+0000 7f021f976ec0 1 -- start start 2024-09-16T17:05:02.602 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.595+0000 7f021f976ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x20d5810 0x215f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.602 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.595+0000 7f021f976ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x2040280 con 0x20d5810 2024-09-16T17:05:02.602 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.595+0000 7f0213fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x20d5810 0x215f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.602 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.595+0000 7f0213fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x20d5810 0x215f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52848/0 (socket says 172.21.15.89:52848) 2024-09-16T17:05:02.603 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.595+0000 7f0213fff640 1 -- 172.21.15.89:0/1263734870 learned_addr learned my addr 172.21.15.89:0/1263734870 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.603 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.595+0000 7f0213fff640 1 -- 172.21.15.89:0/1263734870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1fd0920 con 0x20d5810 2024-09-16T17:05:02.603 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.595+0000 7f0213fff640 1 --2- 172.21.15.89:0/1263734870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x20d5810 0x215f6d0 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.603 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.595+0000 7f02117fa640 1 -- 172.21.15.89:0/1263734870 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f020402d980 con 0x20d5810 2024-09-16T17:05:02.603 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.595+0000 7f02117fa640 1 -- 172.21.15.89:0/1263734870 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0204037b50 con 0x20d5810 2024-09-16T17:05:02.603 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.595+0000 7f021f976ec0 1 -- 172.21.15.89:0/1263734870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1fd0380 con 0x20d5810 2024-09-16T17:05:02.603 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.595+0000 7f02117fa640 1 -- 172.21.15.89:0/1263734870 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0204037df0 con 0x20d5810 2024-09-16T17:05:02.604 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.595+0000 7f021f976ec0 1 -- 172.21.15.89:0/1263734870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2162900 con 0x20d5810 2024-09-16T17:05:02.604 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.596+0000 7f02117fa640 1 -- 172.21.15.89:0/1263734870 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0204003040 con 0x20d5810 2024-09-16T17:05:02.604 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.596+0000 7f02117fa640 1 --2- 172.21.15.89:0/1263734870 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f020003d1c0 0x7f020003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.604 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.596+0000 7f02117fa640 1 -- 172.21.15.89:0/1263734870 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(718..718 src has 406..718) ==== 4207+0+0 (crc 0 0 0) 0x7f0204032040 con 0x20d5810 2024-09-16T17:05:02.604 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.597+0000 7f021f976ec0 1 --2- 172.21.15.89:0/1263734870 >> v2:172.21.15.89:6801/3499031688 conn(0x20de660 0x2205100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.604 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.597+0000 7f021f976ec0 1 -- 172.21.15.89:0/1263734870 --> v2:172.21.15.89:6801/3499031688 -- osd_op(unknown.0.0:1 200.5 200:a557efb1:::obj8:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e718) -- 0x2162fd0 con 0x20de660 2024-09-16T17:05:02.605 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.597+0000 7f02137fe640 1 --2- 172.21.15.89:0/1263734870 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f020003d1c0 0x7f020003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.605 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.597+0000 7f02137fe640 1 --2- 172.21.15.89:0/1263734870 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f020003d1c0 0x7f020003f6d0 crc :-1 s=READY pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.605 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.597+0000 7f0218b9c640 1 --2- 172.21.15.89:0/1263734870 >> v2:172.21.15.89:6801/3499031688 conn(0x20de660 0x2205100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:05:02.605 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.600+0000 7f0218b9c640 1 --2- 172.21.15.89:0/1263734870 >> v2:172.21.15.89:6801/3499031688 conn(0x20de660 0x2205100 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.620 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.617+0000 7f0218b9c640 1 -- 172.21.15.89:0/1263734870 <== osd.0 v2:172.21.15.89:6801/3499031688 1 ==== osd_op_reply(1 obj8 [writefull 0~12875] v718'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f020c00c430 con 0x20de660 2024-09-16T17:05:02.620 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.617+0000 7f021f976ec0 1 -- 172.21.15.89:0/1263734870 >> v2:172.21.15.89:6801/3499031688 conn(0x20de660 msgr2=0x2205100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.621 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.617+0000 7f021f976ec0 1 --2- 172.21.15.89:0/1263734870 >> v2:172.21.15.89:6801/3499031688 conn(0x20de660 0x2205100 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.621 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.618+0000 7f021f976ec0 1 -- 172.21.15.89:0/1263734870 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f020003d1c0 msgr2=0x7f020003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.621 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.618+0000 7f021f976ec0 1 --2- 172.21.15.89:0/1263734870 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f020003d1c0 0x7f020003f6d0 crc :-1 s=READY pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.621 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.618+0000 7f021f976ec0 1 -- 172.21.15.89:0/1263734870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x20d5810 msgr2=0x215f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.622 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.618+0000 7f021f976ec0 1 --2- 172.21.15.89:0/1263734870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x20d5810 0x215f6d0 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.622 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.618+0000 7f021f976ec0 1 -- 172.21.15.89:0/1263734870 shutdown_connections 2024-09-16T17:05:02.622 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.618+0000 7f021f976ec0 1 --2- 172.21.15.89:0/1263734870 >> v2:172.21.15.89:6801/3499031688 conn(0x20de660 0x2205100 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.622 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.618+0000 7f021f976ec0 1 --2- 172.21.15.89:0/1263734870 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f020003d1c0 0x7f020003f6d0 unknown :-1 s=CLOSED pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.622 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.618+0000 7f021f976ec0 1 --2- 172.21.15.89:0/1263734870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x20d5810 0x215f6d0 unknown :-1 s=CLOSED pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.622 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.618+0000 7f021f976ec0 1 -- 172.21.15.89:0/1263734870 >> 172.21.15.89:0/1263734870 conn(0x2002770 msgr2=0x20e1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.623 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.618+0000 7f021f976ec0 1 -- 172.21.15.89:0/1263734870 shutdown_connections 2024-09-16T17:05:02.623 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.618+0000 7f021f976ec0 1 -- 172.21.15.89:0/1263734870 wait complete. 2024-09-16T17:05:02.624 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:05:02.624 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 put obj9 /etc/passwd 2024-09-16T17:05:02.657 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.656+0000 7fea29657ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.662 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.661+0000 7fea29657ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.662 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.661+0000 7fea29657ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.663 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.662+0000 7fea29657ec0 1 Processor -- start 2024-09-16T17:05:02.663 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.662+0000 7fea29657ec0 1 -- start start 2024-09-16T17:05:02.666 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.663+0000 7fea29657ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1e64820 0x1f85e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.666 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.663+0000 7fea29657ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x1dca520 con 0x1e64820 2024-09-16T17:05:02.666 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.663+0000 7fea2179b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1e64820 0x1f85e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.667 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.663+0000 7fea2179b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1e64820 0x1f85e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52860/0 (socket says 172.21.15.89:52860) 2024-09-16T17:05:02.667 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.663+0000 7fea2179b640 1 -- 172.21.15.89:0/1499523460 learned_addr learned my addr 172.21.15.89:0/1499523460 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.667 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.663+0000 7fea2179b640 1 -- 172.21.15.89:0/1499523460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1d66e10 con 0x1e64820 2024-09-16T17:05:02.667 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.663+0000 7fea2179b640 1 --2- 172.21.15.89:0/1499523460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1e64820 0x1f85e60 crc :-1 s=READY pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc13fcfc984f4c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.667 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.664+0000 7fea1affd640 1 -- 172.21.15.89:0/1499523460 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fea0c02daf0 con 0x1e64820 2024-09-16T17:05:02.667 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.664+0000 7fea1affd640 1 -- 172.21.15.89:0/1499523460 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fea0c02dc50 con 0x1e64820 2024-09-16T17:05:02.668 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.664+0000 7fea1affd640 1 -- 172.21.15.89:0/1499523460 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fea0c0374a0 con 0x1e64820 2024-09-16T17:05:02.668 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.664+0000 7fea29657ec0 1 -- 172.21.15.89:0/1499523460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1e64820 msgr2=0x1f85e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.668 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.664+0000 7fea29657ec0 1 --2- 172.21.15.89:0/1499523460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1e64820 0x1f85e60 crc :-1 s=READY pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.668 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.664+0000 7fea29657ec0 1 -- 172.21.15.89:0/1499523460 shutdown_connections 2024-09-16T17:05:02.668 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.664+0000 7fea29657ec0 1 --2- 172.21.15.89:0/1499523460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1e64820 0x1f85e60 unknown :-1 s=CLOSED pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.668 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.664+0000 7fea29657ec0 1 -- 172.21.15.89:0/1499523460 >> 172.21.15.89:0/1499523460 conn(0x1d8a770 msgr2=0x1ef8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.669 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.664+0000 7fea29657ec0 1 -- 172.21.15.89:0/1499523460 shutdown_connections 2024-09-16T17:05:02.669 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.664+0000 7fea29657ec0 1 -- 172.21.15.89:0/1499523460 wait complete. 2024-09-16T17:05:02.669 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.665+0000 7fea29657ec0 1 Processor -- start 2024-09-16T17:05:02.669 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.665+0000 7fea29657ec0 1 -- start start 2024-09-16T17:05:02.673 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.666+0000 7fea29657ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1e64820 0x1ef1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.673 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.666+0000 7fea29657ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x1dc8280 con 0x1e64820 2024-09-16T17:05:02.673 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.666+0000 7fea2179b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1e64820 0x1ef1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.673 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.666+0000 7fea2179b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1e64820 0x1ef1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52872/0 (socket says 172.21.15.89:52872) 2024-09-16T17:05:02.673 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.666+0000 7fea2179b640 1 -- 172.21.15.89:0/2812004933 learned_addr learned my addr 172.21.15.89:0/2812004933 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.673 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.667+0000 7fea2179b640 1 -- 172.21.15.89:0/2812004933 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1d58920 con 0x1e64820 2024-09-16T17:05:02.674 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.667+0000 7fea2179b640 1 --2- 172.21.15.89:0/2812004933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1e64820 0x1ef1580 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.674 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.667+0000 7fea19ffb640 1 -- 172.21.15.89:0/2812004933 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fea0c03e040 con 0x1e64820 2024-09-16T17:05:02.674 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.667+0000 7fea19ffb640 1 -- 172.21.15.89:0/2812004933 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fea0c037e80 con 0x1e64820 2024-09-16T17:05:02.674 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.667+0000 7fea29657ec0 1 -- 172.21.15.89:0/2812004933 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1d58380 con 0x1e64820 2024-09-16T17:05:02.674 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.667+0000 7fea19ffb640 1 -- 172.21.15.89:0/2812004933 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fea0c0374a0 con 0x1e64820 2024-09-16T17:05:02.674 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.667+0000 7fea29657ec0 1 -- 172.21.15.89:0/2812004933 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1f80700 con 0x1e64820 2024-09-16T17:05:02.675 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.668+0000 7fea19ffb640 1 -- 172.21.15.89:0/2812004933 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fea0c041040 con 0x1e64820 2024-09-16T17:05:02.675 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.668+0000 7fea19ffb640 1 --2- 172.21.15.89:0/2812004933 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fea0803d1c0 0x7fea0803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.675 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.668+0000 7fea19ffb640 1 -- 172.21.15.89:0/2812004933 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(718..718 src has 406..718) ==== 4207+0+0 (crc 0 0 0) 0x7fea0c032040 con 0x1e64820 2024-09-16T17:05:02.675 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.668+0000 7fea29657ec0 1 --2- 172.21.15.89:0/2812004933 >> v2:172.21.15.177:6807/75130198 conn(0x1ef4d90 0x1f7f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.675 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.668+0000 7fea29657ec0 1 -- 172.21.15.89:0/2812004933 --> v2:172.21.15.177:6807/75130198 -- osd_op(unknown.0.0:1 200.7 200:fe351e27:::obj9:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e718) -- 0x1f82760 con 0x1ef4d90 2024-09-16T17:05:02.675 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.668+0000 7fea20f9a640 1 --2- 172.21.15.89:0/2812004933 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fea0803d1c0 0x7fea0803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.675 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.669+0000 7fea20f9a640 1 --2- 172.21.15.89:0/2812004933 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fea0803d1c0 0x7fea0803f6d0 crc :-1 s=READY pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.676 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.669+0000 7fea21f9c640 1 --2- 172.21.15.89:0/2812004933 >> v2:172.21.15.177:6807/75130198 conn(0x1ef4d90 0x1f7f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:05:02.676 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.673+0000 7fea21f9c640 1 --2- 172.21.15.89:0/2812004933 >> v2:172.21.15.177:6807/75130198 conn(0x1ef4d90 0x1f7f490 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.694 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.691+0000 7fea21f9c640 1 -- 172.21.15.89:0/2812004933 <== osd.3 v2:172.21.15.177:6807/75130198 1 ==== osd_op_reply(1 obj9 [writefull 0~12875] v718'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fea1400a430 con 0x1ef4d90 2024-09-16T17:05:02.694 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.691+0000 7fea29657ec0 1 -- 172.21.15.89:0/2812004933 >> v2:172.21.15.177:6807/75130198 conn(0x1ef4d90 msgr2=0x1f7f490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.694 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.691+0000 7fea29657ec0 1 --2- 172.21.15.89:0/2812004933 >> v2:172.21.15.177:6807/75130198 conn(0x1ef4d90 0x1f7f490 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.694 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.691+0000 7fea29657ec0 1 -- 172.21.15.89:0/2812004933 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fea0803d1c0 msgr2=0x7fea0803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.695 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.691+0000 7fea29657ec0 1 --2- 172.21.15.89:0/2812004933 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fea0803d1c0 0x7fea0803f6d0 crc :-1 s=READY pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.695 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.691+0000 7fea29657ec0 1 -- 172.21.15.89:0/2812004933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1e64820 msgr2=0x1ef1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.695 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.691+0000 7fea29657ec0 1 --2- 172.21.15.89:0/2812004933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1e64820 0x1ef1580 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.695 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.691+0000 7fea29657ec0 1 -- 172.21.15.89:0/2812004933 shutdown_connections 2024-09-16T17:05:02.696 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.691+0000 7fea29657ec0 1 --2- 172.21.15.89:0/2812004933 >> v2:172.21.15.177:6807/75130198 conn(0x1ef4d90 0x1f7f490 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.696 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.691+0000 7fea29657ec0 1 --2- 172.21.15.89:0/2812004933 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fea0803d1c0 0x7fea0803f6d0 unknown :-1 s=CLOSED pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.696 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.691+0000 7fea29657ec0 1 --2- 172.21.15.89:0/2812004933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1e64820 0x1ef1580 unknown :-1 s=CLOSED pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.696 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.691+0000 7fea29657ec0 1 -- 172.21.15.89:0/2812004933 >> 172.21.15.89:0/2812004933 conn(0x1d8a770 msgr2=0x1e64c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.696 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.691+0000 7fea29657ec0 1 -- 172.21.15.89:0/2812004933 shutdown_connections 2024-09-16T17:05:02.697 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.691+0000 7fea29657ec0 1 -- 172.21.15.89:0/2812004933 wait complete. 2024-09-16T17:05:02.698 INFO:tasks.workunit.client.0.smithi089.stderr:+ for f in `seq 1 10` 2024-09-16T17:05:02.698 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 put obj10 /etc/passwd 2024-09-16T17:05:02.731 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.730+0000 7f196d2f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.736 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.735+0000 7f196d2f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.736 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.735+0000 7f196d2f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:02.737 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.735+0000 7f196d2f3ec0 1 Processor -- start 2024-09-16T17:05:02.737 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.735+0000 7f196d2f3ec0 1 -- start start 2024-09-16T17:05:02.744 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.736+0000 7f196d2f3ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xa97ea0 0xa96650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.744 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.736+0000 7f196d2f3ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x96b520 con 0xa97ea0 2024-09-16T17:05:02.744 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.737+0000 7f196563f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xa97ea0 0xa96650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.744 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.737+0000 7f196563f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xa97ea0 0xa96650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52902/0 (socket says 172.21.15.89:52902) 2024-09-16T17:05:02.745 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.737+0000 7f196563f640 1 -- 172.21.15.89:0/2566479279 learned_addr learned my addr 172.21.15.89:0/2566479279 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.745 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.737+0000 7f196563f640 1 -- 172.21.15.89:0/2566479279 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x907e10 con 0xa97ea0 2024-09-16T17:05:02.745 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.737+0000 7f196563f640 1 --2- 172.21.15.89:0/2566479279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xa97ea0 0xa96650 crc :-1 s=READY pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b63271b67b5557 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.745 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.737+0000 7f195effd640 1 -- 172.21.15.89:0/2566479279 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f195002dc90 con 0xa97ea0 2024-09-16T17:05:02.745 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.737+0000 7f195effd640 1 -- 172.21.15.89:0/2566479279 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f195002de90 con 0xa97ea0 2024-09-16T17:05:02.746 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.737+0000 7f195effd640 1 -- 172.21.15.89:0/2566479279 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f195000a170 con 0xa97ea0 2024-09-16T17:05:02.746 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.738+0000 7f196d2f3ec0 1 -- 172.21.15.89:0/2566479279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xa97ea0 msgr2=0xa96650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.746 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.738+0000 7f196d2f3ec0 1 --2- 172.21.15.89:0/2566479279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xa97ea0 0xa96650 crc :-1 s=READY pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.746 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.738+0000 7f196d2f3ec0 1 -- 172.21.15.89:0/2566479279 shutdown_connections 2024-09-16T17:05:02.746 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.738+0000 7f196d2f3ec0 1 --2- 172.21.15.89:0/2566479279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xa97ea0 0xa96650 unknown :-1 s=CLOSED pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.746 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.738+0000 7f196d2f3ec0 1 -- 172.21.15.89:0/2566479279 >> 172.21.15.89:0/2566479279 conn(0x92b770 msgr2=0xa08050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.747 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.738+0000 7f196d2f3ec0 1 -- 172.21.15.89:0/2566479279 shutdown_connections 2024-09-16T17:05:02.747 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.738+0000 7f196d2f3ec0 1 -- 172.21.15.89:0/2566479279 wait complete. 2024-09-16T17:05:02.747 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.739+0000 7f196d2f3ec0 1 Processor -- start 2024-09-16T17:05:02.747 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.739+0000 7f196d2f3ec0 1 -- start start 2024-09-16T17:05:02.747 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.740+0000 7f196d2f3ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xa97ea0 0xa81470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.747 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.740+0000 7f196d2f3ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x969280 con 0xa97ea0 2024-09-16T17:05:02.748 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.740+0000 7f196563f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xa97ea0 0xa81470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.748 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.740+0000 7f196563f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xa97ea0 0xa81470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52912/0 (socket says 172.21.15.89:52912) 2024-09-16T17:05:02.748 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.740+0000 7f196563f640 1 -- 172.21.15.89:0/1059246931 learned_addr learned my addr 172.21.15.89:0/1059246931 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:02.748 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.740+0000 7f196563f640 1 -- 172.21.15.89:0/1059246931 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x8f9920 con 0xa97ea0 2024-09-16T17:05:02.748 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.740+0000 7f196563f640 1 --2- 172.21.15.89:0/1059246931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xa97ea0 0xa81470 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.748 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.740+0000 7f195dffb640 1 -- 172.21.15.89:0/1059246931 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f195003e040 con 0xa97ea0 2024-09-16T17:05:02.749 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.740+0000 7f195dffb640 1 -- 172.21.15.89:0/1059246931 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1950039660 con 0xa97ea0 2024-09-16T17:05:02.749 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.740+0000 7f196d2f3ec0 1 -- 172.21.15.89:0/1059246931 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x8f9380 con 0xa97ea0 2024-09-16T17:05:02.749 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.740+0000 7f195dffb640 1 -- 172.21.15.89:0/1059246931 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1950039900 con 0xa97ea0 2024-09-16T17:05:02.749 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.741+0000 7f196d2f3ec0 1 -- 172.21.15.89:0/1059246931 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0xa04ce0 con 0xa97ea0 2024-09-16T17:05:02.749 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.741+0000 7f195dffb640 1 -- 172.21.15.89:0/1059246931 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1950039ab0 con 0xa97ea0 2024-09-16T17:05:02.749 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.742+0000 7f195dffb640 1 --2- 172.21.15.89:0/1059246931 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f194c03d1c0 0x7f194c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.750 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.742+0000 7f195dffb640 1 -- 172.21.15.89:0/1059246931 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(718..718 src has 406..718) ==== 4207+0+0 (crc 0 0 0) 0x7f1950032040 con 0xa97ea0 2024-09-16T17:05:02.750 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.742+0000 7f196d2f3ec0 1 --2- 172.21.15.89:0/1059246931 >> v2:172.21.15.89:6801/3499031688 conn(0xa987f0 0xb2be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:02.750 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.742+0000 7f196d2f3ec0 1 -- 172.21.15.89:0/1059246931 --> v2:172.21.15.89:6801/3499031688 -- osd_op(unknown.0.0:1 200.b 200:d1337354:::obj10:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e718) -- 0xa92330 con 0xa987f0 2024-09-16T17:05:02.750 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.742+0000 7f1964e3e640 1 --2- 172.21.15.89:0/1059246931 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f194c03d1c0 0x7f194c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:02.750 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.742+0000 7f1964e3e640 1 --2- 172.21.15.89:0/1059246931 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f194c03d1c0 0x7f194c03f6d0 crc :-1 s=READY pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.751 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.743+0000 7f1965e40640 1 --2- 172.21.15.89:0/1059246931 >> v2:172.21.15.89:6801/3499031688 conn(0xa987f0 0xb2be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:05:02.751 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.746+0000 7f1965e40640 1 --2- 172.21.15.89:0/1059246931 >> v2:172.21.15.89:6801/3499031688 conn(0xa987f0 0xb2be80 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:02.768 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.765+0000 7f1965e40640 1 -- 172.21.15.89:0/1059246931 <== osd.0 v2:172.21.15.89:6801/3499031688 1 ==== osd_op_reply(1 obj10 [writefull 0~12875] v718'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f195800a430 con 0xa987f0 2024-09-16T17:05:02.768 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.766+0000 7f196d2f3ec0 1 -- 172.21.15.89:0/1059246931 >> v2:172.21.15.89:6801/3499031688 conn(0xa987f0 msgr2=0xb2be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.769 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.766+0000 7f196d2f3ec0 1 --2- 172.21.15.89:0/1059246931 >> v2:172.21.15.89:6801/3499031688 conn(0xa987f0 0xb2be80 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.769 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.766+0000 7f196d2f3ec0 1 -- 172.21.15.89:0/1059246931 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f194c03d1c0 msgr2=0x7f194c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.769 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.766+0000 7f196d2f3ec0 1 --2- 172.21.15.89:0/1059246931 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f194c03d1c0 0x7f194c03f6d0 crc :-1 s=READY pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.769 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.766+0000 7f196d2f3ec0 1 -- 172.21.15.89:0/1059246931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xa97ea0 msgr2=0xa81470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:02.769 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.766+0000 7f196d2f3ec0 1 --2- 172.21.15.89:0/1059246931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xa97ea0 0xa81470 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.770 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.766+0000 7f196d2f3ec0 1 -- 172.21.15.89:0/1059246931 shutdown_connections 2024-09-16T17:05:02.770 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.766+0000 7f196d2f3ec0 1 --2- 172.21.15.89:0/1059246931 >> v2:172.21.15.89:6801/3499031688 conn(0xa987f0 0xb2be80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.770 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.766+0000 7f196d2f3ec0 1 --2- 172.21.15.89:0/1059246931 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f194c03d1c0 0x7f194c03f6d0 unknown :-1 s=CLOSED pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.770 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.766+0000 7f196d2f3ec0 1 --2- 172.21.15.89:0/1059246931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0xa97ea0 0xa81470 unknown :-1 s=CLOSED pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:02.770 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.766+0000 7f196d2f3ec0 1 -- 172.21.15.89:0/1059246931 >> 172.21.15.89:0/1059246931 conn(0x92b770 msgr2=0xa08050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:02.770 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.766+0000 7f196d2f3ec0 1 -- 172.21.15.89:0/1059246931 shutdown_connections 2024-09-16T17:05:02.771 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:02.766+0000 7f196d2f3ec0 1 -- 172.21.15.89:0/1059246931 wait complete. 2024-09-16T17:05:02.771 INFO:tasks.workunit.client.0.smithi089.stderr:+ sleep 30 2024-09-16T17:05:32.772 INFO:tasks.workunit.client.0.smithi089.stderr:+ rados -p ad5c36b8-029a-4232-9d54-ea1601f1a3e9 put threemore /etc/passwd 2024-09-16T17:05:32.877 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.814+0000 7f3a07b16ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:32.877 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.819+0000 7f3a07b16ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:32.877 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.820+0000 7f3a07b16ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:32.877 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.820+0000 7f3a07b16ec0 1 Processor -- start 2024-09-16T17:05:32.877 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.820+0000 7f3a07b16ec0 1 -- start start 2024-09-16T17:05:32.878 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.821+0000 7f3a07b16ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1fa2990 0x2020740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:32.878 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.821+0000 7f3a07b16ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x1f07520 con 0x1fa2990 2024-09-16T17:05:32.878 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.821+0000 7f39fb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1fa2990 0x2020740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:32.878 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.821+0000 7f39fb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1fa2990 0x2020740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36366/0 (socket says 172.21.15.89:36366) 2024-09-16T17:05:32.878 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.821+0000 7f39fb7fe640 1 -- 172.21.15.89:0/2910382829 learned_addr learned my addr 172.21.15.89:0/2910382829 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:32.878 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.822+0000 7f39fb7fe640 1 -- 172.21.15.89:0/2910382829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1ea3e10 con 0x1fa2990 2024-09-16T17:05:32.878 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.822+0000 7f39fb7fe640 1 --2- 172.21.15.89:0/2910382829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1fa2990 0x2020740 crc :-1 s=READY pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8877e00d4a4fc248 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:32.878 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.822+0000 7f39f9ffb640 1 -- 172.21.15.89:0/2910382829 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f39e802db60 con 0x1fa2990 2024-09-16T17:05:32.878 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.822+0000 7f39f9ffb640 1 -- 172.21.15.89:0/2910382829 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f39e8037370 con 0x1fa2990 2024-09-16T17:05:32.878 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.822+0000 7f39f9ffb640 1 -- 172.21.15.89:0/2910382829 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f39e8037610 con 0x1fa2990 2024-09-16T17:05:32.879 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.823+0000 7f3a07b16ec0 1 -- 172.21.15.89:0/2910382829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1fa2990 msgr2=0x2020740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:32.879 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.823+0000 7f3a07b16ec0 1 --2- 172.21.15.89:0/2910382829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1fa2990 0x2020740 crc :-1 s=READY pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:32.879 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.823+0000 7f3a07b16ec0 1 -- 172.21.15.89:0/2910382829 shutdown_connections 2024-09-16T17:05:32.879 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.823+0000 7f3a07b16ec0 1 --2- 172.21.15.89:0/2910382829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1fa2990 0x2020740 unknown :-1 s=CLOSED pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:32.879 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.823+0000 7f3a07b16ec0 1 -- 172.21.15.89:0/2910382829 >> 172.21.15.89:0/2910382829 conn(0x1ec7770 msgr2=0x1f9cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:32.879 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.823+0000 7f3a07b16ec0 1 -- 172.21.15.89:0/2910382829 shutdown_connections 2024-09-16T17:05:32.879 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.823+0000 7f3a07b16ec0 1 -- 172.21.15.89:0/2910382829 wait complete. 2024-09-16T17:05:32.879 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.824+0000 7f3a07b16ec0 1 Processor -- start 2024-09-16T17:05:32.879 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.825+0000 7f3a07b16ec0 1 -- start start 2024-09-16T17:05:32.879 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.827+0000 7f3a07b16ec0 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1fa2990 0x2024ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:32.879 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.827+0000 7f3a07b16ec0 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x1f05280 con 0x1fa2990 2024-09-16T17:05:32.879 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.827+0000 7f39fb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1fa2990 0x2024ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:32.880 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.827+0000 7f39fb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1fa2990 0x2024ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36376/0 (socket says 172.21.15.89:36376) 2024-09-16T17:05:32.880 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.827+0000 7f39fb7fe640 1 -- 172.21.15.89:0/2349063427 learned_addr learned my addr 172.21.15.89:0/2349063427 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:32.880 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.827+0000 7f39fb7fe640 1 -- 172.21.15.89:0/2349063427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e95920 con 0x1fa2990 2024-09-16T17:05:32.880 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.827+0000 7f39fb7fe640 1 --2- 172.21.15.89:0/2349063427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1fa2990 0x2024ae0 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:32.880 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.828+0000 7f39f8ff9640 1 -- 172.21.15.89:0/2349063427 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f39e803e040 con 0x1fa2990 2024-09-16T17:05:32.880 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.828+0000 7f39f8ff9640 1 -- 172.21.15.89:0/2349063427 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f39e80374e0 con 0x1fa2990 2024-09-16T17:05:32.880 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.828+0000 7f3a07b16ec0 1 -- 172.21.15.89:0/2349063427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1e95380 con 0x1fa2990 2024-09-16T17:05:32.880 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.828+0000 7f39f8ff9640 1 -- 172.21.15.89:0/2349063427 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f39e802db60 con 0x1fa2990 2024-09-16T17:05:32.880 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.828+0000 7f3a07b16ec0 1 -- 172.21.15.89:0/2349063427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2024720 con 0x1fa2990 2024-09-16T17:05:32.880 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.829+0000 7f39f8ff9640 1 -- 172.21.15.89:0/2349063427 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f39e8041040 con 0x1fa2990 2024-09-16T17:05:32.880 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.829+0000 7f39f8ff9640 1 --2- 172.21.15.89:0/2349063427 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f39e403d1c0 0x7f39e403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:32.880 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.829+0000 7f39f8ff9640 1 -- 172.21.15.89:0/2349063427 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(720..720 src has 406..720) ==== 4207+0+0 (crc 0 0 0) 0x7f39e8032040 con 0x1fa2990 2024-09-16T17:05:32.881 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.829+0000 7f39f8ff9640 1 -- 172.21.15.89:0/2349063427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=721}) -- 0x7f39e4043c50 con 0x1fa2990 2024-09-16T17:05:32.881 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.829+0000 7f3a07b16ec0 1 --2- 172.21.15.89:0/2349063427 >> v2:172.21.15.177:6806/229775330 conn(0x1fa3c50 0x20ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:32.881 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.829+0000 7f3a07b16ec0 1 -- 172.21.15.89:0/2349063427 --> v2:172.21.15.177:6806/229775330 -- osd_op(unknown.0.0:1 199.2 199:47cad802:::threemore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e720) -- 0x2027c00 con 0x1fa3c50 2024-09-16T17:05:32.881 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.829+0000 7f39faffd640 1 --2- 172.21.15.89:0/2349063427 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f39e403d1c0 0x7f39e403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:32.881 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.830+0000 7f39faffd640 1 --2- 172.21.15.89:0/2349063427 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f39e403d1c0 0x7f39e403f6d0 crc :-1 s=READY pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:32.881 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.831+0000 7f39fbfff640 1 --2- 172.21.15.89:0/2349063427 >> v2:172.21.15.177:6806/229775330 conn(0x1fa3c50 0x20ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:05:32.881 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.835+0000 7f39fbfff640 1 --2- 172.21.15.89:0/2349063427 >> v2:172.21.15.177:6806/229775330 conn(0x1fa3c50 0x20ca8b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:32.881 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.857+0000 7f39fbfff640 1 -- 172.21.15.89:0/2349063427 <== osd.2 v2:172.21.15.177:6806/229775330 1 ==== osd_op_reply(1 threemore [writefull 0~12875] v720'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f39f000a430 con 0x1fa3c50 2024-09-16T17:05:32.881 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.857+0000 7f3a07b16ec0 1 -- 172.21.15.89:0/2349063427 >> v2:172.21.15.177:6806/229775330 conn(0x1fa3c50 msgr2=0x20ca8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:32.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.857+0000 7f3a07b16ec0 1 --2- 172.21.15.89:0/2349063427 >> v2:172.21.15.177:6806/229775330 conn(0x1fa3c50 0x20ca8b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:32.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.857+0000 7f3a07b16ec0 1 -- 172.21.15.89:0/2349063427 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f39e403d1c0 msgr2=0x7f39e403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:32.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.857+0000 7f3a07b16ec0 1 --2- 172.21.15.89:0/2349063427 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f39e403d1c0 0x7f39e403f6d0 crc :-1 s=READY pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:32.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.857+0000 7f3a07b16ec0 1 -- 172.21.15.89:0/2349063427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1fa2990 msgr2=0x2024ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:32.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.857+0000 7f3a07b16ec0 1 --2- 172.21.15.89:0/2349063427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1fa2990 0x2024ae0 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:32.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.857+0000 7f3a07b16ec0 1 -- 172.21.15.89:0/2349063427 shutdown_connections 2024-09-16T17:05:32.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.857+0000 7f3a07b16ec0 1 --2- 172.21.15.89:0/2349063427 >> v2:172.21.15.177:6806/229775330 conn(0x1fa3c50 0x20ca8b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:32.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.857+0000 7f3a07b16ec0 1 --2- 172.21.15.89:0/2349063427 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f39e403d1c0 0x7f39e403f6d0 unknown :-1 s=CLOSED pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:32.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.857+0000 7f3a07b16ec0 1 --2- 172.21.15.89:0/2349063427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1fa2990 0x2024ae0 unknown :-1 s=CLOSED pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:32.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.857+0000 7f3a07b16ec0 1 -- 172.21.15.89:0/2349063427 >> 172.21.15.89:0/2349063427 conn(0x1ec7770 msgr2=0x1f9cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:32.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.857+0000 7f3a07b16ec0 1 -- 172.21.15.89:0/2349063427 shutdown_connections 2024-09-16T17:05:32.882 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.857+0000 7f3a07b16ec0 1 -- 172.21.15.89:0/2349063427 wait complete. 2024-09-16T17:05:32.882 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph osd pool set-quota ad5c36b8-029a-4232-9d54-ea1601f1a3e9 max_bytes 0 2024-09-16T17:05:32.956 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.946+0000 7f1079d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:32.956 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.956+0000 7f1079d11640 1 Processor -- start 2024-09-16T17:05:32.957 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.956+0000 7f1079d11640 1 -- start start 2024-09-16T17:05:32.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.957+0000 7f1079d11640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f10740a2df0 0x7f10740a3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:32.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.957+0000 7f1079d11640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10740a2460 con 0x7f1074135510 2024-09-16T17:05:32.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.957+0000 7f1079d11640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f10740a3d40 con 0x7f10740a2df0 2024-09-16T17:05:32.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.957+0000 7f10737fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f10740a2df0 0x7f10740a3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:32.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.957+0000 7f1072ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1074135510 0x7f1074135920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54830/0 (socket says 172.21.15.89:54830) 2024-09-16T17:05:32.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.957+0000 7f1072ffd640 1 -- 172.21.15.89:0/41797531 learned_addr learned my addr 172.21.15.89:0/41797531 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:05:32.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.957+0000 7f10737fe640 1 -- 172.21.15.89:0/41797531 >> v1:172.21.15.89:6789/0 conn(0x7f1074135510 legacy=0x7f1074135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:32.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.957+0000 7f10737fe640 1 -- 172.21.15.89:0/41797531 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10740a29a0 con 0x7f10740a2df0 2024-09-16T17:05:32.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.957+0000 7f10737fe640 1 --2- 172.21.15.89:0/41797531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10740a2df0 0x7f10740a3200 crc :-1 s=READY pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d73b4f1190af6b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:32.959 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.957+0000 7f10727fc640 1 -- 172.21.15.89:0/41797531 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1064009d90 con 0x7f10740a2df0 2024-09-16T17:05:32.960 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.958+0000 7f10727fc640 1 -- 172.21.15.89:0/41797531 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f106400e230 con 0x7f10740a2df0 2024-09-16T17:05:32.960 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.958+0000 7f10727fc640 1 -- 172.21.15.89:0/41797531 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f106400e4d0 con 0x7f10740a2df0 2024-09-16T17:05:32.961 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.958+0000 7f1079d11640 1 -- 172.21.15.89:0/41797531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10740a2df0 msgr2=0x7f10740a3200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:32.961 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.958+0000 7f1079d11640 1 --2- 172.21.15.89:0/41797531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10740a2df0 0x7f10740a3200 crc :-1 s=READY pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:32.961 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.958+0000 7f1079d11640 1 -- 172.21.15.89:0/41797531 shutdown_connections 2024-09-16T17:05:32.961 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.958+0000 7f1079d11640 1 --2- 172.21.15.89:0/41797531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10740a2df0 0x7f10740a3200 unknown :-1 s=CLOSED pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:32.961 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.958+0000 7f1079d11640 1 -- 172.21.15.89:0/41797531 >> 172.21.15.89:0/41797531 conn(0x7f10740a4ad0 msgr2=0x7f10740a4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:32.962 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.958+0000 7f1079d11640 1 -- 172.21.15.89:0/41797531 shutdown_connections 2024-09-16T17:05:32.962 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.958+0000 7f1079d11640 1 -- 172.21.15.89:0/41797531 wait complete. 2024-09-16T17:05:32.962 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.959+0000 7f1079d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:32.962 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.960+0000 7f1079d11640 1 Processor -- start 2024-09-16T17:05:32.962 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.960+0000 7f1079d11640 1 -- start start 2024-09-16T17:05:32.963 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.961+0000 7f1079d11640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10740a2df0 0x7f10741206a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:32.963 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.961+0000 7f1079d11640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1074123110 con 0x7f10740a2df0 2024-09-16T17:05:32.964 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.961+0000 7f10737fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10740a2df0 0x7f10741206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:32.964 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.961+0000 7f10737fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10740a2df0 0x7f10741206a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36400/0 (socket says 172.21.15.89:36400) 2024-09-16T17:05:32.964 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.961+0000 7f10737fe640 1 -- 172.21.15.89:0/2839314125 learned_addr learned my addr 172.21.15.89:0/2839314125 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:32.964 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.961+0000 7f10737fe640 1 -- 172.21.15.89:0/2839314125 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10741202e0 con 0x7f10740a2df0 2024-09-16T17:05:32.964 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.962+0000 7f10737fe640 1 --2- 172.21.15.89:0/2839314125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10740a2df0 0x7f10741206a0 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:32.964 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.962+0000 7f105bfff640 1 -- 172.21.15.89:0/2839314125 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1064014620 con 0x7f10740a2df0 2024-09-16T17:05:32.964 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.962+0000 7f105bfff640 1 -- 172.21.15.89:0/2839314125 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1064014780 con 0x7f10740a2df0 2024-09-16T17:05:32.964 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.962+0000 7f1079d11640 1 -- 172.21.15.89:0/2839314125 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1074123b00 con 0x7f10740a2df0 2024-09-16T17:05:32.964 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.962+0000 7f1079d11640 1 -- 172.21.15.89:0/2839314125 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f107411fc30 con 0x7f10740a2df0 2024-09-16T17:05:32.964 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.962+0000 7f105bfff640 1 -- 172.21.15.89:0/2839314125 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f10640148f0 con 0x7f10740a2df0 2024-09-16T17:05:32.965 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.963+0000 7f1079d11640 1 -- 172.21.15.89:0/2839314125 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f107409bc40 con 0x7f10740a2df0 2024-09-16T17:05:32.965 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.963+0000 7f105bfff640 1 -- 172.21.15.89:0/2839314125 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1064014af0 con 0x7f10740a2df0 2024-09-16T17:05:32.966 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.963+0000 7f105bfff640 1 --2- 172.21.15.89:0/2839314125 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f106003e8e0 0x7f1060040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:32.966 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.963+0000 7f105bfff640 1 -- 172.21.15.89:0/2839314125 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(720..720 src has 406..720) ==== 4207+0+0 (crc 0 0 0) 0x7f1064019040 con 0x7f10740a2df0 2024-09-16T17:05:32.966 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.964+0000 7f105bfff640 1 -- 172.21.15.89:0/2839314125 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=721}) -- 0x7f1060045370 con 0x7f10740a2df0 2024-09-16T17:05:32.966 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.964+0000 7f1072ffd640 1 --2- 172.21.15.89:0/2839314125 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f106003e8e0 0x7f1060040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:32.966 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.964+0000 7f1072ffd640 1 --2- 172.21.15.89:0/2839314125 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f106003e8e0 0x7f1060040df0 crc :-1 s=READY pgs=3871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:32.969 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:32.969+0000 7f105bfff640 1 -- 172.21.15.89:0/2839314125 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f1064012390 con 0x7f10740a2df0 2024-09-16T17:05:33.156 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:33.155+0000 7f1079d11640 1 -- 172.21.15.89:0/2839314125 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_bytes", "val": "0"} v 0) -- 0x7f10740008d0 con 0x7f10740a2df0 2024-09-16T17:05:33.464 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:33.463+0000 7f105bfff640 1 -- 172.21.15.89:0/2839314125 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 v721) ==== 217+0+0 (crc 0 0 0) 0x7f1064018190 con 0x7f10740a2df0 2024-09-16T17:05:33.466 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:33.465+0000 7f105bfff640 1 -- 172.21.15.89:0/2839314125 <== mon.0 v2:172.21.15.89:3300/0 8 ==== osd_map(721..721 src has 406..721) ==== 628+0+0 (crc 0 0 0) 0x7f1064006860 con 0x7f10740a2df0 2024-09-16T17:05:33.466 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:33.465+0000 7f105bfff640 1 -- 172.21.15.89:0/2839314125 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=722}) -- 0x7f10600460f0 con 0x7f10740a2df0 2024-09-16T17:05:33.580 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:33.579+0000 7f1079d11640 1 -- 172.21.15.89:0/2839314125 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_bytes", "val": "0"} v 0) -- 0x7f10740698c0 con 0x7f10740a2df0 2024-09-16T17:05:34.465 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.464+0000 7f105bfff640 1 -- 172.21.15.89:0/2839314125 <== mon.0 v2:172.21.15.89:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 v722) ==== 217+0+0 (crc 0 0 0) 0x7f1064018370 con 0x7f10740a2df0 2024-09-16T17:05:34.465 INFO:tasks.workunit.client.0.smithi089.stderr:set-quota max_bytes = 0 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 2024-09-16T17:05:34.465 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.464+0000 7f105bfff640 1 -- 172.21.15.89:0/2839314125 <== mon.0 v2:172.21.15.89:3300/0 10 ==== osd_map(722..722 src has 406..722) ==== 628+0+0 (crc 0 0 0) 0x7f1064018530 con 0x7f10740a2df0 2024-09-16T17:05:34.465 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.464+0000 7f105bfff640 1 -- 172.21.15.89:0/2839314125 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=723}) -- 0x7f10600463d0 con 0x7f10740a2df0 2024-09-16T17:05:34.467 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.466+0000 7f1079d11640 1 -- 172.21.15.89:0/2839314125 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f106003e8e0 msgr2=0x7f1060040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:34.467 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.466+0000 7f1079d11640 1 --2- 172.21.15.89:0/2839314125 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f106003e8e0 0x7f1060040df0 crc :-1 s=READY pgs=3871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:34.468 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.466+0000 7f1079d11640 1 -- 172.21.15.89:0/2839314125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10740a2df0 msgr2=0x7f10741206a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:34.468 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.466+0000 7f1079d11640 1 --2- 172.21.15.89:0/2839314125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10740a2df0 0x7f10741206a0 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:34.468 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.466+0000 7f1079d11640 1 -- 172.21.15.89:0/2839314125 shutdown_connections 2024-09-16T17:05:34.468 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.466+0000 7f1079d11640 1 --2- 172.21.15.89:0/2839314125 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f106003e8e0 0x7f1060040df0 unknown :-1 s=CLOSED pgs=3871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:34.468 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.466+0000 7f1079d11640 1 --2- 172.21.15.89:0/2839314125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10740a2df0 0x7f10741206a0 unknown :-1 s=CLOSED pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:34.468 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.466+0000 7f1079d11640 1 -- 172.21.15.89:0/2839314125 >> 172.21.15.89:0/2839314125 conn(0x7f10740a4ad0 msgr2=0x7f10740a5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:34.468 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.466+0000 7f1079d11640 1 -- 172.21.15.89:0/2839314125 shutdown_connections 2024-09-16T17:05:34.468 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.467+0000 7f1079d11640 1 -- 172.21.15.89:0/2839314125 wait complete. 2024-09-16T17:05:34.484 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph osd pool set-quota ad5c36b8-029a-4232-9d54-ea1601f1a3e9 max_objects 0 2024-09-16T17:05:34.584 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.575+0000 7fa9fef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:34.585 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.584+0000 7fa9fef51640 1 Processor -- start 2024-09-16T17:05:34.585 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.584+0000 7fa9fef51640 1 -- start start 2024-09-16T17:05:34.587 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.585+0000 7fa9fef51640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa9f8135dd0 0x7fa9f813a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:34.587 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.585+0000 7fa9fef51640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f809d0a0 con 0x7fa9f809bd00 2024-09-16T17:05:34.587 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.585+0000 7fa9fef51640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f809ceb0 con 0x7fa9f8135dd0 2024-09-16T17:05:34.587 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.586+0000 7fa9effff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa9f8135dd0 0x7fa9f813a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:34.587 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.586+0000 7fa9fcced640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa9f809bd00 0x7fa9f81356c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54834/0 (socket says 172.21.15.89:54834) 2024-09-16T17:05:34.588 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.586+0000 7fa9effff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa9f8135dd0 0x7fa9f813a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36404/0 (socket says 172.21.15.89:36404) 2024-09-16T17:05:34.588 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.586+0000 7fa9fcced640 1 -- 172.21.15.89:0/4194055380 learned_addr learned my addr 172.21.15.89:0/4194055380 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:05:34.588 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.586+0000 7fa9effff640 1 -- 172.21.15.89:0/4194055380 >> v1:172.21.15.89:6789/0 conn(0x7fa9f809bd00 legacy=0x7fa9f81356c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:34.588 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.586+0000 7fa9effff640 1 -- 172.21.15.89:0/4194055380 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f81361e0 con 0x7fa9f8135dd0 2024-09-16T17:05:34.588 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.586+0000 7fa9ef7fe640 1 -- 172.21.15.89:0/4194055380 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4167617184 0 0) 0x7fa9f809d0a0 con 0x7fa9f809bd00 2024-09-16T17:05:34.588 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.586+0000 7fa9effff640 1 --2- 172.21.15.89:0/4194055380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9f8135dd0 0x7fa9f813a750 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a40e79c0d81742 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:34.588 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.586+0000 7fa9ef7fe640 1 -- 172.21.15.89:0/4194055380 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa9e8009d90 con 0x7fa9f8135dd0 2024-09-16T17:05:34.588 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.586+0000 7fa9ef7fe640 1 -- 172.21.15.89:0/4194055380 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa9e800e230 con 0x7fa9f8135dd0 2024-09-16T17:05:34.588 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.586+0000 7fa9ef7fe640 1 -- 172.21.15.89:0/4194055380 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa9e800e4d0 con 0x7fa9f8135dd0 2024-09-16T17:05:34.589 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.587+0000 7fa9fef51640 1 -- 172.21.15.89:0/4194055380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9f8135dd0 msgr2=0x7fa9f813a750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:34.589 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.587+0000 7fa9fef51640 1 --2- 172.21.15.89:0/4194055380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9f8135dd0 0x7fa9f813a750 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:34.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.587+0000 7fa9fef51640 1 -- 172.21.15.89:0/4194055380 shutdown_connections 2024-09-16T17:05:34.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.587+0000 7fa9fef51640 1 --2- 172.21.15.89:0/4194055380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9f8135dd0 0x7fa9f813a750 unknown :-1 s=CLOSED pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:34.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.587+0000 7fa9fef51640 1 -- 172.21.15.89:0/4194055380 >> 172.21.15.89:0/4194055380 conn(0x7fa9f80a26b0 msgr2=0x7fa9f80a2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:34.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.587+0000 7fa9fef51640 1 -- 172.21.15.89:0/4194055380 shutdown_connections 2024-09-16T17:05:34.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.587+0000 7fa9fef51640 1 -- 172.21.15.89:0/4194055380 wait complete. 2024-09-16T17:05:34.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.587+0000 7fa9fef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:05:34.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.589+0000 7fa9fef51640 1 Processor -- start 2024-09-16T17:05:34.590 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.589+0000 7fa9fef51640 1 -- start start 2024-09-16T17:05:34.591 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.590+0000 7fa9fef51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9f809bd00 0x7fa9f8131b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:34.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.590+0000 7fa9fef51640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f8121570 con 0x7fa9f809bd00 2024-09-16T17:05:34.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.590+0000 7fa9fcced640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9f809bd00 0x7fa9f8131b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:34.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.590+0000 7fa9fcced640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9f809bd00 0x7fa9f8131b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36414/0 (socket says 172.21.15.89:36414) 2024-09-16T17:05:34.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.590+0000 7fa9fcced640 1 -- 172.21.15.89:0/900816268 learned_addr learned my addr 172.21.15.89:0/900816268 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:05:34.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.590+0000 7fa9fcced640 1 -- 172.21.15.89:0/900816268 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f811e820 con 0x7fa9f809bd00 2024-09-16T17:05:34.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.590+0000 7fa9fcced640 1 --2- 172.21.15.89:0/900816268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9f809bd00 0x7fa9f8131b10 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:34.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.590+0000 7fa9ed7fa640 1 -- 172.21.15.89:0/900816268 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa9f4004b80 con 0x7fa9f809bd00 2024-09-16T17:05:34.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.590+0000 7fa9ed7fa640 1 -- 172.21.15.89:0/900816268 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa9f4004ce0 con 0x7fa9f809bd00 2024-09-16T17:05:34.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.591+0000 7fa9fef51640 1 -- 172.21.15.89:0/900816268 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f8121090 con 0x7fa9f809bd00 2024-09-16T17:05:34.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.591+0000 7fa9ed7fa640 1 -- 172.21.15.89:0/900816268 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa9f4007120 con 0x7fa9f809bd00 2024-09-16T17:05:34.592 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.591+0000 7fa9fef51640 1 -- 172.21.15.89:0/900816268 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f8132ce0 con 0x7fa9f809bd00 2024-09-16T17:05:34.593 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.591+0000 7fa9ed7fa640 1 -- 172.21.15.89:0/900816268 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa9f40072d0 con 0x7fa9f809bd00 2024-09-16T17:05:34.593 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.591+0000 7fa9fef51640 1 -- 172.21.15.89:0/900816268 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f811e680 con 0x7fa9f809bd00 2024-09-16T17:05:34.594 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.592+0000 7fa9ed7fa640 1 --2- 172.21.15.89:0/900816268 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fa9e403e930 0x7fa9e4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:05:34.594 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.592+0000 7fa9ed7fa640 1 -- 172.21.15.89:0/900816268 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(722..722 src has 406..722) ==== 4207+0+0 (crc 0 0 0) 0x7fa9f404fda0 con 0x7fa9f809bd00 2024-09-16T17:05:34.594 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.592+0000 7fa9ed7fa640 1 -- 172.21.15.89:0/900816268 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=723}) -- 0x7fa9e4045360 con 0x7fa9f809bd00 2024-09-16T17:05:34.594 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.592+0000 7fa9effff640 1 --2- 172.21.15.89:0/900816268 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fa9e403e930 0x7fa9e4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:05:34.594 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.593+0000 7fa9effff640 1 --2- 172.21.15.89:0/900816268 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fa9e403e930 0x7fa9e4040e40 crc :-1 s=READY pgs=3872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:05:34.598 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.597+0000 7fa9ed7fa640 1 -- 172.21.15.89:0/900816268 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fa9f811e680 con 0x7fa9f809bd00 2024-09-16T17:05:34.774 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:34.773+0000 7fa9fef51640 1 -- 172.21.15.89:0/900816268 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_objects", "val": "0"} v 0) -- 0x7fa9f811e680 con 0x7fa9f809bd00 2024-09-16T17:05:35.472 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:35.470+0000 7fa9ed7fa640 1 -- 172.21.15.89:0/900816268 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 v723) ==== 221+0+0 (crc 0 0 0) 0x7fa9f811e680 con 0x7fa9f809bd00 2024-09-16T17:05:35.472 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:35.471+0000 7fa9ed7fa640 1 -- 172.21.15.89:0/900816268 <== mon.0 v2:172.21.15.89:3300/0 8 ==== osd_map(723..723 src has 406..723) ==== 628+0+0 (crc 0 0 0) 0x7fa9f400cd90 con 0x7fa9f809bd00 2024-09-16T17:05:35.472 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:35.471+0000 7fa9ed7fa640 1 -- 172.21.15.89:0/900816268 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=724}) -- 0x7fa9e4045cb0 con 0x7fa9f809bd00 2024-09-16T17:05:35.589 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:35.588+0000 7fa9fef51640 1 -- 172.21.15.89:0/900816268 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_objects", "val": "0"} v 0) -- 0x7fa9f811e680 con 0x7fa9f809bd00 2024-09-16T17:05:36.473 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:36.471+0000 7fa9ed7fa640 1 -- 172.21.15.89:0/900816268 <== mon.0 v2:172.21.15.89:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 v724) ==== 221+0+0 (crc 0 0 0) 0x7fa9f811e680 con 0x7fa9f809bd00 2024-09-16T17:05:36.473 INFO:tasks.workunit.client.0.smithi089.stderr:set-quota max_objects = 0 for pool ad5c36b8-029a-4232-9d54-ea1601f1a3e9 2024-09-16T17:05:36.475 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:36.474+0000 7fa9fef51640 1 -- 172.21.15.89:0/900816268 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fa9e403e930 msgr2=0x7fa9e4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:36.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:36.474+0000 7fa9fef51640 1 --2- 172.21.15.89:0/900816268 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fa9e403e930 0x7fa9e4040e40 crc :-1 s=READY pgs=3872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:36.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:36.474+0000 7fa9fef51640 1 -- 172.21.15.89:0/900816268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9f809bd00 msgr2=0x7fa9f8131b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:05:36.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:36.474+0000 7fa9fef51640 1 --2- 172.21.15.89:0/900816268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9f809bd00 0x7fa9f8131b10 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:36.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:36.474+0000 7fa9fef51640 1 -- 172.21.15.89:0/900816268 shutdown_connections 2024-09-16T17:05:36.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:36.474+0000 7fa9fef51640 1 --2- 172.21.15.89:0/900816268 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fa9e403e930 0x7fa9e4040e40 unknown :-1 s=CLOSED pgs=3872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:36.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:36.474+0000 7fa9fef51640 1 --2- 172.21.15.89:0/900816268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9f809bd00 0x7fa9f8131b10 unknown :-1 s=CLOSED pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:05:36.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:36.474+0000 7fa9fef51640 1 -- 172.21.15.89:0/900816268 >> 172.21.15.89:0/900816268 conn(0x7fa9f80a26b0 msgr2=0x7fa9f8136520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:05:36.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:36.474+0000 7fa9fef51640 1 -- 172.21.15.89:0/900816268 shutdown_connections 2024-09-16T17:05:36.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:05:36.474+0000 7fa9fef51640 1 -- 172.21.15.89:0/900816268 wait complete. 2024-09-16T17:05:36.493 INFO:tasks.workunit.client.0.smithi089.stderr:+ sleep 30 2024-09-16T17:06:06.495 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph osd pool delete ad5c36b8-029a-4232-9d54-ea1601f1a3e9 ad5c36b8-029a-4232-9d54-ea1601f1a3e9 --yes-i-really-really-mean-it 2024-09-16T17:06:06.601 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.592+0000 7f240acc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:06.602 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.602+0000 7f240acc8640 1 Processor -- start 2024-09-16T17:06:06.603 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.602+0000 7f240acc8640 1 -- start start 2024-09-16T17:06:06.604 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.603+0000 7f240acc8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2404138880 0x7f240413aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:06.604 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.603+0000 7f240acc8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24040a2460 con 0x7f24040a2df0 2024-09-16T17:06:06.604 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.603+0000 7f240acc8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f24040a3d40 con 0x7f2404138880 2024-09-16T17:06:06.604 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.603+0000 7f2408a64640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f24040a2df0 0x7f24040a3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:46372/0 (socket says 172.21.15.89:46372) 2024-09-16T17:06:06.604 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.603+0000 7f2408a64640 1 -- 172.21.15.89:0/90545419 learned_addr learned my addr 172.21.15.89:0/90545419 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:06:06.604 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.603+0000 7f2403fff640 1 --2- 172.21.15.89:0/90545419 >> v2:172.21.15.89:3300/0 conn(0x7f2404138880 0x7f240413aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:06.606 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.603+0000 7f2403fff640 1 -- 172.21.15.89:0/90545419 >> v1:172.21.15.89:6789/0 conn(0x7f24040a2df0 legacy=0x7f24040a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:06.606 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.603+0000 7f2403fff640 1 -- 172.21.15.89:0/90545419 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24040a29a0 con 0x7f2404138880 2024-09-16T17:06:06.606 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.603+0000 7f2403fff640 1 --2- 172.21.15.89:0/90545419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2404138880 0x7f240413aca0 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8adfe23c357e7356 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:06.606 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.604+0000 7f24037fe640 1 -- 172.21.15.89:0/90545419 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f23f8009d90 con 0x7f2404138880 2024-09-16T17:06:06.606 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.604+0000 7f24037fe640 1 -- 172.21.15.89:0/90545419 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f23f800e230 con 0x7f2404138880 2024-09-16T17:06:06.606 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.604+0000 7f24037fe640 1 -- 172.21.15.89:0/90545419 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f23f800e4d0 con 0x7f2404138880 2024-09-16T17:06:06.606 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.604+0000 7f240acc8640 1 -- 172.21.15.89:0/90545419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2404138880 msgr2=0x7f240413aca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:06.606 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.604+0000 7f240acc8640 1 --2- 172.21.15.89:0/90545419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2404138880 0x7f240413aca0 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:06.606 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.604+0000 7f240acc8640 1 -- 172.21.15.89:0/90545419 shutdown_connections 2024-09-16T17:06:06.606 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.604+0000 7f240acc8640 1 --2- 172.21.15.89:0/90545419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2404138880 0x7f240413aca0 unknown :-1 s=CLOSED pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:06.607 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.604+0000 7f240acc8640 1 -- 172.21.15.89:0/90545419 >> 172.21.15.89:0/90545419 conn(0x7f24040a4ad0 msgr2=0x7f24040a4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:06.607 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.604+0000 7f240acc8640 1 -- 172.21.15.89:0/90545419 shutdown_connections 2024-09-16T17:06:06.607 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.605+0000 7f240acc8640 1 -- 172.21.15.89:0/90545419 wait complete. 2024-09-16T17:06:06.607 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.605+0000 7f240acc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:06.607 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.606+0000 7f240acc8640 1 Processor -- start 2024-09-16T17:06:06.607 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.606+0000 7f240acc8640 1 -- start start 2024-09-16T17:06:06.609 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.607+0000 7f240acc8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24040a2df0 0x7f24041c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:06.609 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.607+0000 7f240acc8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f240411fc40 con 0x7f24040a2df0 2024-09-16T17:06:06.609 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.607+0000 7f2408a64640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24040a2df0 0x7f24041c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:06.609 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.607+0000 7f2408a64640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24040a2df0 0x7f24041c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32908/0 (socket says 172.21.15.89:32908) 2024-09-16T17:06:06.609 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.607+0000 7f2408a64640 1 -- 172.21.15.89:0/4215826842 learned_addr learned my addr 172.21.15.89:0/4215826842 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:06.609 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.608+0000 7f2408a64640 1 -- 172.21.15.89:0/4215826842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240411ff00 con 0x7f24040a2df0 2024-09-16T17:06:06.610 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.608+0000 7f2408a64640 1 --2- 172.21.15.89:0/4215826842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24040a2df0 0x7f24041c9e50 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:06.610 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.608+0000 7f24017fa640 1 -- 172.21.15.89:0/4215826842 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f23f40070b0 con 0x7f24040a2df0 2024-09-16T17:06:06.610 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.608+0000 7f24017fa640 1 -- 172.21.15.89:0/4215826842 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f23f4007210 con 0x7f24040a2df0 2024-09-16T17:06:06.610 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.608+0000 7f24017fa640 1 -- 172.21.15.89:0/4215826842 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f23f40074b0 con 0x7f24040a2df0 2024-09-16T17:06:06.610 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.608+0000 7f240acc8640 1 -- 172.21.15.89:0/4215826842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24041216d0 con 0x7f24040a2df0 2024-09-16T17:06:06.610 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.608+0000 7f240acc8640 1 -- 172.21.15.89:0/4215826842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24040a6140 con 0x7f24040a2df0 2024-09-16T17:06:06.611 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.609+0000 7f240acc8640 1 -- 172.21.15.89:0/4215826842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2404121f80 con 0x7f24040a2df0 2024-09-16T17:06:06.611 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.609+0000 7f24017fa640 1 -- 172.21.15.89:0/4215826842 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f23f4007660 con 0x7f24040a2df0 2024-09-16T17:06:06.611 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.609+0000 7f24017fa640 1 --2- 172.21.15.89:0/4215826842 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f23f003e960 0x7f23f0040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:06.611 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.609+0000 7f24017fa640 1 -- 172.21.15.89:0/4215826842 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(724..724 src has 406..724) ==== 4207+0+0 (crc 0 0 0) 0x7f23f4050660 con 0x7f24040a2df0 2024-09-16T17:06:06.611 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.610+0000 7f24017fa640 1 -- 172.21.15.89:0/4215826842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=725}) -- 0x7f23f00453f0 con 0x7f24040a2df0 2024-09-16T17:06:06.611 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.610+0000 7f2403fff640 1 --2- 172.21.15.89:0/4215826842 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f23f003e960 0x7f23f0040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:06.612 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.610+0000 7f2403fff640 1 --2- 172.21.15.89:0/4215826842 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f23f003e960 0x7f23f0040e70 crc :-1 s=READY pgs=3873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:06.615 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.615+0000 7f24017fa640 1 -- 172.21.15.89:0/4215826842 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f23f400fae0 con 0x7f24040a2df0 2024-09-16T17:06:06.791 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:06.791+0000 7f240acc8640 1 -- 172.21.15.89:0/4215826842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "pool2": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "yes_i_really_really_mean_it": true} v 0) -- 0x7f240409c8a0 con 0x7f24040a2df0 2024-09-16T17:06:07.472 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.471+0000 7f24017fa640 1 -- 172.21.15.89:0/4215826842 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "pool2": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "yes_i_really_really_mean_it": true}]=0 pool 'ad5c36b8-029a-4232-9d54-ea1601f1a3e9' removed v725) ==== 248+0+0 (crc 0 0 0) 0x7f23f40090b0 con 0x7f24040a2df0 2024-09-16T17:06:07.475 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.474+0000 7f24017fa640 1 -- 172.21.15.89:0/4215826842 <== mon.0 v2:172.21.15.89:3300/0 8 ==== osd_map(725..725 src has 406..725) ==== 296+0+0 (crc 0 0 0) 0x7f23f4009450 con 0x7f24040a2df0 2024-09-16T17:06:07.475 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.474+0000 7f24017fa640 1 -- 172.21.15.89:0/4215826842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=726}) -- 0x7f23f00460a0 con 0x7f24040a2df0 2024-09-16T17:06:07.606 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.605+0000 7f240acc8640 1 -- 172.21.15.89:0/4215826842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "pool2": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2404122440 con 0x7f24040a2df0 2024-09-16T17:06:07.606 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.605+0000 7f24017fa640 1 -- 172.21.15.89:0/4215826842 <== mon.0 v2:172.21.15.89:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "pool2": "ad5c36b8-029a-4232-9d54-ea1601f1a3e9", "yes_i_really_really_mean_it": true}]=0 pool 'ad5c36b8-029a-4232-9d54-ea1601f1a3e9' does not exist v725) ==== 255+0+0 (crc 0 0 0) 0x7f23f4009290 con 0x7f24040a2df0 2024-09-16T17:06:07.606 INFO:tasks.workunit.client.0.smithi089.stderr:pool 'ad5c36b8-029a-4232-9d54-ea1601f1a3e9' does not exist 2024-09-16T17:06:07.610 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.608+0000 7f240acc8640 1 -- 172.21.15.89:0/4215826842 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f23f003e960 msgr2=0x7f23f0040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:07.610 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.608+0000 7f240acc8640 1 --2- 172.21.15.89:0/4215826842 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f23f003e960 0x7f23f0040e70 crc :-1 s=READY pgs=3873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:07.610 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.608+0000 7f240acc8640 1 -- 172.21.15.89:0/4215826842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24040a2df0 msgr2=0x7f24041c9e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:07.610 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.608+0000 7f240acc8640 1 --2- 172.21.15.89:0/4215826842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24040a2df0 0x7f24041c9e50 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:07.610 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.608+0000 7f240acc8640 1 -- 172.21.15.89:0/4215826842 shutdown_connections 2024-09-16T17:06:07.610 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.608+0000 7f240acc8640 1 --2- 172.21.15.89:0/4215826842 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f23f003e960 0x7f23f0040e70 unknown :-1 s=CLOSED pgs=3873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:07.610 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.609+0000 7f240acc8640 1 --2- 172.21.15.89:0/4215826842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24040a2df0 0x7f24041c9e50 unknown :-1 s=CLOSED pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:07.610 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.609+0000 7f240acc8640 1 -- 172.21.15.89:0/4215826842 >> 172.21.15.89:0/4215826842 conn(0x7f24040a4ad0 msgr2=0x7f2404135420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:07.610 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.609+0000 7f240acc8640 1 -- 172.21.15.89:0/4215826842 shutdown_connections 2024-09-16T17:06:07.610 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.609+0000 7f240acc8640 1 -- 172.21.15.89:0/4215826842 wait complete. 2024-09-16T17:06:07.626 INFO:tasks.workunit.client.0.smithi089.stderr:+ ceph osd pool delete 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 07ad86ee-368a-4990-9f3d-cf7d02f63ba0 --yes-i-really-really-mean-it 2024-09-16T17:06:07.729 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.718+0000 7f4397f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:07.729 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.729+0000 7f4397f11640 1 Processor -- start 2024-09-16T17:06:07.729 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.729+0000 7f4397f11640 1 -- start start 2024-09-16T17:06:07.731 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.730+0000 7f4397f11640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4390138880 0x7f439013aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:07.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.730+0000 7f4397f11640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43900a2460 con 0x7f43900a2df0 2024-09-16T17:06:07.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.730+0000 7f4397f11640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f43900a3d40 con 0x7f4390138880 2024-09-16T17:06:07.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.730+0000 7f43954ac640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4390138880 0x7f439013aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:07.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.730+0000 7f4395cad640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f43900a2df0 0x7f43900a3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:46386/0 (socket says 172.21.15.89:46386) 2024-09-16T17:06:07.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.730+0000 7f43954ac640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4390138880 0x7f439013aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32914/0 (socket says 172.21.15.89:32914) 2024-09-16T17:06:07.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.730+0000 7f43954ac640 1 -- 172.21.15.89:0/410326232 learned_addr learned my addr 172.21.15.89:0/410326232 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:07.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.730+0000 7f43954ac640 1 -- 172.21.15.89:0/410326232 >> v1:172.21.15.89:6789/0 conn(0x7f43900a2df0 legacy=0x7f43900a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:07.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.730+0000 7f4394cab640 1 -- 172.21.15.89:0/410326232 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 947579585 0 0) 0x7f43900a2460 con 0x7f43900a2df0 2024-09-16T17:06:07.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.730+0000 7f43954ac640 1 -- 172.21.15.89:0/410326232 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43900a29a0 con 0x7f4390138880 2024-09-16T17:06:07.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.730+0000 7f43954ac640 1 --2- 172.21.15.89:0/410326232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4390138880 0x7f439013aca0 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71335a4100091626 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:07.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.731+0000 7f4394cab640 1 -- 172.21.15.89:0/410326232 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4380009e50 con 0x7f4390138880 2024-09-16T17:06:07.732 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.731+0000 7f4394cab640 1 -- 172.21.15.89:0/410326232 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f438000e230 con 0x7f4390138880 2024-09-16T17:06:07.733 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.731+0000 7f4394cab640 1 -- 172.21.15.89:0/410326232 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f438000e4d0 con 0x7f4390138880 2024-09-16T17:06:07.733 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.731+0000 7f4397f11640 1 -- 172.21.15.89:0/410326232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4390138880 msgr2=0x7f439013aca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:07.733 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.731+0000 7f4397f11640 1 --2- 172.21.15.89:0/410326232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4390138880 0x7f439013aca0 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:07.734 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.732+0000 7f4397f11640 1 -- 172.21.15.89:0/410326232 shutdown_connections 2024-09-16T17:06:07.734 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.732+0000 7f4397f11640 1 --2- 172.21.15.89:0/410326232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4390138880 0x7f439013aca0 unknown :-1 s=CLOSED pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:07.734 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.732+0000 7f4397f11640 1 -- 172.21.15.89:0/410326232 >> 172.21.15.89:0/410326232 conn(0x7f43900a4ad0 msgr2=0x7f43900a4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:07.734 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.732+0000 7f4397f11640 1 -- 172.21.15.89:0/410326232 shutdown_connections 2024-09-16T17:06:07.734 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.732+0000 7f4397f11640 1 -- 172.21.15.89:0/410326232 wait complete. 2024-09-16T17:06:07.734 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.732+0000 7f4397f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:07.734 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.733+0000 7f4397f11640 1 Processor -- start 2024-09-16T17:06:07.734 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.733+0000 7f4397f11640 1 -- start start 2024-09-16T17:06:07.736 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.734+0000 7f4397f11640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43900a2df0 0x7f43901205c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:07.736 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.734+0000 7f4397f11640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4390121f50 con 0x7f43900a2df0 2024-09-16T17:06:07.736 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.734+0000 7f4395cad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43900a2df0 0x7f43901205c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:07.736 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.734+0000 7f4395cad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43900a2df0 0x7f43901205c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32924/0 (socket says 172.21.15.89:32924) 2024-09-16T17:06:07.736 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.734+0000 7f4395cad640 1 -- 172.21.15.89:0/2136424869 learned_addr learned my addr 172.21.15.89:0/2136424869 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:07.736 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.735+0000 7f4395cad640 1 -- 172.21.15.89:0/2136424869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4390120070 con 0x7f43900a2df0 2024-09-16T17:06:07.736 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.735+0000 7f4395cad640 1 --2- 172.21.15.89:0/2136424869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43900a2df0 0x7f43901205c0 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:07.736 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.735+0000 7f43867fc640 1 -- 172.21.15.89:0/2136424869 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f438c004b80 con 0x7f43900a2df0 2024-09-16T17:06:07.737 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.735+0000 7f43867fc640 1 -- 172.21.15.89:0/2136424869 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f438c004ce0 con 0x7f43900a2df0 2024-09-16T17:06:07.737 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.735+0000 7f4397f11640 1 -- 172.21.15.89:0/2136424869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43900a5dd0 con 0x7f43900a2df0 2024-09-16T17:06:07.737 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.735+0000 7f43867fc640 1 -- 172.21.15.89:0/2136424869 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f438c007120 con 0x7f43900a2df0 2024-09-16T17:06:07.737 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.735+0000 7f4397f11640 1 -- 172.21.15.89:0/2136424869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f439011fcd0 con 0x7f43900a2df0 2024-09-16T17:06:07.738 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.736+0000 7f4397f11640 1 -- 172.21.15.89:0/2136424869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f439009c8a0 con 0x7f43900a2df0 2024-09-16T17:06:07.738 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.736+0000 7f43867fc640 1 -- 172.21.15.89:0/2136424869 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f438c0072d0 con 0x7f43900a2df0 2024-09-16T17:06:07.738 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.736+0000 7f43867fc640 1 --2- 172.21.15.89:0/2136424869 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f437403e960 0x7f4374040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:07.738 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.736+0000 7f43867fc640 1 -- 172.21.15.89:0/2136424869 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(725..725 src has 406..725) ==== 3819+0+0 (crc 0 0 0) 0x7f438c04fc20 con 0x7f43900a2df0 2024-09-16T17:06:07.738 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.736+0000 7f43867fc640 1 -- 172.21.15.89:0/2136424869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=726}) -- 0x7f4374044c50 con 0x7f43900a2df0 2024-09-16T17:06:07.738 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.737+0000 7f43954ac640 1 --2- 172.21.15.89:0/2136424869 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f437403e960 0x7f4374040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:07.738 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.737+0000 7f43954ac640 1 --2- 172.21.15.89:0/2136424869 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f437403e960 0x7f4374040e70 crc :-1 s=READY pgs=3874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:07.742 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.741+0000 7f43867fc640 1 -- 172.21.15.89:0/2136424869 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f438c00f420 con 0x7f43900a2df0 2024-09-16T17:06:07.919 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:07.918+0000 7f4397f11640 1 -- 172.21.15.89:0/2136424869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "pool2": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "yes_i_really_really_mean_it": true} v 0) -- 0x7f43900698c0 con 0x7f43900a2df0 2024-09-16T17:06:08.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:08.475+0000 7f43867fc640 1 -- 172.21.15.89:0/2136424869 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "pool2": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "yes_i_really_really_mean_it": true}]=0 pool '07ad86ee-368a-4990-9f3d-cf7d02f63ba0' removed v726) ==== 248+0+0 (crc 0 0 0) 0x7f438c00a0c0 con 0x7f43900a2df0 2024-09-16T17:06:08.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:08.475+0000 7f43867fc640 1 -- 172.21.15.89:0/2136424869 <== mon.0 v2:172.21.15.89:3300/0 8 ==== osd_map(726..726 src has 406..726) ==== 296+0+0 (crc 0 0 0) 0x7f438c021e70 con 0x7f43900a2df0 2024-09-16T17:06:08.476 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:08.475+0000 7f43867fc640 1 -- 172.21.15.89:0/2136424869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=727}) -- 0x7f4374045930 con 0x7f43900a2df0 2024-09-16T17:06:08.637 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:08.636+0000 7f4397f11640 1 -- 172.21.15.89:0/2136424869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "pool2": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4390122eb0 con 0x7f43900a2df0 2024-09-16T17:06:08.637 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:08.636+0000 7f43867fc640 1 -- 172.21.15.89:0/2136424869 <== mon.0 v2:172.21.15.89:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "pool2": "07ad86ee-368a-4990-9f3d-cf7d02f63ba0", "yes_i_really_really_mean_it": true}]=0 pool '07ad86ee-368a-4990-9f3d-cf7d02f63ba0' does not exist v726) ==== 255+0+0 (crc 0 0 0) 0x7f438c00a7b0 con 0x7f43900a2df0 2024-09-16T17:06:08.637 INFO:tasks.workunit.client.0.smithi089.stderr:pool '07ad86ee-368a-4990-9f3d-cf7d02f63ba0' does not exist 2024-09-16T17:06:08.640 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:08.639+0000 7f4397f11640 1 -- 172.21.15.89:0/2136424869 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f437403e960 msgr2=0x7f4374040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:08.640 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:08.639+0000 7f4397f11640 1 --2- 172.21.15.89:0/2136424869 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f437403e960 0x7f4374040e70 crc :-1 s=READY pgs=3874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:08.640 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:08.639+0000 7f4397f11640 1 -- 172.21.15.89:0/2136424869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43900a2df0 msgr2=0x7f43901205c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:08.640 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:08.639+0000 7f4397f11640 1 --2- 172.21.15.89:0/2136424869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43900a2df0 0x7f43901205c0 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:08.640 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:08.639+0000 7f4397f11640 1 -- 172.21.15.89:0/2136424869 shutdown_connections 2024-09-16T17:06:08.640 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:08.639+0000 7f4397f11640 1 --2- 172.21.15.89:0/2136424869 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f437403e960 0x7f4374040e70 unknown :-1 s=CLOSED pgs=3874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:08.640 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:08.639+0000 7f4397f11640 1 --2- 172.21.15.89:0/2136424869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43900a2df0 0x7f43901205c0 unknown :-1 s=CLOSED pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:08.641 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:08.639+0000 7f4397f11640 1 -- 172.21.15.89:0/2136424869 >> 172.21.15.89:0/2136424869 conn(0x7f43900a4ad0 msgr2=0x7f4390135420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:08.641 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:08.639+0000 7f4397f11640 1 -- 172.21.15.89:0/2136424869 shutdown_connections 2024-09-16T17:06:08.641 INFO:tasks.workunit.client.0.smithi089.stderr:2024-09-16T17:06:08.639+0000 7f4397f11640 1 -- 172.21.15.89:0/2136424869 wait complete. 2024-09-16T17:06:08.651 INFO:tasks.workunit.client.0.smithi089.stderr:+ echo OK 2024-09-16T17:06:08.652 INFO:tasks.workunit.client.0.smithi089.stdout:OK 2024-09-16T17:06:08.652 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T17:06:08.653 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T17:06:08.680 INFO:tasks.workunit:Stopping ['rados/test.sh --crimson', 'rados/test_pool_quota.sh'] on client.0... 2024-09-16T17:06:08.681 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T17:06:08.998 DEBUG:teuthology.parallel:result is None 2024-09-16T17:06:08.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T17:06:09.023 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T17:06:09.023 DEBUG:teuthology.orchestra.run.smithi089:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T17:06:09.179 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T17:06:09.179 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T17:06:09.188 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T17:06:09.189 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:06:09.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.298+0000 7fe900f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:09.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.302+0000 7fe900f11640 1 Processor -- start 2024-09-16T17:06:09.303 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.302+0000 7fe900f11640 1 -- start start 2024-09-16T17:06:09.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.304+0000 7fe900f11640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe8fc09d010 0x7fe8fc09d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:09.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.304+0000 7fe900f11640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8fc0a02a0 con 0x7fe8fc132170 2024-09-16T17:06:09.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.304+0000 7fe900f11640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7fe8fc09c550 con 0x7fe8fc09d010 2024-09-16T17:06:09.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.304+0000 7fe8fa59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe8fc09d010 0x7fe8fc09d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:09.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.304+0000 7fe8fa59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe8fc09d010 0x7fe8fc09d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37776/0 (socket says 172.21.15.89:37776) 2024-09-16T17:06:09.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.304+0000 7fe8fa59c640 1 -- 172.21.15.89:0/3064383870 learned_addr learned my addr 172.21.15.89:0/3064383870 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:09.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.304+0000 7fe8f9d9b640 1 --1- 172.21.15.89:0/3064383870 >> v1:172.21.15.89:6789/0 conn(0x7fe8fc132170 0x7fe8fc132580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:45770/0 (socket says 172.21.15.89:45770) 2024-09-16T17:06:09.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.304+0000 7fe8fa59c640 1 -- 172.21.15.89:0/3064383870 >> v1:172.21.15.89:6789/0 conn(0x7fe8fc132170 legacy=0x7fe8fc132580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:09.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.304+0000 7fe8fa59c640 1 -- 172.21.15.89:0/3064383870 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8fc09cac0 con 0x7fe8fc09d010 2024-09-16T17:06:09.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.304+0000 7fe8f959a640 1 -- 172.21.15.89:0/3064383870 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1611149944 0 0) 0x7fe8fc0a02a0 con 0x7fe8fc132170 2024-09-16T17:06:09.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.304+0000 7fe8fa59c640 1 --2- 172.21.15.89:0/3064383870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8fc09d010 0x7fe8fc09d420 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422cfcbd2657101c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:09.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.304+0000 7fe8f959a640 1 -- 172.21.15.89:0/3064383870 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe8ec00e040 con 0x7fe8fc09d010 2024-09-16T17:06:09.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.304+0000 7fe8f959a640 1 -- 172.21.15.89:0/3064383870 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe8ec0091e0 con 0x7fe8fc09d010 2024-09-16T17:06:09.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.304+0000 7fe8f959a640 1 -- 172.21.15.89:0/3064383870 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe8ec007730 con 0x7fe8fc09d010 2024-09-16T17:06:09.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.305+0000 7fe900f11640 1 -- 172.21.15.89:0/3064383870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8fc09d010 msgr2=0x7fe8fc09d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:09.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.305+0000 7fe900f11640 1 --2- 172.21.15.89:0/3064383870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8fc09d010 0x7fe8fc09d420 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:09.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.305+0000 7fe900f11640 1 -- 172.21.15.89:0/3064383870 shutdown_connections 2024-09-16T17:06:09.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.305+0000 7fe900f11640 1 --2- 172.21.15.89:0/3064383870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8fc09d010 0x7fe8fc09d420 unknown :-1 s=CLOSED pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:09.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.305+0000 7fe900f11640 1 -- 172.21.15.89:0/3064383870 >> 172.21.15.89:0/3064383870 conn(0x7fe8fc0a0de0 msgr2=0x7fe8fc0a11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:09.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.305+0000 7fe900f11640 1 -- 172.21.15.89:0/3064383870 shutdown_connections 2024-09-16T17:06:09.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.305+0000 7fe900f11640 1 -- 172.21.15.89:0/3064383870 wait complete. 2024-09-16T17:06:09.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.306+0000 7fe900f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:09.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.307+0000 7fe900f11640 1 Processor -- start 2024-09-16T17:06:09.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.307+0000 7fe900f11640 1 -- start start 2024-09-16T17:06:09.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.308+0000 7fe900f11640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8fc09d010 0x7fe8fc09b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:09.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.308+0000 7fe900f11640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc08e9f0 con 0x7fe8fc09d010 2024-09-16T17:06:09.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.308+0000 7fe8fa59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8fc09d010 0x7fe8fc09b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:09.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.308+0000 7fe8fa59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8fc09d010 0x7fe8fc09b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37790/0 (socket says 172.21.15.89:37790) 2024-09-16T17:06:09.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.308+0000 7fe8fa59c640 1 -- 172.21.15.89:0/3422462895 learned_addr learned my addr 172.21.15.89:0/3422462895 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:09.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.309+0000 7fe8fa59c640 1 -- 172.21.15.89:0/3422462895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8fc09dce0 con 0x7fe8fc09d010 2024-09-16T17:06:09.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.309+0000 7fe8fa59c640 1 --2- 172.21.15.89:0/3422462895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8fc09d010 0x7fe8fc09b440 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:09.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.309+0000 7fe8f2ffd640 1 -- 172.21.15.89:0/3422462895 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe8ec00e040 con 0x7fe8fc09d010 2024-09-16T17:06:09.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.309+0000 7fe8f2ffd640 1 -- 172.21.15.89:0/3422462895 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe8ec013790 con 0x7fe8fc09d010 2024-09-16T17:06:09.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.309+0000 7fe900f11640 1 -- 172.21.15.89:0/3422462895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8fc073e30 con 0x7fe8fc09d010 2024-09-16T17:06:09.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.309+0000 7fe8f2ffd640 1 -- 172.21.15.89:0/3422462895 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe8ec013a30 con 0x7fe8fc09d010 2024-09-16T17:06:09.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.309+0000 7fe900f11640 1 -- 172.21.15.89:0/3422462895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8fc08f4b0 con 0x7fe8fc09d010 2024-09-16T17:06:09.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.310+0000 7fe8f2ffd640 1 -- 172.21.15.89:0/3422462895 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe8ec013c30 con 0x7fe8fc09d010 2024-09-16T17:06:09.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.310+0000 7fe8f2ffd640 1 --2- 172.21.15.89:0/3422462895 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe8dc03e8e0 0x7fe8dc040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:09.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.310+0000 7fe900f11640 1 -- 172.21.15.89:0/3422462895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8fc070400 con 0x7fe8fc09d010 2024-09-16T17:06:09.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.310+0000 7fe8f2ffd640 1 -- 172.21.15.89:0/3422462895 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(726..726 src has 406..726) ==== 3431+0+0 (crc 0 0 0) 0x7fe8ec0510b0 con 0x7fe8fc09d010 2024-09-16T17:06:09.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.310+0000 7fe8f9d9b640 1 --2- 172.21.15.89:0/3422462895 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe8dc03e8e0 0x7fe8dc040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:09.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.311+0000 7fe8f9d9b640 1 --2- 172.21.15.89:0/3422462895 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe8dc03e8e0 0x7fe8dc040df0 crc :-1 s=READY pgs=3875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:09.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.315+0000 7fe8f2ffd640 1 -- 172.21.15.89:0/3422462895 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fe8ec014770 con 0x7fe8fc09d010 2024-09-16T17:06:09.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.489+0000 7fe900f11640 1 -- 172.21.15.89:0/3422462895 --> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe8fc133070 con 0x7fe8dc03e8e0 2024-09-16T17:06:09.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.491+0000 7fe8f2ffd640 1 -- 172.21.15.89:0/3422462895 <== mgr.4099 v2:172.21.15.177:6800/1212166405 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109430 (crc 0 0 0) 0x7fe8e40012b0 con 0x7fe8dc03e8e0 2024-09-16T17:06:09.493 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T17:06:09.494 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-16T17:06:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.494+0000 7fe900f11640 1 -- 172.21.15.89:0/3422462895 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe8dc03e8e0 msgr2=0x7fe8dc040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.494+0000 7fe900f11640 1 --2- 172.21.15.89:0/3422462895 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe8dc03e8e0 0x7fe8dc040df0 crc :-1 s=READY pgs=3875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.494+0000 7fe900f11640 1 -- 172.21.15.89:0/3422462895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8fc09d010 msgr2=0x7fe8fc09b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.494+0000 7fe900f11640 1 --2- 172.21.15.89:0/3422462895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8fc09d010 0x7fe8fc09b440 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.494+0000 7fe900f11640 1 -- 172.21.15.89:0/3422462895 shutdown_connections 2024-09-16T17:06:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.494+0000 7fe900f11640 1 --2- 172.21.15.89:0/3422462895 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe8dc03e8e0 0x7fe8dc040df0 unknown :-1 s=CLOSED pgs=3875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.494+0000 7fe900f11640 1 --2- 172.21.15.89:0/3422462895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8fc09d010 0x7fe8fc09b440 unknown :-1 s=CLOSED pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.494+0000 7fe900f11640 1 -- 172.21.15.89:0/3422462895 >> 172.21.15.89:0/3422462895 conn(0x7fe8fc0a0de0 msgr2=0x7fe8fc0a2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:09.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.494+0000 7fe900f11640 1 -- 172.21.15.89:0/3422462895 shutdown_connections 2024-09-16T17:06:09.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.494+0000 7fe900f11640 1 -- 172.21.15.89:0/3422462895 wait complete. 2024-09-16T17:06:09.506 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":1301,"stamp":"2024-09-16T17:06:09.410914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":29928,"kb_used_data":29928,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209160984,"statfs":{"total":214211493888,"available":214180847616,"internally_reserved":0,"allocated":30646272,"data_stored":30646272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001819"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.513597+0000","last_change":"2024-09-16T16:52:01.023066+0000","last_active":"2024-09-16T17:05:36.513597+0000","last_peered":"2024-09-16T17:05:36.513597+0000","last_clean":"2024-09-16T17:05:36.513597+0000","last_became_active":"2024-09-16T16:52:01.016850+0000","last_became_peered":"2024-09-16T16:52:01.016850+0000","last_unstale":"2024-09-16T17:05:36.513597+0000","last_undegraded":"2024-09-16T17:05:36.513597+0000","last_fullsized":"2024-09-16T17:05:36.513597+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.519063+0000","last_change":"2024-09-16T16:52:01.097555+0000","last_active":"2024-09-16T17:05:36.519063+0000","last_peered":"2024-09-16T17:05:36.519063+0000","last_clean":"2024-09-16T17:05:36.519063+0000","last_became_active":"2024-09-16T16:52:01.048635+0000","last_became_peered":"2024-09-16T16:52:01.048635+0000","last_unstale":"2024-09-16T17:05:36.519063+0000","last_undegraded":"2024-09-16T17:05:36.519063+0000","last_fullsized":"2024-09-16T17:05:36.519063+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.513689+0000","last_change":"2024-09-16T16:52:01.083490+0000","last_active":"2024-09-16T17:05:36.513689+0000","last_peered":"2024-09-16T17:05:36.513689+0000","last_clean":"2024-09-16T17:05:36.513689+0000","last_became_active":"2024-09-16T16:52:01.077074+0000","last_became_peered":"2024-09-16T16:52:01.077074+0000","last_unstale":"2024-09-16T17:05:36.513689+0000","last_undegraded":"2024-09-16T17:05:36.513689+0000","last_fullsized":"2024-09-16T17:05:36.513689+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.510812+0000","last_change":"2024-09-16T16:52:01.007501+0000","last_active":"2024-09-16T17:05:36.510812+0000","last_peered":"2024-09-16T17:05:36.510812+0000","last_clean":"2024-09-16T17:05:36.510812+0000","last_became_active":"2024-09-16T16:52:00.995826+0000","last_became_peered":"2024-09-16T16:52:00.995826+0000","last_unstale":"2024-09-16T17:05:36.510812+0000","last_undegraded":"2024-09-16T17:05:36.510812+0000","last_fullsized":"2024-09-16T17:05:36.510812+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.517971+0000","last_change":"2024-09-16T16:52:01.075449+0000","last_active":"2024-09-16T17:05:36.517971+0000","last_peered":"2024-09-16T17:05:36.517971+0000","last_clean":"2024-09-16T17:05:36.517971+0000","last_became_active":"2024-09-16T16:52:01.066170+0000","last_became_peered":"2024-09-16T16:52:01.066170+0000","last_unstale":"2024-09-16T17:05:36.517971+0000","last_undegraded":"2024-09-16T17:05:36.517971+0000","last_fullsized":"2024-09-16T17:05:36.517971+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.506231+0000","last_change":"2024-09-16T16:52:01.164718+0000","last_active":"2024-09-16T17:05:36.506231+0000","last_peered":"2024-09-16T17:05:36.506231+0000","last_clean":"2024-09-16T17:05:36.506231+0000","last_became_active":"2024-09-16T16:52:01.137358+0000","last_became_peered":"2024-09-16T16:52:01.137358+0000","last_unstale":"2024-09-16T17:05:36.506231+0000","last_undegraded":"2024-09-16T17:05:36.506231+0000","last_fullsized":"2024-09-16T17:05:36.506231+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.510218+0000","last_change":"2024-09-16T16:52:01.039514+0000","last_active":"2024-09-16T17:05:36.510218+0000","last_peered":"2024-09-16T17:05:36.510218+0000","last_clean":"2024-09-16T17:05:36.510218+0000","last_became_active":"2024-09-16T16:52:01.018449+0000","last_became_peered":"2024-09-16T16:52:01.018449+0000","last_unstale":"2024-09-16T17:05:36.510218+0000","last_undegraded":"2024-09-16T17:05:36.510218+0000","last_fullsized":"2024-09-16T17:05:36.510218+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.512348+0000","last_change":"2024-09-16T16:52:01.089282+0000","last_active":"2024-09-16T17:05:36.512348+0000","last_peered":"2024-09-16T17:05:36.512348+0000","last_clean":"2024-09-16T17:05:36.512348+0000","last_became_active":"2024-09-16T16:52:01.043446+0000","last_became_peered":"2024-09-16T16:52:01.043446+0000","last_unstale":"2024-09-16T17:05:36.512348+0000","last_undegraded":"2024-09-16T17:05:36.512348+0000","last_fullsized":"2024-09-16T17:05:36.512348+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.507845+0000","last_change":"2024-09-16T16:52:01.002820+0000","last_active":"2024-09-16T17:05:36.507845+0000","last_peered":"2024-09-16T17:05:36.507845+0000","last_clean":"2024-09-16T17:05:36.507845+0000","last_became_active":"2024-09-16T16:52:00.984993+0000","last_became_peered":"2024-09-16T16:52:00.984993+0000","last_unstale":"2024-09-16T17:05:36.507845+0000","last_undegraded":"2024-09-16T17:05:36.507845+0000","last_fullsized":"2024-09-16T17:05:36.507845+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.510725+0000","last_change":"2024-09-16T16:52:01.125926+0000","last_active":"2024-09-16T17:05:36.510725+0000","last_peered":"2024-09-16T17:05:36.510725+0000","last_clean":"2024-09-16T17:05:36.510725+0000","last_became_active":"2024-09-16T16:52:01.118033+0000","last_became_peered":"2024-09-16T16:52:01.118033+0000","last_unstale":"2024-09-16T17:05:36.510725+0000","last_undegraded":"2024-09-16T17:05:36.510725+0000","last_fullsized":"2024-09-16T17:05:36.510725+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.507372+0000","last_change":"2024-09-16T16:52:01.047718+0000","last_active":"2024-09-16T17:05:36.507372+0000","last_peered":"2024-09-16T17:05:36.507372+0000","last_clean":"2024-09-16T17:05:36.507372+0000","last_became_active":"2024-09-16T16:52:01.018199+0000","last_became_peered":"2024-09-16T16:52:01.018199+0000","last_unstale":"2024-09-16T17:05:36.507372+0000","last_undegraded":"2024-09-16T17:05:36.507372+0000","last_fullsized":"2024-09-16T17:05:36.507372+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.508775+0000","last_change":"2024-09-16T16:52:01.126951+0000","last_active":"2024-09-16T17:05:36.508775+0000","last_peered":"2024-09-16T17:05:36.508775+0000","last_clean":"2024-09-16T17:05:36.508775+0000","last_became_active":"2024-09-16T16:52:01.098860+0000","last_became_peered":"2024-09-16T16:52:01.098860+0000","last_unstale":"2024-09-16T17:05:36.508775+0000","last_undegraded":"2024-09-16T17:05:36.508775+0000","last_fullsized":"2024-09-16T17:05:36.508775+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.519261+0000","last_change":"2024-09-16T16:52:01.038538+0000","last_active":"2024-09-16T17:05:36.519261+0000","last_peered":"2024-09-16T17:05:36.519261+0000","last_clean":"2024-09-16T17:05:36.519261+0000","last_became_active":"2024-09-16T16:52:01.014800+0000","last_became_peered":"2024-09-16T16:52:01.014800+0000","last_unstale":"2024-09-16T17:05:36.519261+0000","last_undegraded":"2024-09-16T17:05:36.519261+0000","last_fullsized":"2024-09-16T17:05:36.519261+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.518720+0000","last_change":"2024-09-16T16:52:01.079983+0000","last_active":"2024-09-16T17:05:36.518720+0000","last_peered":"2024-09-16T17:05:36.518720+0000","last_clean":"2024-09-16T17:05:36.518720+0000","last_became_active":"2024-09-16T16:52:01.070554+0000","last_became_peered":"2024-09-16T16:52:01.070554+0000","last_unstale":"2024-09-16T17:05:36.518720+0000","last_undegraded":"2024-09-16T17:05:36.518720+0000","last_fullsized":"2024-09-16T17:05:36.518720+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.506105+0000","last_change":"2024-09-16T16:52:01.171432+0000","last_active":"2024-09-16T17:05:36.506105+0000","last_peered":"2024-09-16T17:05:36.506105+0000","last_clean":"2024-09-16T17:05:36.506105+0000","last_became_active":"2024-09-16T16:52:01.163260+0000","last_became_peered":"2024-09-16T16:52:01.163260+0000","last_unstale":"2024-09-16T17:05:36.506105+0000","last_undegraded":"2024-09-16T17:05:36.506105+0000","last_fullsized":"2024-09-16T17:05:36.506105+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.505722+0000","last_change":"2024-09-16T16:52:01.089266+0000","last_active":"2024-09-16T17:05:36.505722+0000","last_peered":"2024-09-16T17:05:36.505722+0000","last_clean":"2024-09-16T17:05:36.505722+0000","last_became_active":"2024-09-16T16:52:01.039791+0000","last_became_peered":"2024-09-16T16:52:01.039791+0000","last_unstale":"2024-09-16T17:05:36.505722+0000","last_undegraded":"2024-09-16T17:05:36.505722+0000","last_fullsized":"2024-09-16T17:05:36.505722+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.506637+0000","last_change":"2024-09-16T16:52:01.101751+0000","last_active":"2024-09-16T17:05:36.506637+0000","last_peered":"2024-09-16T17:05:36.506637+0000","last_clean":"2024-09-16T17:05:36.506637+0000","last_became_active":"2024-09-16T16:52:01.063909+0000","last_became_peered":"2024-09-16T16:52:01.063909+0000","last_unstale":"2024-09-16T17:05:36.506637+0000","last_undegraded":"2024-09-16T17:05:36.506637+0000","last_fullsized":"2024-09-16T17:05:36.506637+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.506783+0000","last_change":"2024-09-16T16:52:01.160111+0000","last_active":"2024-09-16T17:05:36.506783+0000","last_peered":"2024-09-16T17:05:36.506783+0000","last_clean":"2024-09-16T17:05:36.506783+0000","last_became_active":"2024-09-16T16:52:01.138167+0000","last_became_peered":"2024-09-16T16:52:01.138167+0000","last_unstale":"2024-09-16T17:05:36.506783+0000","last_undegraded":"2024-09-16T17:05:36.506783+0000","last_fullsized":"2024-09-16T17:05:36.506783+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.514011+0000","last_change":"2024-09-16T16:52:01.037689+0000","last_active":"2024-09-16T17:05:36.514011+0000","last_peered":"2024-09-16T17:05:36.514011+0000","last_clean":"2024-09-16T17:05:36.514011+0000","last_became_active":"2024-09-16T16:52:01.016490+0000","last_became_peered":"2024-09-16T16:52:01.016490+0000","last_unstale":"2024-09-16T17:05:36.514011+0000","last_undegraded":"2024-09-16T17:05:36.514011+0000","last_fullsized":"2024-09-16T17:05:36.514011+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.509057+0000","last_change":"2024-09-16T16:52:01.009029+0000","last_active":"2024-09-16T17:05:36.509057+0000","last_peered":"2024-09-16T17:05:36.509057+0000","last_clean":"2024-09-16T17:05:36.509057+0000","last_became_active":"2024-09-16T16:52:00.998521+0000","last_became_peered":"2024-09-16T16:52:00.998521+0000","last_unstale":"2024-09-16T17:05:36.509057+0000","last_undegraded":"2024-09-16T17:05:36.509057+0000","last_fullsized":"2024-09-16T17:05:36.509057+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.512621+0000","last_change":"2024-09-16T16:52:01.083905+0000","last_active":"2024-09-16T17:05:36.512621+0000","last_peered":"2024-09-16T17:05:36.512621+0000","last_clean":"2024-09-16T17:05:36.512621+0000","last_became_active":"2024-09-16T16:52:01.040747+0000","last_became_peered":"2024-09-16T16:52:01.040747+0000","last_unstale":"2024-09-16T17:05:36.512621+0000","last_undegraded":"2024-09-16T17:05:36.512621+0000","last_fullsized":"2024-09-16T17:05:36.512621+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.503679+0000","last_change":"2024-09-16T16:52:01.041092+0000","last_active":"2024-09-16T17:05:36.503679+0000","last_peered":"2024-09-16T17:05:36.503679+0000","last_clean":"2024-09-16T17:05:36.503679+0000","last_became_active":"2024-09-16T16:52:01.017647+0000","last_became_peered":"2024-09-16T16:52:01.017647+0000","last_unstale":"2024-09-16T17:05:36.503679+0000","last_undegraded":"2024-09-16T17:05:36.503679+0000","last_fullsized":"2024-09-16T17:05:36.503679+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.515505+0000","last_change":"2024-09-16T16:52:01.105516+0000","last_active":"2024-09-16T17:05:36.515505+0000","last_peered":"2024-09-16T17:05:36.515505+0000","last_clean":"2024-09-16T17:05:36.515505+0000","last_became_active":"2024-09-16T16:52:01.096609+0000","last_became_peered":"2024-09-16T16:52:01.096609+0000","last_unstale":"2024-09-16T17:05:36.515505+0000","last_undegraded":"2024-09-16T17:05:36.515505+0000","last_fullsized":"2024-09-16T17:05:36.515505+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.515469+0000","last_change":"2024-09-16T16:52:01.188616+0000","last_active":"2024-09-16T17:05:36.515469+0000","last_peered":"2024-09-16T17:05:36.515469+0000","last_clean":"2024-09-16T17:05:36.515469+0000","last_became_active":"2024-09-16T16:52:01.182688+0000","last_became_peered":"2024-09-16T16:52:01.182688+0000","last_unstale":"2024-09-16T17:05:36.515469+0000","last_undegraded":"2024-09-16T17:05:36.515469+0000","last_fullsized":"2024-09-16T17:05:36.515469+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.514399+0000","last_change":"2024-09-16T16:52:01.046742+0000","last_active":"2024-09-16T17:05:36.514399+0000","last_peered":"2024-09-16T17:05:36.514399+0000","last_clean":"2024-09-16T17:05:36.514399+0000","last_became_active":"2024-09-16T16:52:01.022683+0000","last_became_peered":"2024-09-16T16:52:01.022683+0000","last_unstale":"2024-09-16T17:05:36.514399+0000","last_undegraded":"2024-09-16T17:05:36.514399+0000","last_fullsized":"2024-09-16T17:05:36.514399+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.506358+0000","last_change":"2024-09-16T16:52:01.035066+0000","last_active":"2024-09-16T17:05:36.506358+0000","last_peered":"2024-09-16T17:05:36.506358+0000","last_clean":"2024-09-16T17:05:36.506358+0000","last_became_active":"2024-09-16T16:52:01.014432+0000","last_became_peered":"2024-09-16T16:52:01.014432+0000","last_unstale":"2024-09-16T17:05:36.506358+0000","last_undegraded":"2024-09-16T17:05:36.506358+0000","last_fullsized":"2024-09-16T17:05:36.506358+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.517663+0000","last_change":"2024-09-16T16:52:01.168350+0000","last_active":"2024-09-16T17:05:36.517663+0000","last_peered":"2024-09-16T17:05:36.517663+0000","last_clean":"2024-09-16T17:05:36.517663+0000","last_became_active":"2024-09-16T16:52:01.150691+0000","last_became_peered":"2024-09-16T16:52:01.150691+0000","last_unstale":"2024-09-16T17:05:36.517663+0000","last_undegraded":"2024-09-16T17:05:36.517663+0000","last_fullsized":"2024-09-16T17:05:36.517663+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.505254+0000","last_change":"2024-09-16T16:52:01.110296+0000","last_active":"2024-09-16T17:05:36.505254+0000","last_peered":"2024-09-16T17:05:36.505254+0000","last_clean":"2024-09-16T17:05:36.505254+0000","last_became_active":"2024-09-16T16:52:01.054274+0000","last_became_peered":"2024-09-16T16:52:01.054274+0000","last_unstale":"2024-09-16T17:05:36.505254+0000","last_undegraded":"2024-09-16T17:05:36.505254+0000","last_fullsized":"2024-09-16T17:05:36.505254+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.505682+0000","last_change":"2024-09-16T16:52:01.066153+0000","last_active":"2024-09-16T17:05:36.505682+0000","last_peered":"2024-09-16T17:05:36.505682+0000","last_clean":"2024-09-16T17:05:36.505682+0000","last_became_active":"2024-09-16T16:52:01.056754+0000","last_became_peered":"2024-09-16T16:52:01.056754+0000","last_unstale":"2024-09-16T17:05:36.505682+0000","last_undegraded":"2024-09-16T17:05:36.505682+0000","last_fullsized":"2024-09-16T17:05:36.505682+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.499656+0000","last_change":"2024-09-16T16:52:01.167360+0000","last_active":"2024-09-16T17:05:36.499656+0000","last_peered":"2024-09-16T17:05:36.499656+0000","last_clean":"2024-09-16T17:05:36.499656+0000","last_became_active":"2024-09-16T16:52:01.142598+0000","last_became_peered":"2024-09-16T16:52:01.142598+0000","last_unstale":"2024-09-16T17:05:36.499656+0000","last_undegraded":"2024-09-16T17:05:36.499656+0000","last_fullsized":"2024-09-16T17:05:36.499656+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1476,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.508718+0000","last_change":"2024-09-16T16:52:01.078153+0000","last_active":"2024-09-16T17:05:36.508718+0000","last_peered":"2024-09-16T17:05:36.508718+0000","last_clean":"2024-09-16T17:05:36.508718+0000","last_became_active":"2024-09-16T16:52:01.029529+0000","last_became_peered":"2024-09-16T16:52:01.029529+0000","last_unstale":"2024-09-16T17:05:36.508718+0000","last_undegraded":"2024-09-16T17:05:36.508718+0000","last_fullsized":"2024-09-16T17:05:36.508718+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.515851+0000","last_change":"2024-09-16T16:52:01.009380+0000","last_active":"2024-09-16T17:05:36.515851+0000","last_peered":"2024-09-16T17:05:36.515851+0000","last_clean":"2024-09-16T17:05:36.515851+0000","last_became_active":"2024-09-16T16:52:00.988610+0000","last_became_peered":"2024-09-16T16:52:00.988610+0000","last_unstale":"2024-09-16T17:05:36.515851+0000","last_undegraded":"2024-09-16T17:05:36.515851+0000","last_fullsized":"2024-09-16T17:05:36.515851+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.511846+0000","last_change":"2024-09-16T16:46:50.254602+0000","last_active":"2024-09-16T17:05:36.511846+0000","last_peered":"2024-09-16T17:05:36.511846+0000","last_clean":"2024-09-16T17:05:36.511846+0000","last_became_active":"2024-09-16T16:46:48.301220+0000","last_became_peered":"2024-09-16T16:46:48.301220+0000","last_unstale":"2024-09-16T17:05:36.511846+0000","last_undegraded":"2024-09-16T17:05:36.511846+0000","last_fullsized":"2024-09-16T17:05:36.511846+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.512291+0000","last_change":"2024-09-16T16:46:50.252865+0000","last_active":"2024-09-16T17:05:36.512291+0000","last_peered":"2024-09-16T17:05:36.512291+0000","last_clean":"2024-09-16T17:05:36.512291+0000","last_became_active":"2024-09-16T16:46:48.285243+0000","last_became_peered":"2024-09-16T16:46:48.285243+0000","last_unstale":"2024-09-16T17:05:36.512291+0000","last_undegraded":"2024-09-16T17:05:36.512291+0000","last_fullsized":"2024-09-16T17:05:36.512291+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.519749+0000","last_change":"2024-09-16T16:46:50.249574+0000","last_active":"2024-09-16T17:05:36.519749+0000","last_peered":"2024-09-16T17:05:36.519749+0000","last_clean":"2024-09-16T17:05:36.519749+0000","last_became_active":"2024-09-16T16:46:48.295184+0000","last_became_peered":"2024-09-16T16:46:48.295184+0000","last_unstale":"2024-09-16T17:05:36.519749+0000","last_undegraded":"2024-09-16T17:05:36.519749+0000","last_fullsized":"2024-09-16T17:05:36.519749+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.505784+0000","last_change":"2024-09-16T16:46:50.249064+0000","last_active":"2024-09-16T17:05:36.505784+0000","last_peered":"2024-09-16T17:05:36.505784+0000","last_clean":"2024-09-16T17:05:36.505784+0000","last_became_active":"2024-09-16T16:46:48.280354+0000","last_became_peered":"2024-09-16T16:46:48.280354+0000","last_unstale":"2024-09-16T17:05:36.505784+0000","last_undegraded":"2024-09-16T17:05:36.505784+0000","last_fullsized":"2024-09-16T17:05:36.505784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.511609+0000","last_change":"2024-09-16T16:46:50.250531+0000","last_active":"2024-09-16T17:05:36.511609+0000","last_peered":"2024-09-16T17:05:36.511609+0000","last_clean":"2024-09-16T17:05:36.511609+0000","last_became_active":"2024-09-16T16:46:48.303026+0000","last_became_peered":"2024-09-16T16:46:48.303026+0000","last_unstale":"2024-09-16T17:05:36.511609+0000","last_undegraded":"2024-09-16T17:05:36.511609+0000","last_fullsized":"2024-09-16T17:05:36.511609+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.509597+0000","last_change":"2024-09-16T16:46:50.249648+0000","last_active":"2024-09-16T17:05:36.509597+0000","last_peered":"2024-09-16T17:05:36.509597+0000","last_clean":"2024-09-16T17:05:36.509597+0000","last_became_active":"2024-09-16T16:46:48.285463+0000","last_became_peered":"2024-09-16T16:46:48.285463+0000","last_unstale":"2024-09-16T17:05:36.509597+0000","last_undegraded":"2024-09-16T17:05:36.509597+0000","last_fullsized":"2024-09-16T17:05:36.509597+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.510534+0000","last_change":"2024-09-16T16:46:50.250997+0000","last_active":"2024-09-16T17:05:36.510534+0000","last_peered":"2024-09-16T17:05:36.510534+0000","last_clean":"2024-09-16T17:05:36.510534+0000","last_became_active":"2024-09-16T16:46:48.281970+0000","last_became_peered":"2024-09-16T16:46:48.281970+0000","last_unstale":"2024-09-16T17:05:36.510534+0000","last_undegraded":"2024-09-16T17:05:36.510534+0000","last_fullsized":"2024-09-16T17:05:36.510534+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2143,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.513065+0000","last_change":"2024-09-16T16:46:50.254143+0000","last_active":"2024-09-16T17:05:36.513065+0000","last_peered":"2024-09-16T17:05:36.513065+0000","last_clean":"2024-09-16T17:05:36.513065+0000","last_became_active":"2024-09-16T16:46:48.282002+0000","last_became_peered":"2024-09-16T16:46:48.282002+0000","last_unstale":"2024-09-16T17:05:36.513065+0000","last_undegraded":"2024-09-16T17:05:36.513065+0000","last_fullsized":"2024-09-16T17:05:36.513065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2214,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.502460+0000","last_change":"2024-09-16T16:46:46.272094+0000","last_active":"2024-09-16T17:05:36.502460+0000","last_peered":"2024-09-16T17:05:36.502460+0000","last_clean":"2024-09-16T17:05:36.502460+0000","last_became_active":"2024-09-16T16:46:46.253718+0000","last_became_peered":"2024-09-16T16:46:46.253718+0000","last_unstale":"2024-09-16T17:05:36.502460+0000","last_undegraded":"2024-09-16T17:05:36.502460+0000","last_fullsized":"2024-09-16T17:05:36.502460+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.198151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.198151+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.198151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214180847616,"internally_reserved":0,"allocated":30646272,"data_stored":30646272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214180847616,"internally_reserved":0,"allocated":30646272,"data_stored":30646272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53544812544,"internally_reserved":0,"allocated":8060928,"data_stored":8060928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7872,"kb_used_data":7872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289856,"statfs":{"total":53552873472,"available":53544812544,"internally_reserved":0,"allocated":8060928,"data_stored":8060928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6900,"kb_used_data":6900,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290828,"statfs":{"total":53552873472,"available":53545807872,"internally_reserved":0,"allocated":7065600,"data_stored":7065600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6752,"kb_used_data":6752,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290976,"statfs":{"total":53552873472,"available":53545959424,"internally_reserved":0,"allocated":6914048,"data_stored":6914048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8404,"kb_used_data":8404,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289324,"statfs":{"total":53552873472,"available":53544267776,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53544812544,"internally_reserved":0,"allocated":8060928,"data_stored":8060928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53544267776,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53545959424,"internally_reserved":0,"allocated":6914048,"data_stored":6914048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53545807872,"internally_reserved":0,"allocated":7065600,"data_stored":7065600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53544812544,"internally_reserved":0,"allocated":8060928,"data_stored":8060928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":53552873472,"available":53544267776,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":53552873472,"available":53545959424,"internally_reserved":0,"allocated":6914048,"data_stored":6914048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":53552873472,"available":53545807872,"internally_reserved":0,"allocated":7065600,"data_stored":7065600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":53552873472,"available":53544812544,"internally_reserved":0,"allocated":8060928,"data_stored":8060928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:06:09.508 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:06:09.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.611+0000 7fb3cb791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:09.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.616+0000 7fb3cb791640 1 Processor -- start 2024-09-16T17:06:09.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.616+0000 7fb3cb791640 1 -- start start 2024-09-16T17:06:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.617+0000 7fb3cb791640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb3c4132520 0x7fb3c4132930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.617+0000 7fb3cb791640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3c406f6d0 con 0x7fb3c40a3450 2024-09-16T17:06:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.617+0000 7fb3cb791640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7fb3c406f3d0 con 0x7fb3c4132520 2024-09-16T17:06:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.617+0000 7fb3c952d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb3c4132520 0x7fb3c4132930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.617+0000 7fb3c8d2c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb3c40a3450 0x7fb3c40a3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:45784/0 (socket says 172.21.15.89:45784) 2024-09-16T17:06:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.617+0000 7fb3c8d2c640 1 -- 172.21.15.89:0/3383606256 learned_addr learned my addr 172.21.15.89:0/3383606256 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:06:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.617+0000 7fb3c952d640 1 -- 172.21.15.89:0/3383606256 >> v1:172.21.15.89:6789/0 conn(0x7fb3c40a3450 legacy=0x7fb3c40a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.617+0000 7fb3c952d640 1 -- 172.21.15.89:0/3383606256 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c406f0c0 con 0x7fb3c4132520 2024-09-16T17:06:09.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.617+0000 7fb3bbfff640 1 -- 172.21.15.89:0/3383606256 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2449040581 0 0) 0x7fb3c406f6d0 con 0x7fb3c40a3450 2024-09-16T17:06:09.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.618+0000 7fb3c952d640 1 --2- 172.21.15.89:0/3383606256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3c4132520 0x7fb3c4132930 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a61ffb0e6515a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:09.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.618+0000 7fb3bbfff640 1 -- 172.21.15.89:0/3383606256 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb3c0009d90 con 0x7fb3c4132520 2024-09-16T17:06:09.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.618+0000 7fb3bbfff640 1 -- 172.21.15.89:0/3383606256 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb3c000e230 con 0x7fb3c4132520 2024-09-16T17:06:09.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.618+0000 7fb3bbfff640 1 -- 172.21.15.89:0/3383606256 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb3c000e4d0 con 0x7fb3c4132520 2024-09-16T17:06:09.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.618+0000 7fb3cb791640 1 -- 172.21.15.89:0/3383606256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3c4132520 msgr2=0x7fb3c4132930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:09.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.618+0000 7fb3cb791640 1 --2- 172.21.15.89:0/3383606256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3c4132520 0x7fb3c4132930 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:09.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.618+0000 7fb3cb791640 1 -- 172.21.15.89:0/3383606256 shutdown_connections 2024-09-16T17:06:09.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.618+0000 7fb3cb791640 1 --2- 172.21.15.89:0/3383606256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3c4132520 0x7fb3c4132930 unknown :-1 s=CLOSED pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:09.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.618+0000 7fb3cb791640 1 -- 172.21.15.89:0/3383606256 >> 172.21.15.89:0/3383606256 conn(0x7fb3c406e490 msgr2=0x7fb3c406e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:09.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.619+0000 7fb3cb791640 1 -- 172.21.15.89:0/3383606256 shutdown_connections 2024-09-16T17:06:09.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.619+0000 7fb3cb791640 1 -- 172.21.15.89:0/3383606256 wait complete. 2024-09-16T17:06:09.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.619+0000 7fb3cb791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:09.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.620+0000 7fb3cb791640 1 Processor -- start 2024-09-16T17:06:09.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.620+0000 7fb3cb791640 1 -- start start 2024-09-16T17:06:09.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.621+0000 7fb3cb791640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3c40a3450 0x7fb3c411e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.621+0000 7fb3cb791640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c4121ed0 con 0x7fb3c40a3450 2024-09-16T17:06:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.621+0000 7fb3c952d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3c40a3450 0x7fb3c411e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.621+0000 7fb3c952d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3c40a3450 0x7fb3c411e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37804/0 (socket says 172.21.15.89:37804) 2024-09-16T17:06:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.621+0000 7fb3c952d640 1 -- 172.21.15.89:0/2483188880 learned_addr learned my addr 172.21.15.89:0/2483188880 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.621+0000 7fb3c952d640 1 -- 172.21.15.89:0/2483188880 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c4121aa0 con 0x7fb3c40a3450 2024-09-16T17:06:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.622+0000 7fb3c952d640 1 --2- 172.21.15.89:0/2483188880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3c40a3450 0x7fb3c411e090 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.622+0000 7fb3b9ffb640 1 -- 172.21.15.89:0/2483188880 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb3c0014540 con 0x7fb3c40a3450 2024-09-16T17:06:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.622+0000 7fb3b9ffb640 1 -- 172.21.15.89:0/2483188880 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb3c00146a0 con 0x7fb3c40a3450 2024-09-16T17:06:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.622+0000 7fb3b9ffb640 1 -- 172.21.15.89:0/2483188880 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb3c0014940 con 0x7fb3c40a3450 2024-09-16T17:06:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.622+0000 7fb3cb791640 1 -- 172.21.15.89:0/2483188880 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c4135780 con 0x7fb3c40a3450 2024-09-16T17:06:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.622+0000 7fb3cb791640 1 -- 172.21.15.89:0/2483188880 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c4121790 con 0x7fb3c40a3450 2024-09-16T17:06:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.623+0000 7fb3b9ffb640 1 -- 172.21.15.89:0/2483188880 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb3c0014af0 con 0x7fb3c40a3450 2024-09-16T17:06:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.623+0000 7fb3cb791640 1 -- 172.21.15.89:0/2483188880 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c406a300 con 0x7fb3c40a3450 2024-09-16T17:06:09.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.623+0000 7fb3b9ffb640 1 --2- 172.21.15.89:0/2483188880 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fb3a803e930 0x7fb3a8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:09.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.623+0000 7fb3b9ffb640 1 -- 172.21.15.89:0/2483188880 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(726..726 src has 406..726) ==== 3431+0+0 (crc 0 0 0) 0x7fb3c0019040 con 0x7fb3c40a3450 2024-09-16T17:06:09.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.623+0000 7fb3c8d2c640 1 --2- 172.21.15.89:0/2483188880 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fb3a803e930 0x7fb3a8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:09.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.624+0000 7fb3c8d2c640 1 --2- 172.21.15.89:0/2483188880 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fb3a803e930 0x7fb3a8040e40 crc :-1 s=READY pgs=3876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:09.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.629+0000 7fb3b9ffb640 1 -- 172.21.15.89:0/2483188880 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fb3c0011380 con 0x7fb3c40a3450 2024-09-16T17:06:09.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.800+0000 7fb3cb791640 1 -- 172.21.15.89:0/2483188880 --> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3c409c830 con 0x7fb3a803e930 2024-09-16T17:06:09.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.802+0000 7fb3b9ffb640 1 -- 172.21.15.89:0/2483188880 <== mgr.4099 v2:172.21.15.177:6800/1212166405 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109430 (crc 0 0 0) 0x7fb3b40070b0 con 0x7fb3a803e930 2024-09-16T17:06:09.804 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T17:06:09.804 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-16T17:06:09.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.804+0000 7fb3cb791640 1 -- 172.21.15.89:0/2483188880 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fb3a803e930 msgr2=0x7fb3a8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:09.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.804+0000 7fb3cb791640 1 --2- 172.21.15.89:0/2483188880 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fb3a803e930 0x7fb3a8040e40 crc :-1 s=READY pgs=3876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:09.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.804+0000 7fb3cb791640 1 -- 172.21.15.89:0/2483188880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3c40a3450 msgr2=0x7fb3c411e090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:09.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.804+0000 7fb3cb791640 1 --2- 172.21.15.89:0/2483188880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3c40a3450 0x7fb3c411e090 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:09.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.804+0000 7fb3cb791640 1 -- 172.21.15.89:0/2483188880 shutdown_connections 2024-09-16T17:06:09.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.804+0000 7fb3cb791640 1 --2- 172.21.15.89:0/2483188880 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fb3a803e930 0x7fb3a8040e40 unknown :-1 s=CLOSED pgs=3876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:09.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.804+0000 7fb3cb791640 1 --2- 172.21.15.89:0/2483188880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3c40a3450 0x7fb3c411e090 unknown :-1 s=CLOSED pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:09.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.805+0000 7fb3cb791640 1 -- 172.21.15.89:0/2483188880 >> 172.21.15.89:0/2483188880 conn(0x7fb3c406e490 msgr2=0x7fb3c40a5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:09.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.805+0000 7fb3cb791640 1 -- 172.21.15.89:0/2483188880 shutdown_connections 2024-09-16T17:06:09.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.805+0000 7fb3cb791640 1 -- 172.21.15.89:0/2483188880 wait complete. 2024-09-16T17:06:09.817 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":1301,"stamp":"2024-09-16T17:06:09.410914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":29928,"kb_used_data":29928,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209160984,"statfs":{"total":214211493888,"available":214180847616,"internally_reserved":0,"allocated":30646272,"data_stored":30646272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001819"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.513597+0000","last_change":"2024-09-16T16:52:01.023066+0000","last_active":"2024-09-16T17:05:36.513597+0000","last_peered":"2024-09-16T17:05:36.513597+0000","last_clean":"2024-09-16T17:05:36.513597+0000","last_became_active":"2024-09-16T16:52:01.016850+0000","last_became_peered":"2024-09-16T16:52:01.016850+0000","last_unstale":"2024-09-16T17:05:36.513597+0000","last_undegraded":"2024-09-16T17:05:36.513597+0000","last_fullsized":"2024-09-16T17:05:36.513597+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.519063+0000","last_change":"2024-09-16T16:52:01.097555+0000","last_active":"2024-09-16T17:05:36.519063+0000","last_peered":"2024-09-16T17:05:36.519063+0000","last_clean":"2024-09-16T17:05:36.519063+0000","last_became_active":"2024-09-16T16:52:01.048635+0000","last_became_peered":"2024-09-16T16:52:01.048635+0000","last_unstale":"2024-09-16T17:05:36.519063+0000","last_undegraded":"2024-09-16T17:05:36.519063+0000","last_fullsized":"2024-09-16T17:05:36.519063+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.513689+0000","last_change":"2024-09-16T16:52:01.083490+0000","last_active":"2024-09-16T17:05:36.513689+0000","last_peered":"2024-09-16T17:05:36.513689+0000","last_clean":"2024-09-16T17:05:36.513689+0000","last_became_active":"2024-09-16T16:52:01.077074+0000","last_became_peered":"2024-09-16T16:52:01.077074+0000","last_unstale":"2024-09-16T17:05:36.513689+0000","last_undegraded":"2024-09-16T17:05:36.513689+0000","last_fullsized":"2024-09-16T17:05:36.513689+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.510812+0000","last_change":"2024-09-16T16:52:01.007501+0000","last_active":"2024-09-16T17:05:36.510812+0000","last_peered":"2024-09-16T17:05:36.510812+0000","last_clean":"2024-09-16T17:05:36.510812+0000","last_became_active":"2024-09-16T16:52:00.995826+0000","last_became_peered":"2024-09-16T16:52:00.995826+0000","last_unstale":"2024-09-16T17:05:36.510812+0000","last_undegraded":"2024-09-16T17:05:36.510812+0000","last_fullsized":"2024-09-16T17:05:36.510812+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.517971+0000","last_change":"2024-09-16T16:52:01.075449+0000","last_active":"2024-09-16T17:05:36.517971+0000","last_peered":"2024-09-16T17:05:36.517971+0000","last_clean":"2024-09-16T17:05:36.517971+0000","last_became_active":"2024-09-16T16:52:01.066170+0000","last_became_peered":"2024-09-16T16:52:01.066170+0000","last_unstale":"2024-09-16T17:05:36.517971+0000","last_undegraded":"2024-09-16T17:05:36.517971+0000","last_fullsized":"2024-09-16T17:05:36.517971+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.506231+0000","last_change":"2024-09-16T16:52:01.164718+0000","last_active":"2024-09-16T17:05:36.506231+0000","last_peered":"2024-09-16T17:05:36.506231+0000","last_clean":"2024-09-16T17:05:36.506231+0000","last_became_active":"2024-09-16T16:52:01.137358+0000","last_became_peered":"2024-09-16T16:52:01.137358+0000","last_unstale":"2024-09-16T17:05:36.506231+0000","last_undegraded":"2024-09-16T17:05:36.506231+0000","last_fullsized":"2024-09-16T17:05:36.506231+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.510218+0000","last_change":"2024-09-16T16:52:01.039514+0000","last_active":"2024-09-16T17:05:36.510218+0000","last_peered":"2024-09-16T17:05:36.510218+0000","last_clean":"2024-09-16T17:05:36.510218+0000","last_became_active":"2024-09-16T16:52:01.018449+0000","last_became_peered":"2024-09-16T16:52:01.018449+0000","last_unstale":"2024-09-16T17:05:36.510218+0000","last_undegraded":"2024-09-16T17:05:36.510218+0000","last_fullsized":"2024-09-16T17:05:36.510218+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.512348+0000","last_change":"2024-09-16T16:52:01.089282+0000","last_active":"2024-09-16T17:05:36.512348+0000","last_peered":"2024-09-16T17:05:36.512348+0000","last_clean":"2024-09-16T17:05:36.512348+0000","last_became_active":"2024-09-16T16:52:01.043446+0000","last_became_peered":"2024-09-16T16:52:01.043446+0000","last_unstale":"2024-09-16T17:05:36.512348+0000","last_undegraded":"2024-09-16T17:05:36.512348+0000","last_fullsized":"2024-09-16T17:05:36.512348+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.507845+0000","last_change":"2024-09-16T16:52:01.002820+0000","last_active":"2024-09-16T17:05:36.507845+0000","last_peered":"2024-09-16T17:05:36.507845+0000","last_clean":"2024-09-16T17:05:36.507845+0000","last_became_active":"2024-09-16T16:52:00.984993+0000","last_became_peered":"2024-09-16T16:52:00.984993+0000","last_unstale":"2024-09-16T17:05:36.507845+0000","last_undegraded":"2024-09-16T17:05:36.507845+0000","last_fullsized":"2024-09-16T17:05:36.507845+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.510725+0000","last_change":"2024-09-16T16:52:01.125926+0000","last_active":"2024-09-16T17:05:36.510725+0000","last_peered":"2024-09-16T17:05:36.510725+0000","last_clean":"2024-09-16T17:05:36.510725+0000","last_became_active":"2024-09-16T16:52:01.118033+0000","last_became_peered":"2024-09-16T16:52:01.118033+0000","last_unstale":"2024-09-16T17:05:36.510725+0000","last_undegraded":"2024-09-16T17:05:36.510725+0000","last_fullsized":"2024-09-16T17:05:36.510725+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.507372+0000","last_change":"2024-09-16T16:52:01.047718+0000","last_active":"2024-09-16T17:05:36.507372+0000","last_peered":"2024-09-16T17:05:36.507372+0000","last_clean":"2024-09-16T17:05:36.507372+0000","last_became_active":"2024-09-16T16:52:01.018199+0000","last_became_peered":"2024-09-16T16:52:01.018199+0000","last_unstale":"2024-09-16T17:05:36.507372+0000","last_undegraded":"2024-09-16T17:05:36.507372+0000","last_fullsized":"2024-09-16T17:05:36.507372+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.508775+0000","last_change":"2024-09-16T16:52:01.126951+0000","last_active":"2024-09-16T17:05:36.508775+0000","last_peered":"2024-09-16T17:05:36.508775+0000","last_clean":"2024-09-16T17:05:36.508775+0000","last_became_active":"2024-09-16T16:52:01.098860+0000","last_became_peered":"2024-09-16T16:52:01.098860+0000","last_unstale":"2024-09-16T17:05:36.508775+0000","last_undegraded":"2024-09-16T17:05:36.508775+0000","last_fullsized":"2024-09-16T17:05:36.508775+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.519261+0000","last_change":"2024-09-16T16:52:01.038538+0000","last_active":"2024-09-16T17:05:36.519261+0000","last_peered":"2024-09-16T17:05:36.519261+0000","last_clean":"2024-09-16T17:05:36.519261+0000","last_became_active":"2024-09-16T16:52:01.014800+0000","last_became_peered":"2024-09-16T16:52:01.014800+0000","last_unstale":"2024-09-16T17:05:36.519261+0000","last_undegraded":"2024-09-16T17:05:36.519261+0000","last_fullsized":"2024-09-16T17:05:36.519261+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.518720+0000","last_change":"2024-09-16T16:52:01.079983+0000","last_active":"2024-09-16T17:05:36.518720+0000","last_peered":"2024-09-16T17:05:36.518720+0000","last_clean":"2024-09-16T17:05:36.518720+0000","last_became_active":"2024-09-16T16:52:01.070554+0000","last_became_peered":"2024-09-16T16:52:01.070554+0000","last_unstale":"2024-09-16T17:05:36.518720+0000","last_undegraded":"2024-09-16T17:05:36.518720+0000","last_fullsized":"2024-09-16T17:05:36.518720+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.506105+0000","last_change":"2024-09-16T16:52:01.171432+0000","last_active":"2024-09-16T17:05:36.506105+0000","last_peered":"2024-09-16T17:05:36.506105+0000","last_clean":"2024-09-16T17:05:36.506105+0000","last_became_active":"2024-09-16T16:52:01.163260+0000","last_became_peered":"2024-09-16T16:52:01.163260+0000","last_unstale":"2024-09-16T17:05:36.506105+0000","last_undegraded":"2024-09-16T17:05:36.506105+0000","last_fullsized":"2024-09-16T17:05:36.506105+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.505722+0000","last_change":"2024-09-16T16:52:01.089266+0000","last_active":"2024-09-16T17:05:36.505722+0000","last_peered":"2024-09-16T17:05:36.505722+0000","last_clean":"2024-09-16T17:05:36.505722+0000","last_became_active":"2024-09-16T16:52:01.039791+0000","last_became_peered":"2024-09-16T16:52:01.039791+0000","last_unstale":"2024-09-16T17:05:36.505722+0000","last_undegraded":"2024-09-16T17:05:36.505722+0000","last_fullsized":"2024-09-16T17:05:36.505722+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.506637+0000","last_change":"2024-09-16T16:52:01.101751+0000","last_active":"2024-09-16T17:05:36.506637+0000","last_peered":"2024-09-16T17:05:36.506637+0000","last_clean":"2024-09-16T17:05:36.506637+0000","last_became_active":"2024-09-16T16:52:01.063909+0000","last_became_peered":"2024-09-16T16:52:01.063909+0000","last_unstale":"2024-09-16T17:05:36.506637+0000","last_undegraded":"2024-09-16T17:05:36.506637+0000","last_fullsized":"2024-09-16T17:05:36.506637+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.506783+0000","last_change":"2024-09-16T16:52:01.160111+0000","last_active":"2024-09-16T17:05:36.506783+0000","last_peered":"2024-09-16T17:05:36.506783+0000","last_clean":"2024-09-16T17:05:36.506783+0000","last_became_active":"2024-09-16T16:52:01.138167+0000","last_became_peered":"2024-09-16T16:52:01.138167+0000","last_unstale":"2024-09-16T17:05:36.506783+0000","last_undegraded":"2024-09-16T17:05:36.506783+0000","last_fullsized":"2024-09-16T17:05:36.506783+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.514011+0000","last_change":"2024-09-16T16:52:01.037689+0000","last_active":"2024-09-16T17:05:36.514011+0000","last_peered":"2024-09-16T17:05:36.514011+0000","last_clean":"2024-09-16T17:05:36.514011+0000","last_became_active":"2024-09-16T16:52:01.016490+0000","last_became_peered":"2024-09-16T16:52:01.016490+0000","last_unstale":"2024-09-16T17:05:36.514011+0000","last_undegraded":"2024-09-16T17:05:36.514011+0000","last_fullsized":"2024-09-16T17:05:36.514011+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.509057+0000","last_change":"2024-09-16T16:52:01.009029+0000","last_active":"2024-09-16T17:05:36.509057+0000","last_peered":"2024-09-16T17:05:36.509057+0000","last_clean":"2024-09-16T17:05:36.509057+0000","last_became_active":"2024-09-16T16:52:00.998521+0000","last_became_peered":"2024-09-16T16:52:00.998521+0000","last_unstale":"2024-09-16T17:05:36.509057+0000","last_undegraded":"2024-09-16T17:05:36.509057+0000","last_fullsized":"2024-09-16T17:05:36.509057+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.512621+0000","last_change":"2024-09-16T16:52:01.083905+0000","last_active":"2024-09-16T17:05:36.512621+0000","last_peered":"2024-09-16T17:05:36.512621+0000","last_clean":"2024-09-16T17:05:36.512621+0000","last_became_active":"2024-09-16T16:52:01.040747+0000","last_became_peered":"2024-09-16T16:52:01.040747+0000","last_unstale":"2024-09-16T17:05:36.512621+0000","last_undegraded":"2024-09-16T17:05:36.512621+0000","last_fullsized":"2024-09-16T17:05:36.512621+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.503679+0000","last_change":"2024-09-16T16:52:01.041092+0000","last_active":"2024-09-16T17:05:36.503679+0000","last_peered":"2024-09-16T17:05:36.503679+0000","last_clean":"2024-09-16T17:05:36.503679+0000","last_became_active":"2024-09-16T16:52:01.017647+0000","last_became_peered":"2024-09-16T16:52:01.017647+0000","last_unstale":"2024-09-16T17:05:36.503679+0000","last_undegraded":"2024-09-16T17:05:36.503679+0000","last_fullsized":"2024-09-16T17:05:36.503679+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.515505+0000","last_change":"2024-09-16T16:52:01.105516+0000","last_active":"2024-09-16T17:05:36.515505+0000","last_peered":"2024-09-16T17:05:36.515505+0000","last_clean":"2024-09-16T17:05:36.515505+0000","last_became_active":"2024-09-16T16:52:01.096609+0000","last_became_peered":"2024-09-16T16:52:01.096609+0000","last_unstale":"2024-09-16T17:05:36.515505+0000","last_undegraded":"2024-09-16T17:05:36.515505+0000","last_fullsized":"2024-09-16T17:05:36.515505+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.515469+0000","last_change":"2024-09-16T16:52:01.188616+0000","last_active":"2024-09-16T17:05:36.515469+0000","last_peered":"2024-09-16T17:05:36.515469+0000","last_clean":"2024-09-16T17:05:36.515469+0000","last_became_active":"2024-09-16T16:52:01.182688+0000","last_became_peered":"2024-09-16T16:52:01.182688+0000","last_unstale":"2024-09-16T17:05:36.515469+0000","last_undegraded":"2024-09-16T17:05:36.515469+0000","last_fullsized":"2024-09-16T17:05:36.515469+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.514399+0000","last_change":"2024-09-16T16:52:01.046742+0000","last_active":"2024-09-16T17:05:36.514399+0000","last_peered":"2024-09-16T17:05:36.514399+0000","last_clean":"2024-09-16T17:05:36.514399+0000","last_became_active":"2024-09-16T16:52:01.022683+0000","last_became_peered":"2024-09-16T16:52:01.022683+0000","last_unstale":"2024-09-16T17:05:36.514399+0000","last_undegraded":"2024-09-16T17:05:36.514399+0000","last_fullsized":"2024-09-16T17:05:36.514399+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.506358+0000","last_change":"2024-09-16T16:52:01.035066+0000","last_active":"2024-09-16T17:05:36.506358+0000","last_peered":"2024-09-16T17:05:36.506358+0000","last_clean":"2024-09-16T17:05:36.506358+0000","last_became_active":"2024-09-16T16:52:01.014432+0000","last_became_peered":"2024-09-16T16:52:01.014432+0000","last_unstale":"2024-09-16T17:05:36.506358+0000","last_undegraded":"2024-09-16T17:05:36.506358+0000","last_fullsized":"2024-09-16T17:05:36.506358+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.517663+0000","last_change":"2024-09-16T16:52:01.168350+0000","last_active":"2024-09-16T17:05:36.517663+0000","last_peered":"2024-09-16T17:05:36.517663+0000","last_clean":"2024-09-16T17:05:36.517663+0000","last_became_active":"2024-09-16T16:52:01.150691+0000","last_became_peered":"2024-09-16T16:52:01.150691+0000","last_unstale":"2024-09-16T17:05:36.517663+0000","last_undegraded":"2024-09-16T17:05:36.517663+0000","last_fullsized":"2024-09-16T17:05:36.517663+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.505254+0000","last_change":"2024-09-16T16:52:01.110296+0000","last_active":"2024-09-16T17:05:36.505254+0000","last_peered":"2024-09-16T17:05:36.505254+0000","last_clean":"2024-09-16T17:05:36.505254+0000","last_became_active":"2024-09-16T16:52:01.054274+0000","last_became_peered":"2024-09-16T16:52:01.054274+0000","last_unstale":"2024-09-16T17:05:36.505254+0000","last_undegraded":"2024-09-16T17:05:36.505254+0000","last_fullsized":"2024-09-16T17:05:36.505254+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.505682+0000","last_change":"2024-09-16T16:52:01.066153+0000","last_active":"2024-09-16T17:05:36.505682+0000","last_peered":"2024-09-16T17:05:36.505682+0000","last_clean":"2024-09-16T17:05:36.505682+0000","last_became_active":"2024-09-16T16:52:01.056754+0000","last_became_peered":"2024-09-16T16:52:01.056754+0000","last_unstale":"2024-09-16T17:05:36.505682+0000","last_undegraded":"2024-09-16T17:05:36.505682+0000","last_fullsized":"2024-09-16T17:05:36.505682+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.499656+0000","last_change":"2024-09-16T16:52:01.167360+0000","last_active":"2024-09-16T17:05:36.499656+0000","last_peered":"2024-09-16T17:05:36.499656+0000","last_clean":"2024-09-16T17:05:36.499656+0000","last_became_active":"2024-09-16T16:52:01.142598+0000","last_became_peered":"2024-09-16T16:52:01.142598+0000","last_unstale":"2024-09-16T17:05:36.499656+0000","last_undegraded":"2024-09-16T17:05:36.499656+0000","last_fullsized":"2024-09-16T17:05:36.499656+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1476,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.508718+0000","last_change":"2024-09-16T16:52:01.078153+0000","last_active":"2024-09-16T17:05:36.508718+0000","last_peered":"2024-09-16T17:05:36.508718+0000","last_clean":"2024-09-16T17:05:36.508718+0000","last_became_active":"2024-09-16T16:52:01.029529+0000","last_became_peered":"2024-09-16T16:52:01.029529+0000","last_unstale":"2024-09-16T17:05:36.508718+0000","last_undegraded":"2024-09-16T17:05:36.508718+0000","last_fullsized":"2024-09-16T17:05:36.508718+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.515851+0000","last_change":"2024-09-16T16:52:01.009380+0000","last_active":"2024-09-16T17:05:36.515851+0000","last_peered":"2024-09-16T17:05:36.515851+0000","last_clean":"2024-09-16T17:05:36.515851+0000","last_became_active":"2024-09-16T16:52:00.988610+0000","last_became_peered":"2024-09-16T16:52:00.988610+0000","last_unstale":"2024-09-16T17:05:36.515851+0000","last_undegraded":"2024-09-16T17:05:36.515851+0000","last_fullsized":"2024-09-16T17:05:36.515851+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.511846+0000","last_change":"2024-09-16T16:46:50.254602+0000","last_active":"2024-09-16T17:05:36.511846+0000","last_peered":"2024-09-16T17:05:36.511846+0000","last_clean":"2024-09-16T17:05:36.511846+0000","last_became_active":"2024-09-16T16:46:48.301220+0000","last_became_peered":"2024-09-16T16:46:48.301220+0000","last_unstale":"2024-09-16T17:05:36.511846+0000","last_undegraded":"2024-09-16T17:05:36.511846+0000","last_fullsized":"2024-09-16T17:05:36.511846+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.512291+0000","last_change":"2024-09-16T16:46:50.252865+0000","last_active":"2024-09-16T17:05:36.512291+0000","last_peered":"2024-09-16T17:05:36.512291+0000","last_clean":"2024-09-16T17:05:36.512291+0000","last_became_active":"2024-09-16T16:46:48.285243+0000","last_became_peered":"2024-09-16T16:46:48.285243+0000","last_unstale":"2024-09-16T17:05:36.512291+0000","last_undegraded":"2024-09-16T17:05:36.512291+0000","last_fullsized":"2024-09-16T17:05:36.512291+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.519749+0000","last_change":"2024-09-16T16:46:50.249574+0000","last_active":"2024-09-16T17:05:36.519749+0000","last_peered":"2024-09-16T17:05:36.519749+0000","last_clean":"2024-09-16T17:05:36.519749+0000","last_became_active":"2024-09-16T16:46:48.295184+0000","last_became_peered":"2024-09-16T16:46:48.295184+0000","last_unstale":"2024-09-16T17:05:36.519749+0000","last_undegraded":"2024-09-16T17:05:36.519749+0000","last_fullsized":"2024-09-16T17:05:36.519749+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.505784+0000","last_change":"2024-09-16T16:46:50.249064+0000","last_active":"2024-09-16T17:05:36.505784+0000","last_peered":"2024-09-16T17:05:36.505784+0000","last_clean":"2024-09-16T17:05:36.505784+0000","last_became_active":"2024-09-16T16:46:48.280354+0000","last_became_peered":"2024-09-16T16:46:48.280354+0000","last_unstale":"2024-09-16T17:05:36.505784+0000","last_undegraded":"2024-09-16T17:05:36.505784+0000","last_fullsized":"2024-09-16T17:05:36.505784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.511609+0000","last_change":"2024-09-16T16:46:50.250531+0000","last_active":"2024-09-16T17:05:36.511609+0000","last_peered":"2024-09-16T17:05:36.511609+0000","last_clean":"2024-09-16T17:05:36.511609+0000","last_became_active":"2024-09-16T16:46:48.303026+0000","last_became_peered":"2024-09-16T16:46:48.303026+0000","last_unstale":"2024-09-16T17:05:36.511609+0000","last_undegraded":"2024-09-16T17:05:36.511609+0000","last_fullsized":"2024-09-16T17:05:36.511609+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.509597+0000","last_change":"2024-09-16T16:46:50.249648+0000","last_active":"2024-09-16T17:05:36.509597+0000","last_peered":"2024-09-16T17:05:36.509597+0000","last_clean":"2024-09-16T17:05:36.509597+0000","last_became_active":"2024-09-16T16:46:48.285463+0000","last_became_peered":"2024-09-16T16:46:48.285463+0000","last_unstale":"2024-09-16T17:05:36.509597+0000","last_undegraded":"2024-09-16T17:05:36.509597+0000","last_fullsized":"2024-09-16T17:05:36.509597+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.510534+0000","last_change":"2024-09-16T16:46:50.250997+0000","last_active":"2024-09-16T17:05:36.510534+0000","last_peered":"2024-09-16T17:05:36.510534+0000","last_clean":"2024-09-16T17:05:36.510534+0000","last_became_active":"2024-09-16T16:46:48.281970+0000","last_became_peered":"2024-09-16T16:46:48.281970+0000","last_unstale":"2024-09-16T17:05:36.510534+0000","last_undegraded":"2024-09-16T17:05:36.510534+0000","last_fullsized":"2024-09-16T17:05:36.510534+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2143,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.513065+0000","last_change":"2024-09-16T16:46:50.254143+0000","last_active":"2024-09-16T17:05:36.513065+0000","last_peered":"2024-09-16T17:05:36.513065+0000","last_clean":"2024-09-16T17:05:36.513065+0000","last_became_active":"2024-09-16T16:46:48.282002+0000","last_became_peered":"2024-09-16T16:46:48.282002+0000","last_unstale":"2024-09-16T17:05:36.513065+0000","last_undegraded":"2024-09-16T17:05:36.513065+0000","last_fullsized":"2024-09-16T17:05:36.513065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2214,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.502460+0000","last_change":"2024-09-16T16:46:46.272094+0000","last_active":"2024-09-16T17:05:36.502460+0000","last_peered":"2024-09-16T17:05:36.502460+0000","last_clean":"2024-09-16T17:05:36.502460+0000","last_became_active":"2024-09-16T16:46:46.253718+0000","last_became_peered":"2024-09-16T16:46:46.253718+0000","last_unstale":"2024-09-16T17:05:36.502460+0000","last_undegraded":"2024-09-16T17:05:36.502460+0000","last_fullsized":"2024-09-16T17:05:36.502460+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.198151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.198151+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.198151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214180847616,"internally_reserved":0,"allocated":30646272,"data_stored":30646272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214180847616,"internally_reserved":0,"allocated":30646272,"data_stored":30646272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53544812544,"internally_reserved":0,"allocated":8060928,"data_stored":8060928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7872,"kb_used_data":7872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289856,"statfs":{"total":53552873472,"available":53544812544,"internally_reserved":0,"allocated":8060928,"data_stored":8060928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6900,"kb_used_data":6900,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290828,"statfs":{"total":53552873472,"available":53545807872,"internally_reserved":0,"allocated":7065600,"data_stored":7065600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6752,"kb_used_data":6752,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290976,"statfs":{"total":53552873472,"available":53545959424,"internally_reserved":0,"allocated":6914048,"data_stored":6914048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8404,"kb_used_data":8404,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289324,"statfs":{"total":53552873472,"available":53544267776,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53544812544,"internally_reserved":0,"allocated":8060928,"data_stored":8060928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53544267776,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53545959424,"internally_reserved":0,"allocated":6914048,"data_stored":6914048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53545807872,"internally_reserved":0,"allocated":7065600,"data_stored":7065600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53544812544,"internally_reserved":0,"allocated":8060928,"data_stored":8060928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":53552873472,"available":53544267776,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":53552873472,"available":53545959424,"internally_reserved":0,"allocated":6914048,"data_stored":6914048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":53552873472,"available":53545807872,"internally_reserved":0,"allocated":7065600,"data_stored":7065600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":53552873472,"available":53544812544,"internally_reserved":0,"allocated":8060928,"data_stored":8060928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:06:09.818 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T17:06:09.819 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:06:09.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.921+0000 7fab53591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:09.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.925+0000 7fab53591640 1 Processor -- start 2024-09-16T17:06:09.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.925+0000 7fab53591640 1 -- start start 2024-09-16T17:06:09.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.926+0000 7fab53591640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fab4c131300 0x7fab4c131710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:09.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.926+0000 7fab53591640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab4c09ce60 con 0x7fab4c132030 2024-09-16T17:06:09.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.926+0000 7fab53591640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7fab4c09e010 con 0x7fab4c131300 2024-09-16T17:06:09.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.927+0000 7fab5132d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fab4c131300 0x7fab4c131710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:09.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.927+0000 7fab5132d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fab4c131300 0x7fab4c131710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37814/0 (socket says 172.21.15.89:37814) 2024-09-16T17:06:09.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.927+0000 7fab50b2c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fab4c132030 0x7fab4c132440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:45794/0 (socket says 172.21.15.89:45794) 2024-09-16T17:06:09.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.927+0000 7fab5132d640 1 -- 172.21.15.89:0/2136371325 learned_addr learned my addr 172.21.15.89:0/2136371325 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:09.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.927+0000 7fab5132d640 1 -- 172.21.15.89:0/2136371325 >> v1:172.21.15.89:6789/0 conn(0x7fab4c132030 legacy=0x7fab4c132440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:09.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.927+0000 7fab43fff640 1 -- 172.21.15.89:0/2136371325 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192357561 0 0) 0x7fab4c09ce60 con 0x7fab4c132030 2024-09-16T17:06:09.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.927+0000 7fab5132d640 1 -- 172.21.15.89:0/2136371325 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4c0a0aa0 con 0x7fab4c131300 2024-09-16T17:06:09.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.927+0000 7fab5132d640 1 --2- 172.21.15.89:0/2136371325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab4c131300 0x7fab4c131710 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8de5bd299572b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:09.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.927+0000 7fab43fff640 1 -- 172.21.15.89:0/2136371325 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab48009e20 con 0x7fab4c131300 2024-09-16T17:06:09.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.927+0000 7fab43fff640 1 -- 172.21.15.89:0/2136371325 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fab4800e230 con 0x7fab4c131300 2024-09-16T17:06:09.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.927+0000 7fab43fff640 1 -- 172.21.15.89:0/2136371325 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab4800e4d0 con 0x7fab4c131300 2024-09-16T17:06:09.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.928+0000 7fab53591640 1 -- 172.21.15.89:0/2136371325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab4c131300 msgr2=0x7fab4c131710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:09.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.928+0000 7fab53591640 1 --2- 172.21.15.89:0/2136371325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab4c131300 0x7fab4c131710 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:09.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.928+0000 7fab53591640 1 -- 172.21.15.89:0/2136371325 shutdown_connections 2024-09-16T17:06:09.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.928+0000 7fab53591640 1 --2- 172.21.15.89:0/2136371325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab4c131300 0x7fab4c131710 unknown :-1 s=CLOSED pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:09.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.928+0000 7fab53591640 1 -- 172.21.15.89:0/2136371325 >> 172.21.15.89:0/2136371325 conn(0x7fab4c069d10 msgr2=0x7fab4c09f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:09.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.928+0000 7fab53591640 1 -- 172.21.15.89:0/2136371325 shutdown_connections 2024-09-16T17:06:09.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.928+0000 7fab53591640 1 -- 172.21.15.89:0/2136371325 wait complete. 2024-09-16T17:06:09.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.928+0000 7fab53591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:09.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.930+0000 7fab53591640 1 Processor -- start 2024-09-16T17:06:09.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.930+0000 7fab53591640 1 -- start start 2024-09-16T17:06:09.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.931+0000 7fab53591640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab4c131300 0x7fab4c11cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:09.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.931+0000 7fab53591640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c120b50 con 0x7fab4c131300 2024-09-16T17:06:09.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.931+0000 7fab5132d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab4c131300 0x7fab4c11cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:09.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.931+0000 7fab5132d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab4c131300 0x7fab4c11cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37824/0 (socket says 172.21.15.89:37824) 2024-09-16T17:06:09.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.931+0000 7fab5132d640 1 -- 172.21.15.89:0/1811712555 learned_addr learned my addr 172.21.15.89:0/1811712555 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:09.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.931+0000 7fab5132d640 1 -- 172.21.15.89:0/1811712555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4c073ac0 con 0x7fab4c131300 2024-09-16T17:06:09.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.931+0000 7fab5132d640 1 --2- 172.21.15.89:0/1811712555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab4c131300 0x7fab4c11cdf0 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:09.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.931+0000 7fab41ffb640 1 -- 172.21.15.89:0/1811712555 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab4800ee10 con 0x7fab4c131300 2024-09-16T17:06:09.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.931+0000 7fab41ffb640 1 -- 172.21.15.89:0/1811712555 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fab48015420 con 0x7fab4c131300 2024-09-16T17:06:09.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.931+0000 7fab53591640 1 -- 172.21.15.89:0/1811712555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab4c120dd0 con 0x7fab4c131300 2024-09-16T17:06:09.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.931+0000 7fab41ffb640 1 -- 172.21.15.89:0/1811712555 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab480156c0 con 0x7fab4c131300 2024-09-16T17:06:09.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.932+0000 7fab53591640 1 -- 172.21.15.89:0/1811712555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab4c11e870 con 0x7fab4c131300 2024-09-16T17:06:09.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.932+0000 7fab41ffb640 1 -- 172.21.15.89:0/1811712555 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fab480158b0 con 0x7fab4c131300 2024-09-16T17:06:09.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.932+0000 7fab53591640 1 -- 172.21.15.89:0/1811712555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab4c11f200 con 0x7fab4c131300 2024-09-16T17:06:09.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.932+0000 7fab41ffb640 1 --2- 172.21.15.89:0/1811712555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fab3003e960 0x7fab30040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:09.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.933+0000 7fab41ffb640 1 -- 172.21.15.89:0/1811712555 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(726..726 src has 406..726) ==== 3431+0+0 (crc 0 0 0) 0x7fab48050f30 con 0x7fab4c131300 2024-09-16T17:06:09.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.933+0000 7fab50b2c640 1 --2- 172.21.15.89:0/1811712555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fab3003e960 0x7fab30040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:09.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.933+0000 7fab50b2c640 1 --2- 172.21.15.89:0/1811712555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fab3003e960 0x7fab30040e70 crc :-1 s=READY pgs=3877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:09.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:09.938+0000 7fab41ffb640 1 -- 172.21.15.89:0/1811712555 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fab4800f2a0 con 0x7fab4c131300 2024-09-16T17:06:10.110 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.109+0000 7fab53591640 1 -- 172.21.15.89:0/1811712555 --> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fab4c0a2f10 con 0x7fab3003e960 2024-09-16T17:06:10.112 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.111+0000 7fab41ffb640 1 -- 172.21.15.89:0/1811712555 <== mgr.4099 v2:172.21.15.177:6800/1212166405 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109430 (crc 0 0 0) 0x7fab4c0a2f10 con 0x7fab3003e960 2024-09-16T17:06:10.113 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T17:06:10.114 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-16T17:06:10.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.114+0000 7fab53591640 1 -- 172.21.15.89:0/1811712555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fab3003e960 msgr2=0x7fab30040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:10.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.114+0000 7fab53591640 1 --2- 172.21.15.89:0/1811712555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fab3003e960 0x7fab30040e70 crc :-1 s=READY pgs=3877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:10.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.114+0000 7fab53591640 1 -- 172.21.15.89:0/1811712555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab4c131300 msgr2=0x7fab4c11cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:10.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.114+0000 7fab53591640 1 --2- 172.21.15.89:0/1811712555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab4c131300 0x7fab4c11cdf0 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:10.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.114+0000 7fab53591640 1 -- 172.21.15.89:0/1811712555 shutdown_connections 2024-09-16T17:06:10.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.114+0000 7fab53591640 1 --2- 172.21.15.89:0/1811712555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fab3003e960 0x7fab30040e70 unknown :-1 s=CLOSED pgs=3877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:10.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.114+0000 7fab53591640 1 --2- 172.21.15.89:0/1811712555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab4c131300 0x7fab4c11cdf0 unknown :-1 s=CLOSED pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:10.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.114+0000 7fab53591640 1 -- 172.21.15.89:0/1811712555 >> 172.21.15.89:0/1811712555 conn(0x7fab4c069d10 msgr2=0x7fab4c09f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:10.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.114+0000 7fab53591640 1 -- 172.21.15.89:0/1811712555 shutdown_connections 2024-09-16T17:06:10.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.114+0000 7fab53591640 1 -- 172.21.15.89:0/1811712555 wait complete. 2024-09-16T17:06:10.126 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":1301,"stamp":"2024-09-16T17:06:09.410914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":29928,"kb_used_data":29928,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209160984,"statfs":{"total":214211493888,"available":214180847616,"internally_reserved":0,"allocated":30646272,"data_stored":30646272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001819"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.513597+0000","last_change":"2024-09-16T16:52:01.023066+0000","last_active":"2024-09-16T17:05:36.513597+0000","last_peered":"2024-09-16T17:05:36.513597+0000","last_clean":"2024-09-16T17:05:36.513597+0000","last_became_active":"2024-09-16T16:52:01.016850+0000","last_became_peered":"2024-09-16T16:52:01.016850+0000","last_unstale":"2024-09-16T17:05:36.513597+0000","last_undegraded":"2024-09-16T17:05:36.513597+0000","last_fullsized":"2024-09-16T17:05:36.513597+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.519063+0000","last_change":"2024-09-16T16:52:01.097555+0000","last_active":"2024-09-16T17:05:36.519063+0000","last_peered":"2024-09-16T17:05:36.519063+0000","last_clean":"2024-09-16T17:05:36.519063+0000","last_became_active":"2024-09-16T16:52:01.048635+0000","last_became_peered":"2024-09-16T16:52:01.048635+0000","last_unstale":"2024-09-16T17:05:36.519063+0000","last_undegraded":"2024-09-16T17:05:36.519063+0000","last_fullsized":"2024-09-16T17:05:36.519063+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.513689+0000","last_change":"2024-09-16T16:52:01.083490+0000","last_active":"2024-09-16T17:05:36.513689+0000","last_peered":"2024-09-16T17:05:36.513689+0000","last_clean":"2024-09-16T17:05:36.513689+0000","last_became_active":"2024-09-16T16:52:01.077074+0000","last_became_peered":"2024-09-16T16:52:01.077074+0000","last_unstale":"2024-09-16T17:05:36.513689+0000","last_undegraded":"2024-09-16T17:05:36.513689+0000","last_fullsized":"2024-09-16T17:05:36.513689+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.510812+0000","last_change":"2024-09-16T16:52:01.007501+0000","last_active":"2024-09-16T17:05:36.510812+0000","last_peered":"2024-09-16T17:05:36.510812+0000","last_clean":"2024-09-16T17:05:36.510812+0000","last_became_active":"2024-09-16T16:52:00.995826+0000","last_became_peered":"2024-09-16T16:52:00.995826+0000","last_unstale":"2024-09-16T17:05:36.510812+0000","last_undegraded":"2024-09-16T17:05:36.510812+0000","last_fullsized":"2024-09-16T17:05:36.510812+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.517971+0000","last_change":"2024-09-16T16:52:01.075449+0000","last_active":"2024-09-16T17:05:36.517971+0000","last_peered":"2024-09-16T17:05:36.517971+0000","last_clean":"2024-09-16T17:05:36.517971+0000","last_became_active":"2024-09-16T16:52:01.066170+0000","last_became_peered":"2024-09-16T16:52:01.066170+0000","last_unstale":"2024-09-16T17:05:36.517971+0000","last_undegraded":"2024-09-16T17:05:36.517971+0000","last_fullsized":"2024-09-16T17:05:36.517971+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.506231+0000","last_change":"2024-09-16T16:52:01.164718+0000","last_active":"2024-09-16T17:05:36.506231+0000","last_peered":"2024-09-16T17:05:36.506231+0000","last_clean":"2024-09-16T17:05:36.506231+0000","last_became_active":"2024-09-16T16:52:01.137358+0000","last_became_peered":"2024-09-16T16:52:01.137358+0000","last_unstale":"2024-09-16T17:05:36.506231+0000","last_undegraded":"2024-09-16T17:05:36.506231+0000","last_fullsized":"2024-09-16T17:05:36.506231+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.510218+0000","last_change":"2024-09-16T16:52:01.039514+0000","last_active":"2024-09-16T17:05:36.510218+0000","last_peered":"2024-09-16T17:05:36.510218+0000","last_clean":"2024-09-16T17:05:36.510218+0000","last_became_active":"2024-09-16T16:52:01.018449+0000","last_became_peered":"2024-09-16T16:52:01.018449+0000","last_unstale":"2024-09-16T17:05:36.510218+0000","last_undegraded":"2024-09-16T17:05:36.510218+0000","last_fullsized":"2024-09-16T17:05:36.510218+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.512348+0000","last_change":"2024-09-16T16:52:01.089282+0000","last_active":"2024-09-16T17:05:36.512348+0000","last_peered":"2024-09-16T17:05:36.512348+0000","last_clean":"2024-09-16T17:05:36.512348+0000","last_became_active":"2024-09-16T16:52:01.043446+0000","last_became_peered":"2024-09-16T16:52:01.043446+0000","last_unstale":"2024-09-16T17:05:36.512348+0000","last_undegraded":"2024-09-16T17:05:36.512348+0000","last_fullsized":"2024-09-16T17:05:36.512348+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.507845+0000","last_change":"2024-09-16T16:52:01.002820+0000","last_active":"2024-09-16T17:05:36.507845+0000","last_peered":"2024-09-16T17:05:36.507845+0000","last_clean":"2024-09-16T17:05:36.507845+0000","last_became_active":"2024-09-16T16:52:00.984993+0000","last_became_peered":"2024-09-16T16:52:00.984993+0000","last_unstale":"2024-09-16T17:05:36.507845+0000","last_undegraded":"2024-09-16T17:05:36.507845+0000","last_fullsized":"2024-09-16T17:05:36.507845+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.510725+0000","last_change":"2024-09-16T16:52:01.125926+0000","last_active":"2024-09-16T17:05:36.510725+0000","last_peered":"2024-09-16T17:05:36.510725+0000","last_clean":"2024-09-16T17:05:36.510725+0000","last_became_active":"2024-09-16T16:52:01.118033+0000","last_became_peered":"2024-09-16T16:52:01.118033+0000","last_unstale":"2024-09-16T17:05:36.510725+0000","last_undegraded":"2024-09-16T17:05:36.510725+0000","last_fullsized":"2024-09-16T17:05:36.510725+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.507372+0000","last_change":"2024-09-16T16:52:01.047718+0000","last_active":"2024-09-16T17:05:36.507372+0000","last_peered":"2024-09-16T17:05:36.507372+0000","last_clean":"2024-09-16T17:05:36.507372+0000","last_became_active":"2024-09-16T16:52:01.018199+0000","last_became_peered":"2024-09-16T16:52:01.018199+0000","last_unstale":"2024-09-16T17:05:36.507372+0000","last_undegraded":"2024-09-16T17:05:36.507372+0000","last_fullsized":"2024-09-16T17:05:36.507372+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.508775+0000","last_change":"2024-09-16T16:52:01.126951+0000","last_active":"2024-09-16T17:05:36.508775+0000","last_peered":"2024-09-16T17:05:36.508775+0000","last_clean":"2024-09-16T17:05:36.508775+0000","last_became_active":"2024-09-16T16:52:01.098860+0000","last_became_peered":"2024-09-16T16:52:01.098860+0000","last_unstale":"2024-09-16T17:05:36.508775+0000","last_undegraded":"2024-09-16T17:05:36.508775+0000","last_fullsized":"2024-09-16T17:05:36.508775+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.519261+0000","last_change":"2024-09-16T16:52:01.038538+0000","last_active":"2024-09-16T17:05:36.519261+0000","last_peered":"2024-09-16T17:05:36.519261+0000","last_clean":"2024-09-16T17:05:36.519261+0000","last_became_active":"2024-09-16T16:52:01.014800+0000","last_became_peered":"2024-09-16T16:52:01.014800+0000","last_unstale":"2024-09-16T17:05:36.519261+0000","last_undegraded":"2024-09-16T17:05:36.519261+0000","last_fullsized":"2024-09-16T17:05:36.519261+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.518720+0000","last_change":"2024-09-16T16:52:01.079983+0000","last_active":"2024-09-16T17:05:36.518720+0000","last_peered":"2024-09-16T17:05:36.518720+0000","last_clean":"2024-09-16T17:05:36.518720+0000","last_became_active":"2024-09-16T16:52:01.070554+0000","last_became_peered":"2024-09-16T16:52:01.070554+0000","last_unstale":"2024-09-16T17:05:36.518720+0000","last_undegraded":"2024-09-16T17:05:36.518720+0000","last_fullsized":"2024-09-16T17:05:36.518720+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.506105+0000","last_change":"2024-09-16T16:52:01.171432+0000","last_active":"2024-09-16T17:05:36.506105+0000","last_peered":"2024-09-16T17:05:36.506105+0000","last_clean":"2024-09-16T17:05:36.506105+0000","last_became_active":"2024-09-16T16:52:01.163260+0000","last_became_peered":"2024-09-16T16:52:01.163260+0000","last_unstale":"2024-09-16T17:05:36.506105+0000","last_undegraded":"2024-09-16T17:05:36.506105+0000","last_fullsized":"2024-09-16T17:05:36.506105+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.505722+0000","last_change":"2024-09-16T16:52:01.089266+0000","last_active":"2024-09-16T17:05:36.505722+0000","last_peered":"2024-09-16T17:05:36.505722+0000","last_clean":"2024-09-16T17:05:36.505722+0000","last_became_active":"2024-09-16T16:52:01.039791+0000","last_became_peered":"2024-09-16T16:52:01.039791+0000","last_unstale":"2024-09-16T17:05:36.505722+0000","last_undegraded":"2024-09-16T17:05:36.505722+0000","last_fullsized":"2024-09-16T17:05:36.505722+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.506637+0000","last_change":"2024-09-16T16:52:01.101751+0000","last_active":"2024-09-16T17:05:36.506637+0000","last_peered":"2024-09-16T17:05:36.506637+0000","last_clean":"2024-09-16T17:05:36.506637+0000","last_became_active":"2024-09-16T16:52:01.063909+0000","last_became_peered":"2024-09-16T16:52:01.063909+0000","last_unstale":"2024-09-16T17:05:36.506637+0000","last_undegraded":"2024-09-16T17:05:36.506637+0000","last_fullsized":"2024-09-16T17:05:36.506637+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.506783+0000","last_change":"2024-09-16T16:52:01.160111+0000","last_active":"2024-09-16T17:05:36.506783+0000","last_peered":"2024-09-16T17:05:36.506783+0000","last_clean":"2024-09-16T17:05:36.506783+0000","last_became_active":"2024-09-16T16:52:01.138167+0000","last_became_peered":"2024-09-16T16:52:01.138167+0000","last_unstale":"2024-09-16T17:05:36.506783+0000","last_undegraded":"2024-09-16T17:05:36.506783+0000","last_fullsized":"2024-09-16T17:05:36.506783+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.514011+0000","last_change":"2024-09-16T16:52:01.037689+0000","last_active":"2024-09-16T17:05:36.514011+0000","last_peered":"2024-09-16T17:05:36.514011+0000","last_clean":"2024-09-16T17:05:36.514011+0000","last_became_active":"2024-09-16T16:52:01.016490+0000","last_became_peered":"2024-09-16T16:52:01.016490+0000","last_unstale":"2024-09-16T17:05:36.514011+0000","last_undegraded":"2024-09-16T17:05:36.514011+0000","last_fullsized":"2024-09-16T17:05:36.514011+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.509057+0000","last_change":"2024-09-16T16:52:01.009029+0000","last_active":"2024-09-16T17:05:36.509057+0000","last_peered":"2024-09-16T17:05:36.509057+0000","last_clean":"2024-09-16T17:05:36.509057+0000","last_became_active":"2024-09-16T16:52:00.998521+0000","last_became_peered":"2024-09-16T16:52:00.998521+0000","last_unstale":"2024-09-16T17:05:36.509057+0000","last_undegraded":"2024-09-16T17:05:36.509057+0000","last_fullsized":"2024-09-16T17:05:36.509057+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.512621+0000","last_change":"2024-09-16T16:52:01.083905+0000","last_active":"2024-09-16T17:05:36.512621+0000","last_peered":"2024-09-16T17:05:36.512621+0000","last_clean":"2024-09-16T17:05:36.512621+0000","last_became_active":"2024-09-16T16:52:01.040747+0000","last_became_peered":"2024-09-16T16:52:01.040747+0000","last_unstale":"2024-09-16T17:05:36.512621+0000","last_undegraded":"2024-09-16T17:05:36.512621+0000","last_fullsized":"2024-09-16T17:05:36.512621+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.503679+0000","last_change":"2024-09-16T16:52:01.041092+0000","last_active":"2024-09-16T17:05:36.503679+0000","last_peered":"2024-09-16T17:05:36.503679+0000","last_clean":"2024-09-16T17:05:36.503679+0000","last_became_active":"2024-09-16T16:52:01.017647+0000","last_became_peered":"2024-09-16T16:52:01.017647+0000","last_unstale":"2024-09-16T17:05:36.503679+0000","last_undegraded":"2024-09-16T17:05:36.503679+0000","last_fullsized":"2024-09-16T17:05:36.503679+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.515505+0000","last_change":"2024-09-16T16:52:01.105516+0000","last_active":"2024-09-16T17:05:36.515505+0000","last_peered":"2024-09-16T17:05:36.515505+0000","last_clean":"2024-09-16T17:05:36.515505+0000","last_became_active":"2024-09-16T16:52:01.096609+0000","last_became_peered":"2024-09-16T16:52:01.096609+0000","last_unstale":"2024-09-16T17:05:36.515505+0000","last_undegraded":"2024-09-16T17:05:36.515505+0000","last_fullsized":"2024-09-16T17:05:36.515505+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.515469+0000","last_change":"2024-09-16T16:52:01.188616+0000","last_active":"2024-09-16T17:05:36.515469+0000","last_peered":"2024-09-16T17:05:36.515469+0000","last_clean":"2024-09-16T17:05:36.515469+0000","last_became_active":"2024-09-16T16:52:01.182688+0000","last_became_peered":"2024-09-16T16:52:01.182688+0000","last_unstale":"2024-09-16T17:05:36.515469+0000","last_undegraded":"2024-09-16T17:05:36.515469+0000","last_fullsized":"2024-09-16T17:05:36.515469+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.514399+0000","last_change":"2024-09-16T16:52:01.046742+0000","last_active":"2024-09-16T17:05:36.514399+0000","last_peered":"2024-09-16T17:05:36.514399+0000","last_clean":"2024-09-16T17:05:36.514399+0000","last_became_active":"2024-09-16T16:52:01.022683+0000","last_became_peered":"2024-09-16T16:52:01.022683+0000","last_unstale":"2024-09-16T17:05:36.514399+0000","last_undegraded":"2024-09-16T17:05:36.514399+0000","last_fullsized":"2024-09-16T17:05:36.514399+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.506358+0000","last_change":"2024-09-16T16:52:01.035066+0000","last_active":"2024-09-16T17:05:36.506358+0000","last_peered":"2024-09-16T17:05:36.506358+0000","last_clean":"2024-09-16T17:05:36.506358+0000","last_became_active":"2024-09-16T16:52:01.014432+0000","last_became_peered":"2024-09-16T16:52:01.014432+0000","last_unstale":"2024-09-16T17:05:36.506358+0000","last_undegraded":"2024-09-16T17:05:36.506358+0000","last_fullsized":"2024-09-16T17:05:36.506358+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.517663+0000","last_change":"2024-09-16T16:52:01.168350+0000","last_active":"2024-09-16T17:05:36.517663+0000","last_peered":"2024-09-16T17:05:36.517663+0000","last_clean":"2024-09-16T17:05:36.517663+0000","last_became_active":"2024-09-16T16:52:01.150691+0000","last_became_peered":"2024-09-16T16:52:01.150691+0000","last_unstale":"2024-09-16T17:05:36.517663+0000","last_undegraded":"2024-09-16T17:05:36.517663+0000","last_fullsized":"2024-09-16T17:05:36.517663+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.505254+0000","last_change":"2024-09-16T16:52:01.110296+0000","last_active":"2024-09-16T17:05:36.505254+0000","last_peered":"2024-09-16T17:05:36.505254+0000","last_clean":"2024-09-16T17:05:36.505254+0000","last_became_active":"2024-09-16T16:52:01.054274+0000","last_became_peered":"2024-09-16T16:52:01.054274+0000","last_unstale":"2024-09-16T17:05:36.505254+0000","last_undegraded":"2024-09-16T17:05:36.505254+0000","last_fullsized":"2024-09-16T17:05:36.505254+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.505682+0000","last_change":"2024-09-16T16:52:01.066153+0000","last_active":"2024-09-16T17:05:36.505682+0000","last_peered":"2024-09-16T17:05:36.505682+0000","last_clean":"2024-09-16T17:05:36.505682+0000","last_became_active":"2024-09-16T16:52:01.056754+0000","last_became_peered":"2024-09-16T16:52:01.056754+0000","last_unstale":"2024-09-16T17:05:36.505682+0000","last_undegraded":"2024-09-16T17:05:36.505682+0000","last_fullsized":"2024-09-16T17:05:36.505682+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.499656+0000","last_change":"2024-09-16T16:52:01.167360+0000","last_active":"2024-09-16T17:05:36.499656+0000","last_peered":"2024-09-16T17:05:36.499656+0000","last_clean":"2024-09-16T17:05:36.499656+0000","last_became_active":"2024-09-16T16:52:01.142598+0000","last_became_peered":"2024-09-16T16:52:01.142598+0000","last_unstale":"2024-09-16T17:05:36.499656+0000","last_undegraded":"2024-09-16T17:05:36.499656+0000","last_fullsized":"2024-09-16T17:05:36.499656+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1476,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.508718+0000","last_change":"2024-09-16T16:52:01.078153+0000","last_active":"2024-09-16T17:05:36.508718+0000","last_peered":"2024-09-16T17:05:36.508718+0000","last_clean":"2024-09-16T17:05:36.508718+0000","last_became_active":"2024-09-16T16:52:01.029529+0000","last_became_peered":"2024-09-16T16:52:01.029529+0000","last_unstale":"2024-09-16T17:05:36.508718+0000","last_undegraded":"2024-09-16T17:05:36.508718+0000","last_fullsized":"2024-09-16T17:05:36.508718+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1463,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.515851+0000","last_change":"2024-09-16T16:52:01.009380+0000","last_active":"2024-09-16T17:05:36.515851+0000","last_peered":"2024-09-16T17:05:36.515851+0000","last_clean":"2024-09-16T17:05:36.515851+0000","last_became_active":"2024-09-16T16:52:00.988610+0000","last_became_peered":"2024-09-16T16:52:00.988610+0000","last_unstale":"2024-09-16T17:05:36.515851+0000","last_undegraded":"2024-09-16T17:05:36.515851+0000","last_fullsized":"2024-09-16T17:05:36.515851+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.511846+0000","last_change":"2024-09-16T16:46:50.254602+0000","last_active":"2024-09-16T17:05:36.511846+0000","last_peered":"2024-09-16T17:05:36.511846+0000","last_clean":"2024-09-16T17:05:36.511846+0000","last_became_active":"2024-09-16T16:46:48.301220+0000","last_became_peered":"2024-09-16T16:46:48.301220+0000","last_unstale":"2024-09-16T17:05:36.511846+0000","last_undegraded":"2024-09-16T17:05:36.511846+0000","last_fullsized":"2024-09-16T17:05:36.511846+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.512291+0000","last_change":"2024-09-16T16:46:50.252865+0000","last_active":"2024-09-16T17:05:36.512291+0000","last_peered":"2024-09-16T17:05:36.512291+0000","last_clean":"2024-09-16T17:05:36.512291+0000","last_became_active":"2024-09-16T16:46:48.285243+0000","last_became_peered":"2024-09-16T16:46:48.285243+0000","last_unstale":"2024-09-16T17:05:36.512291+0000","last_undegraded":"2024-09-16T17:05:36.512291+0000","last_fullsized":"2024-09-16T17:05:36.512291+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.519749+0000","last_change":"2024-09-16T16:46:50.249574+0000","last_active":"2024-09-16T17:05:36.519749+0000","last_peered":"2024-09-16T17:05:36.519749+0000","last_clean":"2024-09-16T17:05:36.519749+0000","last_became_active":"2024-09-16T16:46:48.295184+0000","last_became_peered":"2024-09-16T16:46:48.295184+0000","last_unstale":"2024-09-16T17:05:36.519749+0000","last_undegraded":"2024-09-16T17:05:36.519749+0000","last_fullsized":"2024-09-16T17:05:36.519749+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.505784+0000","last_change":"2024-09-16T16:46:50.249064+0000","last_active":"2024-09-16T17:05:36.505784+0000","last_peered":"2024-09-16T17:05:36.505784+0000","last_clean":"2024-09-16T17:05:36.505784+0000","last_became_active":"2024-09-16T16:46:48.280354+0000","last_became_peered":"2024-09-16T16:46:48.280354+0000","last_unstale":"2024-09-16T17:05:36.505784+0000","last_undegraded":"2024-09-16T17:05:36.505784+0000","last_fullsized":"2024-09-16T17:05:36.505784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.511609+0000","last_change":"2024-09-16T16:46:50.250531+0000","last_active":"2024-09-16T17:05:36.511609+0000","last_peered":"2024-09-16T17:05:36.511609+0000","last_clean":"2024-09-16T17:05:36.511609+0000","last_became_active":"2024-09-16T16:46:48.303026+0000","last_became_peered":"2024-09-16T16:46:48.303026+0000","last_unstale":"2024-09-16T17:05:36.511609+0000","last_undegraded":"2024-09-16T17:05:36.511609+0000","last_fullsized":"2024-09-16T17:05:36.511609+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.509597+0000","last_change":"2024-09-16T16:46:50.249648+0000","last_active":"2024-09-16T17:05:36.509597+0000","last_peered":"2024-09-16T17:05:36.509597+0000","last_clean":"2024-09-16T17:05:36.509597+0000","last_became_active":"2024-09-16T16:46:48.285463+0000","last_became_peered":"2024-09-16T16:46:48.285463+0000","last_unstale":"2024-09-16T17:05:36.509597+0000","last_undegraded":"2024-09-16T17:05:36.509597+0000","last_fullsized":"2024-09-16T17:05:36.509597+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.510534+0000","last_change":"2024-09-16T16:46:50.250997+0000","last_active":"2024-09-16T17:05:36.510534+0000","last_peered":"2024-09-16T17:05:36.510534+0000","last_clean":"2024-09-16T17:05:36.510534+0000","last_became_active":"2024-09-16T16:46:48.281970+0000","last_became_peered":"2024-09-16T16:46:48.281970+0000","last_unstale":"2024-09-16T17:05:36.510534+0000","last_undegraded":"2024-09-16T17:05:36.510534+0000","last_fullsized":"2024-09-16T17:05:36.510534+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2143,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.513065+0000","last_change":"2024-09-16T16:46:50.254143+0000","last_active":"2024-09-16T17:05:36.513065+0000","last_peered":"2024-09-16T17:05:36.513065+0000","last_clean":"2024-09-16T17:05:36.513065+0000","last_became_active":"2024-09-16T16:46:48.282002+0000","last_became_peered":"2024-09-16T16:46:48.282002+0000","last_unstale":"2024-09-16T17:05:36.513065+0000","last_undegraded":"2024-09-16T17:05:36.513065+0000","last_fullsized":"2024-09-16T17:05:36.513065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2214,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-16T17:05:36.502460+0000","last_change":"2024-09-16T16:46:46.272094+0000","last_active":"2024-09-16T17:05:36.502460+0000","last_peered":"2024-09-16T17:05:36.502460+0000","last_clean":"2024-09-16T17:05:36.502460+0000","last_became_active":"2024-09-16T16:46:46.253718+0000","last_became_peered":"2024-09-16T16:46:46.253718+0000","last_unstale":"2024-09-16T17:05:36.502460+0000","last_undegraded":"2024-09-16T17:05:36.502460+0000","last_fullsized":"2024-09-16T17:05:36.502460+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.198151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.198151+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.198151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214180847616,"internally_reserved":0,"allocated":30646272,"data_stored":30646272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214180847616,"internally_reserved":0,"allocated":30646272,"data_stored":30646272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53544812544,"internally_reserved":0,"allocated":8060928,"data_stored":8060928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7872,"kb_used_data":7872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289856,"statfs":{"total":53552873472,"available":53544812544,"internally_reserved":0,"allocated":8060928,"data_stored":8060928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6900,"kb_used_data":6900,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290828,"statfs":{"total":53552873472,"available":53545807872,"internally_reserved":0,"allocated":7065600,"data_stored":7065600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6752,"kb_used_data":6752,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290976,"statfs":{"total":53552873472,"available":53545959424,"internally_reserved":0,"allocated":6914048,"data_stored":6914048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8404,"kb_used_data":8404,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289324,"statfs":{"total":53552873472,"available":53544267776,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53544812544,"internally_reserved":0,"allocated":8060928,"data_stored":8060928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53544267776,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53545959424,"internally_reserved":0,"allocated":6914048,"data_stored":6914048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53545807872,"internally_reserved":0,"allocated":7065600,"data_stored":7065600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53544812544,"internally_reserved":0,"allocated":8060928,"data_stored":8060928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":53552873472,"available":53544267776,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":53552873472,"available":53545959424,"internally_reserved":0,"allocated":6914048,"data_stored":6914048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":53552873472,"available":53545807872,"internally_reserved":0,"allocated":7065600,"data_stored":7065600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":53552873472,"available":53544812544,"internally_reserved":0,"allocated":8060928,"data_stored":8060928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:06:10.128 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T17:06:10.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.230+0000 7f9dc84fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.234+0000 7f9dc84fd640 1 Processor -- start 2024-09-16T17:06:10.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.234+0000 7f9dc84fd640 1 -- start start 2024-09-16T17:06:10.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.235+0000 7f9dc84fd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9dc009daa0 0x7f9dc009ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:10.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.235+0000 7f9dc84fd640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dc012f190 con 0x7f9dc009cfa0 2024-09-16T17:06:10.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.235+0000 7f9dc84fd640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f9dc00706a0 con 0x7f9dc009daa0 2024-09-16T17:06:10.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.236+0000 7f9dc6299640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9dc009daa0 0x7f9dc009ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:10.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.236+0000 7f9dc6299640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9dc009daa0 0x7f9dc009ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37826/0 (socket says 172.21.15.89:37826) 2024-09-16T17:06:10.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.236+0000 7f9dc6299640 1 -- 172.21.15.89:0/3075844795 learned_addr learned my addr 172.21.15.89:0/3075844795 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:10.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.236+0000 7f9dc5a98640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9dc009cfa0 0x7f9dc0131770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:45798/0 (socket says 172.21.15.89:45798) 2024-09-16T17:06:10.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.236+0000 7f9dc6299640 1 -- 172.21.15.89:0/3075844795 >> v1:172.21.15.89:6789/0 conn(0x7f9dc009cfa0 legacy=0x7f9dc0131770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:10.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.236+0000 7f9dc6299640 1 -- 172.21.15.89:0/3075844795 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc012e970 con 0x7f9dc009daa0 2024-09-16T17:06:10.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.236+0000 7f9dc6299640 1 --2- 172.21.15.89:0/3075844795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dc009daa0 0x7f9dc009ca60 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e414dd189b409ed server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:10.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.236+0000 7f9dc5297640 1 -- 172.21.15.89:0/3075844795 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9dbc009e50 con 0x7f9dc009daa0 2024-09-16T17:06:10.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.236+0000 7f9dc5297640 1 -- 172.21.15.89:0/3075844795 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9dbc00f340 con 0x7f9dc009daa0 2024-09-16T17:06:10.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.236+0000 7f9dc5297640 1 -- 172.21.15.89:0/3075844795 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9dbc00f5e0 con 0x7f9dc009daa0 2024-09-16T17:06:10.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.237+0000 7f9dc84fd640 1 -- 172.21.15.89:0/3075844795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dc009daa0 msgr2=0x7f9dc009ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:10.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.237+0000 7f9dc84fd640 1 --2- 172.21.15.89:0/3075844795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dc009daa0 0x7f9dc009ca60 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:10.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.237+0000 7f9dc84fd640 1 -- 172.21.15.89:0/3075844795 shutdown_connections 2024-09-16T17:06:10.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.237+0000 7f9dc84fd640 1 --2- 172.21.15.89:0/3075844795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dc009daa0 0x7f9dc009ca60 unknown :-1 s=CLOSED pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:10.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.237+0000 7f9dc84fd640 1 -- 172.21.15.89:0/3075844795 >> 172.21.15.89:0/3075844795 conn(0x7f9dc0069d60 msgr2=0x7f9dc009e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:10.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.237+0000 7f9dc84fd640 1 -- 172.21.15.89:0/3075844795 shutdown_connections 2024-09-16T17:06:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.237+0000 7f9dc84fd640 1 -- 172.21.15.89:0/3075844795 wait complete. 2024-09-16T17:06:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.237+0000 7f9dc84fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.239+0000 7f9dc84fd640 1 Processor -- start 2024-09-16T17:06:10.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.239+0000 7f9dc84fd640 1 -- start start 2024-09-16T17:06:10.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.240+0000 7f9dc84fd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dc009cfa0 0x7f9dc011adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:10.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.240+0000 7f9dc84fd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc011c100 con 0x7f9dc009cfa0 2024-09-16T17:06:10.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.240+0000 7f9dc6299640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dc009cfa0 0x7f9dc011adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:10.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.240+0000 7f9dc6299640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dc009cfa0 0x7f9dc011adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37834/0 (socket says 172.21.15.89:37834) 2024-09-16T17:06:10.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.240+0000 7f9dc6299640 1 -- 172.21.15.89:0/3612086066 learned_addr learned my addr 172.21.15.89:0/3612086066 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:10.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.240+0000 7f9dc6299640 1 -- 172.21.15.89:0/3612086066 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc012bf80 con 0x7f9dc009cfa0 2024-09-16T17:06:10.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.240+0000 7f9dc6299640 1 --2- 172.21.15.89:0/3612086066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dc009cfa0 0x7f9dc011adc0 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:10.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.240+0000 7f9db6ffd640 1 -- 172.21.15.89:0/3612086066 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9dbc013440 con 0x7f9dc009cfa0 2024-09-16T17:06:10.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.240+0000 7f9db6ffd640 1 -- 172.21.15.89:0/3612086066 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9dbc0135a0 con 0x7f9dc009cfa0 2024-09-16T17:06:10.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.240+0000 7f9dc84fd640 1 -- 172.21.15.89:0/3612086066 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc011eda0 con 0x7f9dc009cfa0 2024-09-16T17:06:10.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.240+0000 7f9db6ffd640 1 -- 172.21.15.89:0/3612086066 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9dbc013840 con 0x7f9dc009cfa0 2024-09-16T17:06:10.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.240+0000 7f9dc84fd640 1 -- 172.21.15.89:0/3612086066 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc00a3190 con 0x7f9dc009cfa0 2024-09-16T17:06:10.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.241+0000 7f9db6ffd640 1 -- 172.21.15.89:0/3612086066 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f9dbc0139f0 con 0x7f9dc009cfa0 2024-09-16T17:06:10.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.241+0000 7f9db6ffd640 1 --2- 172.21.15.89:0/3612086066 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f9da403e930 0x7f9da4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:10.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.241+0000 7f9db6ffd640 1 -- 172.21.15.89:0/3612086066 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(726..726 src has 406..726) ==== 3431+0+0 (crc 0 0 0) 0x7f9dbc051ac0 con 0x7f9dc009cfa0 2024-09-16T17:06:10.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.241+0000 7f9dc84fd640 1 -- 172.21.15.89:0/3612086066 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc009ea40 con 0x7f9dc009cfa0 2024-09-16T17:06:10.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.242+0000 7f9dc5a98640 1 --2- 172.21.15.89:0/3612086066 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f9da403e930 0x7f9da4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:10.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.242+0000 7f9dc5a98640 1 --2- 172.21.15.89:0/3612086066 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f9da403e930 0x7f9da4040e40 crc :-1 s=READY pgs=3878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:10.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.247+0000 7f9db6ffd640 1 -- 172.21.15.89:0/3612086066 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f9dbc0103b0 con 0x7f9dc009cfa0 2024-09-16T17:06:10.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.422+0000 7f9dc84fd640 1 -- 172.21.15.89:0/3612086066 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9dc01328a0 con 0x7f9dc009cfa0 2024-09-16T17:06:10.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.423+0000 7f9db6ffd640 1 -- 172.21.15.89:0/3612086066 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v726) ==== 74+0+11247 (crc 0 0 0) 0x7f9dc01328a0 con 0x7f9dc009cfa0 2024-09-16T17:06:10.424 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T17:06:10.424 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":726,"fsid":"747238a8-71dc-4442-98b8-945fe8c55201","created":"2024-09-16T16:46:36.683580+0000","modified":"2024-09-16T17:06:08.472625+0000","last_up_change":"2024-09-16T16:46:43.196279+0000","last_in_change":"2024-09-16T16:46:38.791805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":200,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:45.169648+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:46:46.943517+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":75,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-09-16T16:51:58.966368+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"240","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb249ec8-d1ab-4204-b3c2-71a37e34be86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":713,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6801","nonce":3499031688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":3499031688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":3499031688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6807","nonce":3499031688}]},"public_addr":"172.21.15.89:6801/3499031688","cluster_addr":"172.21.15.89:6800/3499031688","heartbeat_back_addr":"172.21.15.89:6806/3499031688","heartbeat_front_addr":"172.21.15.89:6807/3499031688","state":["exists","up"]},{"osd":1,"uuid":"e2f9a1fc-171f-41e1-93e0-7415da80187d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":713,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6803","nonce":245700216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":245700216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6805","nonce":245700216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":245700216}]},"public_addr":"172.21.15.89:6803/245700216","cluster_addr":"172.21.15.89:6802/245700216","heartbeat_back_addr":"172.21.15.89:6805/245700216","heartbeat_front_addr":"172.21.15.89:6804/245700216","state":["exists","up"]},{"osd":2,"uuid":"e95520d6-1eb4-43a1-b6db-21fe2f976fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":713,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":229775330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":229775330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":229775330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":229775330}]},"public_addr":"172.21.15.177:6806/229775330","cluster_addr":"172.21.15.177:6805/229775330","heartbeat_back_addr":"172.21.15.177:6814/229775330","heartbeat_front_addr":"172.21.15.177:6813/229775330","state":["exists","up"]},{"osd":3,"uuid":"8c090f0a-e303-4058-bef0-2f9bfc8c6a6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":713,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6807","nonce":75130198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":75130198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":75130198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":75130198}]},"public_addr":"172.21.15.177:6807/75130198","cluster_addr":"172.21.15.177:6804/75130198","heartbeat_back_addr":"172.21.15.177:6810/75130198","heartbeat_front_addr":"172.21.15.177:6809/75130198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":100,"snaps":[{"begin":1,"length":4}]},{"pool":101,"snaps":[{"begin":2,"length":4},{"begin":7,"length":2}]},{"pool":102,"snaps":[{"begin":1,"length":6}]},{"pool":103,"snaps":[{"begin":2,"length":9},{"begin":14,"length":1}]},{"pool":104,"snaps":[{"begin":2,"length":1}]},{"pool":179,"snaps":[{"begin":1,"length":1}]},{"pool":180,"snaps":[{"begin":1,"length":1}]},{"pool":182,"snaps":[{"begin":1,"length":1}]},{"pool":183,"snaps":[{"begin":1,"length":2}]},{"pool":184,"snaps":[{"begin":3,"length":1}]},{"pool":187,"snaps":[{"begin":2,"length":2}]},{"pool":189,"snaps":[{"begin":3,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T17:06:10.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.426+0000 7f9dc84fd640 1 -- 172.21.15.89:0/3612086066 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f9da403e930 msgr2=0x7f9da4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:10.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.426+0000 7f9dc84fd640 1 --2- 172.21.15.89:0/3612086066 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f9da403e930 0x7f9da4040e40 crc :-1 s=READY pgs=3878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:10.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.426+0000 7f9dc84fd640 1 -- 172.21.15.89:0/3612086066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dc009cfa0 msgr2=0x7f9dc011adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:10.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.426+0000 7f9dc84fd640 1 --2- 172.21.15.89:0/3612086066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dc009cfa0 0x7f9dc011adc0 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:10.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.426+0000 7f9dc84fd640 1 -- 172.21.15.89:0/3612086066 shutdown_connections 2024-09-16T17:06:10.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.426+0000 7f9dc84fd640 1 --2- 172.21.15.89:0/3612086066 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f9da403e930 0x7f9da4040e40 unknown :-1 s=CLOSED pgs=3878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:10.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.426+0000 7f9dc84fd640 1 --2- 172.21.15.89:0/3612086066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9dc009cfa0 0x7f9dc011adc0 unknown :-1 s=CLOSED pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:10.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.426+0000 7f9dc84fd640 1 -- 172.21.15.89:0/3612086066 >> 172.21.15.89:0/3612086066 conn(0x7f9dc0069d60 msgr2=0x7f9dc00a15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:10.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.426+0000 7f9dc84fd640 1 -- 172.21.15.89:0/3612086066 shutdown_connections 2024-09-16T17:06:10.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:10.426+0000 7f9dc84fd640 1 -- 172.21.15.89:0/3612086066 wait complete. 2024-09-16T17:06:11.439 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T17:06:11.439 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:06:11.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.553+0000 7f672c111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:11.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.562+0000 7f672c111640 1 Processor -- start 2024-09-16T17:06:11.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.562+0000 7f672c111640 1 -- start start 2024-09-16T17:06:11.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.563+0000 7f672c111640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f672409ec50 0x7f672406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:11.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.564+0000 7f672c111640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67240a0d00 con 0x7f672406d380 2024-09-16T17:06:11.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.564+0000 7f672c111640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f67240a0a30 con 0x7f672409ec50 2024-09-16T17:06:11.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.564+0000 7f6729ead640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f672409ec50 0x7f672406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:11.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.564+0000 7f6729ead640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f672409ec50 0x7f672406ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37842/0 (socket says 172.21.15.89:37842) 2024-09-16T17:06:11.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.564+0000 7f67296ac640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f672406d380 0x7f672412ffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:45802/0 (socket says 172.21.15.89:45802) 2024-09-16T17:06:11.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.564+0000 7f6729ead640 1 -- 172.21.15.89:0/1765575865 learned_addr learned my addr 172.21.15.89:0/1765575865 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:11.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.564+0000 7f6729ead640 1 -- 172.21.15.89:0/1765575865 >> v1:172.21.15.89:6789/0 conn(0x7f672406d380 legacy=0x7f672412ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:11.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.564+0000 7f6729ead640 1 -- 172.21.15.89:0/1765575865 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67240710b0 con 0x7f672409ec50 2024-09-16T17:06:11.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.564+0000 7f6728eab640 1 -- 172.21.15.89:0/1765575865 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 27554478 0 0) 0x7f67240a0d00 con 0x7f672406d380 2024-09-16T17:06:11.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.564+0000 7f6729ead640 1 --2- 172.21.15.89:0/1765575865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672409ec50 0x7f672406ce40 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd573655fc0719fa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:11.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.564+0000 7f6728eab640 1 -- 172.21.15.89:0/1765575865 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f672000e040 con 0x7f672409ec50 2024-09-16T17:06:11.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.564+0000 7f6728eab640 1 -- 172.21.15.89:0/1765575865 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f67200091e0 con 0x7f672409ec50 2024-09-16T17:06:11.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.564+0000 7f6728eab640 1 -- 172.21.15.89:0/1765575865 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6720007730 con 0x7f672409ec50 2024-09-16T17:06:11.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.565+0000 7f672c111640 1 -- 172.21.15.89:0/1765575865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672409ec50 msgr2=0x7f672406ce40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:11.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.565+0000 7f672c111640 1 --2- 172.21.15.89:0/1765575865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672409ec50 0x7f672406ce40 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:11.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.565+0000 7f672c111640 1 -- 172.21.15.89:0/1765575865 shutdown_connections 2024-09-16T17:06:11.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.565+0000 7f672c111640 1 --2- 172.21.15.89:0/1765575865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672409ec50 0x7f672406ce40 unknown :-1 s=CLOSED pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:11.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.565+0000 7f672c111640 1 -- 172.21.15.89:0/1765575865 >> 172.21.15.89:0/1765575865 conn(0x7f6724069d10 msgr2=0x7f672409f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:11.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.565+0000 7f672c111640 1 -- 172.21.15.89:0/1765575865 shutdown_connections 2024-09-16T17:06:11.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.565+0000 7f672c111640 1 -- 172.21.15.89:0/1765575865 wait complete. 2024-09-16T17:06:11.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.565+0000 7f672c111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:11.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.567+0000 7f672c111640 1 Processor -- start 2024-09-16T17:06:11.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.567+0000 7f672c111640 1 -- start start 2024-09-16T17:06:11.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.568+0000 7f672c111640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672406d380 0x7f672411cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:11.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.568+0000 7f672c111640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f672411df80 con 0x7f672406d380 2024-09-16T17:06:11.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.568+0000 7f6729ead640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672406d380 0x7f672411cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:11.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.568+0000 7f6729ead640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672406d380 0x7f672411cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37856/0 (socket says 172.21.15.89:37856) 2024-09-16T17:06:11.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.568+0000 7f6729ead640 1 -- 172.21.15.89:0/142342793 learned_addr learned my addr 172.21.15.89:0/142342793 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:11.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.568+0000 7f6729ead640 1 -- 172.21.15.89:0/142342793 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6724120b90 con 0x7f672406d380 2024-09-16T17:06:11.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.568+0000 7f6729ead640 1 --2- 172.21.15.89:0/142342793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672406d380 0x7f672411cc40 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:11.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.568+0000 7f671a7fc640 1 -- 172.21.15.89:0/142342793 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f672000e040 con 0x7f672406d380 2024-09-16T17:06:11.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.568+0000 7f671a7fc640 1 -- 172.21.15.89:0/142342793 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f67200128e0 con 0x7f672406d380 2024-09-16T17:06:11.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.568+0000 7f672c111640 1 -- 172.21.15.89:0/142342793 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f672411e630 con 0x7f672406d380 2024-09-16T17:06:11.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.568+0000 7f671a7fc640 1 -- 172.21.15.89:0/142342793 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6720012b80 con 0x7f672406d380 2024-09-16T17:06:11.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.568+0000 7f672c111640 1 -- 172.21.15.89:0/142342793 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f672411f450 con 0x7f672406d380 2024-09-16T17:06:11.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.569+0000 7f672c111640 1 -- 172.21.15.89:0/142342793 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f672406ce40 con 0x7f672406d380 2024-09-16T17:06:11.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.569+0000 7f671a7fc640 1 -- 172.21.15.89:0/142342793 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6720012d30 con 0x7f672406d380 2024-09-16T17:06:11.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.570+0000 7f671a7fc640 1 --2- 172.21.15.89:0/142342793 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f670803e930 0x7f6708040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:11.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.570+0000 7f671a7fc640 1 -- 172.21.15.89:0/142342793 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(726..726 src has 406..726) ==== 3431+0+0 (crc 0 0 0) 0x7f6720050f80 con 0x7f672406d380 2024-09-16T17:06:11.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.570+0000 7f671a7fc640 1 --2- 172.21.15.89:0/142342793 >> v2:172.21.15.89:6801/3499031688 conn(0x7f6708044ad0 0x7f6708046fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:11.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.570+0000 7f671a7fc640 1 -- 172.21.15.89:0/142342793 --> v2:172.21.15.89:6801/3499031688 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6708047650 con 0x7f6708044ad0 2024-09-16T17:06:11.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.570+0000 7f671a7fc640 1 -- 172.21.15.89:0/142342793 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=726) ==== 24+0+0 (crc 0 0 0) 0x7f67200533f0 con 0x7f672406d380 2024-09-16T17:06:11.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.570+0000 7f67296ac640 1 --2- 172.21.15.89:0/142342793 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f670803e930 0x7f6708040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:11.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.571+0000 7f67296ac640 1 --2- 172.21.15.89:0/142342793 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f670803e930 0x7f6708040e40 crc :-1 s=READY pgs=3879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:11.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.571+0000 7f672a6ae640 1 --2- 172.21.15.89:0/142342793 >> v2:172.21.15.89:6801/3499031688 conn(0x7f6708044ad0 0x7f6708046fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:06:11.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.574+0000 7f672a6ae640 1 --2- 172.21.15.89:0/142342793 >> v2:172.21.15.89:6801/3499031688 conn(0x7f6708044ad0 0x7f6708046fc0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:11.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.576+0000 7f671a7fc640 1 -- 172.21.15.89:0/142342793 <== osd.0 v2:172.21.15.89:6801/3499031688 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f6708047650 con 0x7f6708044ad0 2024-09-16T17:06:11.580 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.579+0000 7f672c111640 1 -- 172.21.15.89:0/142342793 --> v2:172.21.15.89:6801/3499031688 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f672406d790 con 0x7f6708044ad0 2024-09-16T17:06:11.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.581+0000 7f671a7fc640 1 -- 172.21.15.89:0/142342793 <== osd.0 v2:172.21.15.89:6801/3499031688 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f672406d790 con 0x7f6708044ad0 2024-09-16T17:06:11.582 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-16T17:06:11.582 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "" 2024-09-16T17:06:11.582 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-16T17:06:11.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.581+0000 7f672c111640 1 -- 172.21.15.89:0/142342793 >> v2:172.21.15.89:6801/3499031688 conn(0x7f6708044ad0 msgr2=0x7f6708046fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:11.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.581+0000 7f672c111640 1 --2- 172.21.15.89:0/142342793 >> v2:172.21.15.89:6801/3499031688 conn(0x7f6708044ad0 0x7f6708046fc0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:11.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.581+0000 7f672c111640 1 -- 172.21.15.89:0/142342793 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f670803e930 msgr2=0x7f6708040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:11.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.581+0000 7f672c111640 1 --2- 172.21.15.89:0/142342793 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f670803e930 0x7f6708040e40 crc :-1 s=READY pgs=3879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:11.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.581+0000 7f672c111640 1 -- 172.21.15.89:0/142342793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672406d380 msgr2=0x7f672411cc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:11.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.581+0000 7f672c111640 1 --2- 172.21.15.89:0/142342793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672406d380 0x7f672411cc40 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:11.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.581+0000 7f672c111640 1 -- 172.21.15.89:0/142342793 shutdown_connections 2024-09-16T17:06:11.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.581+0000 7f672c111640 1 --2- 172.21.15.89:0/142342793 >> v2:172.21.15.89:6801/3499031688 conn(0x7f6708044ad0 0x7f6708046fc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:11.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.581+0000 7f672c111640 1 --2- 172.21.15.89:0/142342793 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f670803e930 0x7f6708040e40 unknown :-1 s=CLOSED pgs=3879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:11.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.581+0000 7f672c111640 1 --2- 172.21.15.89:0/142342793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f672406d380 0x7f672411cc40 unknown :-1 s=CLOSED pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:11.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.581+0000 7f672c111640 1 -- 172.21.15.89:0/142342793 >> 172.21.15.89:0/142342793 conn(0x7f6724069d10 msgr2=0x7f67240a2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:11.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.581+0000 7f672c111640 1 -- 172.21.15.89:0/142342793 shutdown_connections 2024-09-16T17:06:11.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.581+0000 7f672c111640 1 -- 172.21.15.89:0/142342793 wait complete. 2024-09-16T17:06:11.593 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T17:06:11.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.694+0000 7f77bdeac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:11.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.700+0000 7f77bdeac640 1 Processor -- start 2024-09-16T17:06:11.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.700+0000 7f77bdeac640 1 -- start start 2024-09-16T17:06:11.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.701+0000 7f77bdeac640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f77b809daa0 0x7f77b809ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:11.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.701+0000 7f77bdeac640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b812f190 con 0x7f77b809cfa0 2024-09-16T17:06:11.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.701+0000 7f77bdeac640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f77b80706a0 con 0x7f77b809daa0 2024-09-16T17:06:11.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.702+0000 7f77b77fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f77b809daa0 0x7f77b809ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:11.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.702+0000 7f77b77fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f77b809daa0 0x7f77b809ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37870/0 (socket says 172.21.15.89:37870) 2024-09-16T17:06:11.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.702+0000 7f77b6ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f77b809cfa0 0x7f77b8131770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:45812/0 (socket says 172.21.15.89:45812) 2024-09-16T17:06:11.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.702+0000 7f77b77fe640 1 -- 172.21.15.89:0/1586442188 learned_addr learned my addr 172.21.15.89:0/1586442188 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:11.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.702+0000 7f77b77fe640 1 -- 172.21.15.89:0/1586442188 >> v1:172.21.15.89:6789/0 conn(0x7f77b809cfa0 legacy=0x7f77b8131770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:11.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.702+0000 7f77b77fe640 1 -- 172.21.15.89:0/1586442188 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b812e970 con 0x7f77b809daa0 2024-09-16T17:06:11.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.702+0000 7f77b77fe640 1 --2- 172.21.15.89:0/1586442188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77b809daa0 0x7f77b809ca60 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3208f8f40dfd8927 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:11.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.702+0000 7f77b67fc640 1 -- 172.21.15.89:0/1586442188 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f77a800f040 con 0x7f77b809daa0 2024-09-16T17:06:11.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.702+0000 7f77b67fc640 1 -- 172.21.15.89:0/1586442188 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f77a800a1e0 con 0x7f77b809daa0 2024-09-16T17:06:11.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.702+0000 7f77b67fc640 1 -- 172.21.15.89:0/1586442188 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f77a8008710 con 0x7f77b809daa0 2024-09-16T17:06:11.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.703+0000 7f77bdeac640 1 -- 172.21.15.89:0/1586442188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77b809daa0 msgr2=0x7f77b809ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:11.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.703+0000 7f77bdeac640 1 --2- 172.21.15.89:0/1586442188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77b809daa0 0x7f77b809ca60 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:11.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.703+0000 7f77bdeac640 1 -- 172.21.15.89:0/1586442188 shutdown_connections 2024-09-16T17:06:11.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.703+0000 7f77bdeac640 1 --2- 172.21.15.89:0/1586442188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77b809daa0 0x7f77b809ca60 unknown :-1 s=CLOSED pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:11.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.703+0000 7f77bdeac640 1 -- 172.21.15.89:0/1586442188 >> 172.21.15.89:0/1586442188 conn(0x7f77b8069d60 msgr2=0x7f77b809e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:11.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.703+0000 7f77bdeac640 1 -- 172.21.15.89:0/1586442188 shutdown_connections 2024-09-16T17:06:11.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.703+0000 7f77bdeac640 1 -- 172.21.15.89:0/1586442188 wait complete. 2024-09-16T17:06:11.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.703+0000 7f77bdeac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:11.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.705+0000 7f77bdeac640 1 Processor -- start 2024-09-16T17:06:11.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.705+0000 7f77bdeac640 1 -- start start 2024-09-16T17:06:11.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.706+0000 7f77bdeac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77b809cfa0 0x7f77b811ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:11.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.706+0000 7f77bdeac640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f77b811e870 con 0x7f77b809cfa0 2024-09-16T17:06:11.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.706+0000 7f77b77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77b809cfa0 0x7f77b811ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:11.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.706+0000 7f77b77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77b809cfa0 0x7f77b811ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37880/0 (socket says 172.21.15.89:37880) 2024-09-16T17:06:11.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.706+0000 7f77b77fe640 1 -- 172.21.15.89:0/2753310178 learned_addr learned my addr 172.21.15.89:0/2753310178 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:11.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.706+0000 7f77b77fe640 1 -- 172.21.15.89:0/2753310178 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b811f8f0 con 0x7f77b809cfa0 2024-09-16T17:06:11.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.706+0000 7f77b77fe640 1 --2- 172.21.15.89:0/2753310178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77b809cfa0 0x7f77b811ced0 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:11.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.706+0000 7f779ffff640 1 -- 172.21.15.89:0/2753310178 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f77a800f040 con 0x7f77b809cfa0 2024-09-16T17:06:11.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.706+0000 7f779ffff640 1 -- 172.21.15.89:0/2753310178 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f77a800a5e0 con 0x7f77b809cfa0 2024-09-16T17:06:11.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.706+0000 7f77bdeac640 1 -- 172.21.15.89:0/2753310178 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77b812bf80 con 0x7f77b809cfa0 2024-09-16T17:06:11.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.706+0000 7f779ffff640 1 -- 172.21.15.89:0/2753310178 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f77a8007a00 con 0x7f77b809cfa0 2024-09-16T17:06:11.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.707+0000 7f77bdeac640 1 -- 172.21.15.89:0/2753310178 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77b811f150 con 0x7f77b809cfa0 2024-09-16T17:06:11.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.708+0000 7f77bdeac640 1 -- 172.21.15.89:0/2753310178 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b812e1f0 con 0x7f77b809cfa0 2024-09-16T17:06:11.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.708+0000 7f779ffff640 1 -- 172.21.15.89:0/2753310178 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f77a8012040 con 0x7f77b809cfa0 2024-09-16T17:06:11.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.708+0000 7f779ffff640 1 --2- 172.21.15.89:0/2753310178 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f77a403e930 0x7f77a4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:11.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.708+0000 7f779ffff640 1 -- 172.21.15.89:0/2753310178 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(726..726 src has 406..726) ==== 3431+0+0 (crc 0 0 0) 0x7f77a8051380 con 0x7f77b809cfa0 2024-09-16T17:06:11.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.708+0000 7f77b6ffd640 1 --2- 172.21.15.89:0/2753310178 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f77a403e930 0x7f77a4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:11.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.709+0000 7f77b6ffd640 1 --2- 172.21.15.89:0/2753310178 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f77a403e930 0x7f77a4040e40 crc :-1 s=READY pgs=3880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:11.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.713+0000 7f779ffff640 1 -- 172.21.15.89:0/2753310178 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f77a80114b0 con 0x7f77b809cfa0 2024-09-16T17:06:11.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.888+0000 7f77bdeac640 1 -- 172.21.15.89:0/2753310178 --> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f77b806f860 con 0x7f77a403e930 2024-09-16T17:06:11.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.889+0000 7f779ffff640 1 -- 172.21.15.89:0/2753310178 <== mgr.4099 v2:172.21.15.177:6800/1212166405 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f77ac001270 con 0x7f77a403e930 2024-09-16T17:06:11.890 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T17:06:11.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.891+0000 7f77bdeac640 1 -- 172.21.15.89:0/2753310178 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f77a403e930 msgr2=0x7f77a4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:11.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.891+0000 7f77bdeac640 1 --2- 172.21.15.89:0/2753310178 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f77a403e930 0x7f77a4040e40 crc :-1 s=READY pgs=3880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:11.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.891+0000 7f77bdeac640 1 -- 172.21.15.89:0/2753310178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77b809cfa0 msgr2=0x7f77b811ced0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:11.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.891+0000 7f77bdeac640 1 --2- 172.21.15.89:0/2753310178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77b809cfa0 0x7f77b811ced0 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:11.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.891+0000 7f77bdeac640 1 -- 172.21.15.89:0/2753310178 shutdown_connections 2024-09-16T17:06:11.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.891+0000 7f77bdeac640 1 --2- 172.21.15.89:0/2753310178 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f77a403e930 0x7f77a4040e40 unknown :-1 s=CLOSED pgs=3880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:11.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.891+0000 7f77bdeac640 1 --2- 172.21.15.89:0/2753310178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77b809cfa0 0x7f77b811ced0 unknown :-1 s=CLOSED pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:11.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.891+0000 7f77bdeac640 1 -- 172.21.15.89:0/2753310178 >> 172.21.15.89:0/2753310178 conn(0x7f77b8069d60 msgr2=0x7f77b809eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:11.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.891+0000 7f77bdeac640 1 -- 172.21.15.89:0/2753310178 shutdown_connections 2024-09-16T17:06:11.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:11.891+0000 7f77bdeac640 1 -- 172.21.15.89:0/2753310178 wait complete. 2024-09-16T17:06:11.913 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T17:06:11.913 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:06:12.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.026+0000 7fc63acd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:12.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.035+0000 7fc63acd1640 1 Processor -- start 2024-09-16T17:06:12.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.036+0000 7fc63acd1640 1 -- start start 2024-09-16T17:06:12.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.037+0000 7fc63acd1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc6341386c0 0x7fc63413aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.037+0000 7fc63acd1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc634132e30 con 0x7fc634132310 2024-09-16T17:06:12.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.037+0000 7fc63acd1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7fc6340a0f40 con 0x7fc6341386c0 2024-09-16T17:06:12.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.037+0000 7fc633fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc6341386c0 0x7fc63413aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:12.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.037+0000 7fc638a6d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc634132310 0x7fc634132720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:45816/0 (socket says 172.21.15.89:45816) 2024-09-16T17:06:12.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.037+0000 7fc638a6d640 1 -- 172.21.15.89:0/913336188 learned_addr learned my addr 172.21.15.89:0/913336188 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:06:12.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.037+0000 7fc633fff640 1 -- 172.21.15.89:0/913336188 >> v1:172.21.15.89:6789/0 conn(0x7fc634132310 legacy=0x7fc634132720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.037+0000 7fc633fff640 1 -- 172.21.15.89:0/913336188 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63409ed40 con 0x7fc6341386c0 2024-09-16T17:06:12.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.037+0000 7fc633fff640 1 --2- 172.21.15.89:0/913336188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6341386c0 0x7fc63413aae0 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100e3eb3ee348e27 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.037+0000 7fc6337fe640 1 -- 172.21.15.89:0/913336188 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc628009d90 con 0x7fc6341386c0 2024-09-16T17:06:12.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.037+0000 7fc6337fe640 1 -- 172.21.15.89:0/913336188 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc62800e230 con 0x7fc6341386c0 2024-09-16T17:06:12.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.037+0000 7fc6337fe640 1 -- 172.21.15.89:0/913336188 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc62800e4d0 con 0x7fc6341386c0 2024-09-16T17:06:12.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.038+0000 7fc63acd1640 1 -- 172.21.15.89:0/913336188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6341386c0 msgr2=0x7fc63413aae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.038+0000 7fc63acd1640 1 --2- 172.21.15.89:0/913336188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6341386c0 0x7fc63413aae0 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.038+0000 7fc63acd1640 1 -- 172.21.15.89:0/913336188 shutdown_connections 2024-09-16T17:06:12.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.038+0000 7fc63acd1640 1 --2- 172.21.15.89:0/913336188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6341386c0 0x7fc63413aae0 unknown :-1 s=CLOSED pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.038+0000 7fc63acd1640 1 -- 172.21.15.89:0/913336188 >> 172.21.15.89:0/913336188 conn(0x7fc634069d10 msgr2=0x7fc63409f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:12.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.038+0000 7fc63acd1640 1 -- 172.21.15.89:0/913336188 shutdown_connections 2024-09-16T17:06:12.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.038+0000 7fc63acd1640 1 -- 172.21.15.89:0/913336188 wait complete. 2024-09-16T17:06:12.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.038+0000 7fc63acd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:12.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.040+0000 7fc63acd1640 1 Processor -- start 2024-09-16T17:06:12.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.040+0000 7fc63acd1640 1 -- start start 2024-09-16T17:06:12.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.041+0000 7fc63acd1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc634132310 0x7fc63411edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.041+0000 7fc63acd1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc634120290 con 0x7fc634132310 2024-09-16T17:06:12.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.041+0000 7fc638a6d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc634132310 0x7fc63411edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:12.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.041+0000 7fc638a6d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc634132310 0x7fc63411edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37890/0 (socket says 172.21.15.89:37890) 2024-09-16T17:06:12.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.041+0000 7fc638a6d640 1 -- 172.21.15.89:0/2181543188 learned_addr learned my addr 172.21.15.89:0/2181543188 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:12.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.041+0000 7fc638a6d640 1 -- 172.21.15.89:0/2181543188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc634122d70 con 0x7fc634132310 2024-09-16T17:06:12.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.041+0000 7fc638a6d640 1 --2- 172.21.15.89:0/2181543188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc634132310 0x7fc63411edf0 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.041+0000 7fc6317fa640 1 -- 172.21.15.89:0/2181543188 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc624005a60 con 0x7fc634132310 2024-09-16T17:06:12.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.042+0000 7fc6317fa640 1 -- 172.21.15.89:0/2181543188 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc624005bc0 con 0x7fc634132310 2024-09-16T17:06:12.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.042+0000 7fc63acd1640 1 -- 172.21.15.89:0/2181543188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc634137800 con 0x7fc634132310 2024-09-16T17:06:12.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.042+0000 7fc6317fa640 1 -- 172.21.15.89:0/2181543188 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc624005e60 con 0x7fc634132310 2024-09-16T17:06:12.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.042+0000 7fc63acd1640 1 -- 172.21.15.89:0/2181543188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc634122a40 con 0x7fc634132310 2024-09-16T17:06:12.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.042+0000 7fc63acd1640 1 -- 172.21.15.89:0/2181543188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc6340a06b0 con 0x7fc634132310 2024-09-16T17:06:12.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.043+0000 7fc6317fa640 1 -- 172.21.15.89:0/2181543188 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc6240070b0 con 0x7fc634132310 2024-09-16T17:06:12.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.043+0000 7fc6317fa640 1 --2- 172.21.15.89:0/2181543188 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc62003e8e0 0x7fc620040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.043+0000 7fc6317fa640 1 -- 172.21.15.89:0/2181543188 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(726..726 src has 406..726) ==== 3431+0+0 (crc 0 0 0) 0x7fc62404f7e0 con 0x7fc634132310 2024-09-16T17:06:12.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.043+0000 7fc6317fa640 1 --2- 172.21.15.89:0/2181543188 >> v2:172.21.15.89:6803/245700216 conn(0x7fc620044a20 0x7fc620046f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.043+0000 7fc6317fa640 1 -- 172.21.15.89:0/2181543188 --> v2:172.21.15.89:6803/245700216 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6200475a0 con 0x7fc620044a20 2024-09-16T17:06:12.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.043+0000 7fc6317fa640 1 -- 172.21.15.89:0/2181543188 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=726) ==== 24+0+0 (crc 0 0 0) 0x7fc62404fc70 con 0x7fc634132310 2024-09-16T17:06:12.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.043+0000 7fc633fff640 1 --2- 172.21.15.89:0/2181543188 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc62003e8e0 0x7fc620040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:12.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.044+0000 7fc633fff640 1 --2- 172.21.15.89:0/2181543188 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc62003e8e0 0x7fc620040df0 crc :-1 s=READY pgs=3881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.044+0000 7fc63926e640 1 --2- 172.21.15.89:0/2181543188 >> v2:172.21.15.89:6803/245700216 conn(0x7fc620044a20 0x7fc620046f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:06:12.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.047+0000 7fc63926e640 1 --2- 172.21.15.89:0/2181543188 >> v2:172.21.15.89:6803/245700216 conn(0x7fc620044a20 0x7fc620046f10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.049+0000 7fc6317fa640 1 -- 172.21.15.89:0/2181543188 <== osd.1 v2:172.21.15.89:6803/245700216 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7fc6200475a0 con 0x7fc620044a20 2024-09-16T17:06:12.056 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.052+0000 7fc63acd1640 1 -- 172.21.15.89:0/2181543188 --> v2:172.21.15.89:6803/245700216 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc634138910 con 0x7fc620044a20 2024-09-16T17:06:12.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.054+0000 7fc6317fa640 1 -- 172.21.15.89:0/2181543188 <== osd.1 v2:172.21.15.89:6803/245700216 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7fc634138910 con 0x7fc620044a20 2024-09-16T17:06:12.057 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-16T17:06:12.057 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "" 2024-09-16T17:06:12.058 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-16T17:06:12.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.054+0000 7fc63acd1640 1 -- 172.21.15.89:0/2181543188 >> v2:172.21.15.89:6803/245700216 conn(0x7fc620044a20 msgr2=0x7fc620046f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.054+0000 7fc63acd1640 1 --2- 172.21.15.89:0/2181543188 >> v2:172.21.15.89:6803/245700216 conn(0x7fc620044a20 0x7fc620046f10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.054+0000 7fc63acd1640 1 -- 172.21.15.89:0/2181543188 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc62003e8e0 msgr2=0x7fc620040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.054+0000 7fc63acd1640 1 --2- 172.21.15.89:0/2181543188 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc62003e8e0 0x7fc620040df0 crc :-1 s=READY pgs=3881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.054+0000 7fc63acd1640 1 -- 172.21.15.89:0/2181543188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc634132310 msgr2=0x7fc63411edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.054+0000 7fc63acd1640 1 --2- 172.21.15.89:0/2181543188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc634132310 0x7fc63411edf0 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.054+0000 7fc63acd1640 1 -- 172.21.15.89:0/2181543188 shutdown_connections 2024-09-16T17:06:12.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.054+0000 7fc63acd1640 1 --2- 172.21.15.89:0/2181543188 >> v2:172.21.15.89:6803/245700216 conn(0x7fc620044a20 0x7fc620046f10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.054+0000 7fc63acd1640 1 --2- 172.21.15.89:0/2181543188 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fc62003e8e0 0x7fc620040df0 unknown :-1 s=CLOSED pgs=3881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.054+0000 7fc63acd1640 1 --2- 172.21.15.89:0/2181543188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc634132310 0x7fc63411edf0 unknown :-1 s=CLOSED pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.054+0000 7fc63acd1640 1 -- 172.21.15.89:0/2181543188 >> 172.21.15.89:0/2181543188 conn(0x7fc634069d10 msgr2=0x7fc63409d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:12.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.054+0000 7fc63acd1640 1 -- 172.21.15.89:0/2181543188 shutdown_connections 2024-09-16T17:06:12.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.054+0000 7fc63acd1640 1 -- 172.21.15.89:0/2181543188 wait complete. 2024-09-16T17:06:12.067 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T17:06:12.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.169+0000 7f457e951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:12.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.175+0000 7f457e951640 1 Processor -- start 2024-09-16T17:06:12.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.175+0000 7f457e951640 1 -- start start 2024-09-16T17:06:12.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.176+0000 7f457e951640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4578134ac0 0x7f4578136ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.176+0000 7f457e951640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f457812f190 con 0x7f457809daa0 2024-09-16T17:06:12.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.176+0000 7f457e951640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f45780706a0 con 0x7f4578134ac0 2024-09-16T17:06:12.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.177+0000 7f45777fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4578134ac0 0x7f4578136ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:12.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.177+0000 7f45777fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4578134ac0 0x7f4578136ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37902/0 (socket says 172.21.15.89:37902) 2024-09-16T17:06:12.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.177+0000 7f45777fe640 1 -- 172.21.15.89:0/3634296934 learned_addr learned my addr 172.21.15.89:0/3634296934 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:12.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.177+0000 7f4577fff640 1 --1- 172.21.15.89:0/3634296934 >> v1:172.21.15.89:6789/0 conn(0x7f457809daa0 0x7f457809ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:45822/0 (socket says 172.21.15.89:45822) 2024-09-16T17:06:12.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.177+0000 7f45777fe640 1 -- 172.21.15.89:0/3634296934 >> v1:172.21.15.89:6789/0 conn(0x7f457809daa0 legacy=0x7f457809ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.177+0000 7f45777fe640 1 -- 172.21.15.89:0/3634296934 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f457812e970 con 0x7f4578134ac0 2024-09-16T17:06:12.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.177+0000 7f45777fe640 1 --2- 172.21.15.89:0/3634296934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4578134ac0 0x7f4578136ee0 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae9261355e3c90d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.177+0000 7f4576ffd640 1 -- 172.21.15.89:0/3634296934 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f456c00ade0 con 0x7f4578134ac0 2024-09-16T17:06:12.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.177+0000 7f4576ffd640 1 -- 172.21.15.89:0/3634296934 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f456c00f340 con 0x7f4578134ac0 2024-09-16T17:06:12.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.177+0000 7f4576ffd640 1 -- 172.21.15.89:0/3634296934 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f456c00f5e0 con 0x7f4578134ac0 2024-09-16T17:06:12.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.178+0000 7f457e951640 1 -- 172.21.15.89:0/3634296934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4578134ac0 msgr2=0x7f4578136ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.178+0000 7f457e951640 1 --2- 172.21.15.89:0/3634296934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4578134ac0 0x7f4578136ee0 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.178+0000 7f457e951640 1 -- 172.21.15.89:0/3634296934 shutdown_connections 2024-09-16T17:06:12.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.178+0000 7f457e951640 1 --2- 172.21.15.89:0/3634296934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4578134ac0 0x7f4578136ee0 unknown :-1 s=CLOSED pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.178+0000 7f457e951640 1 -- 172.21.15.89:0/3634296934 >> 172.21.15.89:0/3634296934 conn(0x7f4578069d60 msgr2=0x7f457809e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:12.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.178+0000 7f457e951640 1 -- 172.21.15.89:0/3634296934 shutdown_connections 2024-09-16T17:06:12.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.178+0000 7f457e951640 1 -- 172.21.15.89:0/3634296934 wait complete. 2024-09-16T17:06:12.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.178+0000 7f457e951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:12.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.179+0000 7f457e951640 1 Processor -- start 2024-09-16T17:06:12.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.180+0000 7f457e951640 1 -- start start 2024-09-16T17:06:12.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.181+0000 7f457e951640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f457809daa0 0x7f45781c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.181+0000 7f457e951640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f457811db80 con 0x7f457809daa0 2024-09-16T17:06:12.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.181+0000 7f4577fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f457809daa0 0x7f45781c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:12.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.181+0000 7f4577fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f457809daa0 0x7f45781c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37904/0 (socket says 172.21.15.89:37904) 2024-09-16T17:06:12.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.181+0000 7f4577fff640 1 -- 172.21.15.89:0/3747509555 learned_addr learned my addr 172.21.15.89:0/3747509555 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:12.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.181+0000 7f4577fff640 1 -- 172.21.15.89:0/3747509555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f457811dfd0 con 0x7f457809daa0 2024-09-16T17:06:12.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.181+0000 7f4577fff640 1 --2- 172.21.15.89:0/3747509555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f457809daa0 0x7f45781c8300 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.181+0000 7f4574ff9640 1 -- 172.21.15.89:0/3747509555 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f45680059a0 con 0x7f457809daa0 2024-09-16T17:06:12.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.181+0000 7f4574ff9640 1 -- 172.21.15.89:0/3747509555 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4568005b00 con 0x7f457809daa0 2024-09-16T17:06:12.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.181+0000 7f457e951640 1 -- 172.21.15.89:0/3747509555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45781c7f40 con 0x7f457809daa0 2024-09-16T17:06:12.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.181+0000 7f4574ff9640 1 -- 172.21.15.89:0/3747509555 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4568005da0 con 0x7f457809daa0 2024-09-16T17:06:12.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.181+0000 7f457e951640 1 -- 172.21.15.89:0/3747509555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45780748a0 con 0x7f457809daa0 2024-09-16T17:06:12.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.182+0000 7f457e951640 1 -- 172.21.15.89:0/3747509555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f457812e270 con 0x7f457809daa0 2024-09-16T17:06:12.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.182+0000 7f4574ff9640 1 -- 172.21.15.89:0/3747509555 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f45680070b0 con 0x7f457809daa0 2024-09-16T17:06:12.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.183+0000 7f4574ff9640 1 --2- 172.21.15.89:0/3747509555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f456403e930 0x7f4564040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.183+0000 7f4574ff9640 1 -- 172.21.15.89:0/3747509555 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(726..726 src has 406..726) ==== 3431+0+0 (crc 0 0 0) 0x7f456804f960 con 0x7f457809daa0 2024-09-16T17:06:12.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.183+0000 7f45777fe640 1 --2- 172.21.15.89:0/3747509555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f456403e930 0x7f4564040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:12.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.184+0000 7f45777fe640 1 --2- 172.21.15.89:0/3747509555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f456403e930 0x7f4564040e40 crc :-1 s=READY pgs=3882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.188+0000 7f4574ff9640 1 -- 172.21.15.89:0/3747509555 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f456800dc10 con 0x7f457809daa0 2024-09-16T17:06:12.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.372+0000 7f457e951640 1 -- 172.21.15.89:0/3747509555 --> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f457811f720 con 0x7f456403e930 2024-09-16T17:06:12.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.373+0000 7f4574ff9640 1 -- 172.21.15.89:0/3747509555 <== mgr.4099 v2:172.21.15.177:6800/1212166405 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f456c00adc0 con 0x7f456403e930 2024-09-16T17:06:12.374 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T17:06:12.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.375+0000 7f457e951640 1 -- 172.21.15.89:0/3747509555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f456403e930 msgr2=0x7f4564040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.375+0000 7f457e951640 1 --2- 172.21.15.89:0/3747509555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f456403e930 0x7f4564040e40 crc :-1 s=READY pgs=3882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.375+0000 7f457e951640 1 -- 172.21.15.89:0/3747509555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f457809daa0 msgr2=0x7f45781c8300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.375+0000 7f457e951640 1 --2- 172.21.15.89:0/3747509555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f457809daa0 0x7f45781c8300 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.375+0000 7f457e951640 1 -- 172.21.15.89:0/3747509555 shutdown_connections 2024-09-16T17:06:12.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.375+0000 7f457e951640 1 --2- 172.21.15.89:0/3747509555 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f456403e930 0x7f4564040e40 unknown :-1 s=CLOSED pgs=3882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.375+0000 7f457e951640 1 --2- 172.21.15.89:0/3747509555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f457809daa0 0x7f45781c8300 unknown :-1 s=CLOSED pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.375+0000 7f457e951640 1 -- 172.21.15.89:0/3747509555 >> 172.21.15.89:0/3747509555 conn(0x7f4578069d60 msgr2=0x7f4578133e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:12.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.376+0000 7f457e951640 1 -- 172.21.15.89:0/3747509555 shutdown_connections 2024-09-16T17:06:12.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.376+0000 7f457e951640 1 -- 172.21.15.89:0/3747509555 wait complete. 2024-09-16T17:06:12.397 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T17:06:12.398 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:06:12.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.506+0000 7f7534991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:12.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.515+0000 7f7534991640 1 Processor -- start 2024-09-16T17:06:12.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.515+0000 7f7534991640 1 -- start start 2024-09-16T17:06:12.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.516+0000 7f7534991640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f753009ec50 0x7f753006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.516+0000 7f7534991640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75300a0d00 con 0x7f753006d380 2024-09-16T17:06:12.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.516+0000 7f7534991640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f75300a0a30 con 0x7f753009ec50 2024-09-16T17:06:12.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.516+0000 7f752e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f753009ec50 0x7f753006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:12.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.516+0000 7f752e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f753009ec50 0x7f753006ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37906/0 (socket says 172.21.15.89:37906) 2024-09-16T17:06:12.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.516+0000 7f752e59c640 1 -- 172.21.15.89:0/3970325426 learned_addr learned my addr 172.21.15.89:0/3970325426 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:12.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.516+0000 7f752dd9b640 1 --1- 172.21.15.89:0/3970325426 >> v1:172.21.15.89:6789/0 conn(0x7f753006d380 0x7f753012ffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:45830/0 (socket says 172.21.15.89:45830) 2024-09-16T17:06:12.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.517+0000 7f752e59c640 1 -- 172.21.15.89:0/3970325426 >> v1:172.21.15.89:6789/0 conn(0x7f753006d380 legacy=0x7f753012ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.517+0000 7f752e59c640 1 -- 172.21.15.89:0/3970325426 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75300710b0 con 0x7f753009ec50 2024-09-16T17:06:12.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.517+0000 7f752e59c640 1 --2- 172.21.15.89:0/3970325426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f753009ec50 0x7f753006ce40 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334d049f3da5855 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.517+0000 7f752d59a640 1 -- 172.21.15.89:0/3970325426 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7520009e50 con 0x7f753009ec50 2024-09-16T17:06:12.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.517+0000 7f752d59a640 1 -- 172.21.15.89:0/3970325426 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f752000e230 con 0x7f753009ec50 2024-09-16T17:06:12.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.517+0000 7f752d59a640 1 -- 172.21.15.89:0/3970325426 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f752000e4d0 con 0x7f753009ec50 2024-09-16T17:06:12.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.518+0000 7f7534991640 1 -- 172.21.15.89:0/3970325426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f753009ec50 msgr2=0x7f753006ce40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.518+0000 7f7534991640 1 --2- 172.21.15.89:0/3970325426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f753009ec50 0x7f753006ce40 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.518+0000 7f7534991640 1 -- 172.21.15.89:0/3970325426 shutdown_connections 2024-09-16T17:06:12.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.518+0000 7f7534991640 1 --2- 172.21.15.89:0/3970325426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f753009ec50 0x7f753006ce40 unknown :-1 s=CLOSED pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.518+0000 7f7534991640 1 -- 172.21.15.89:0/3970325426 >> 172.21.15.89:0/3970325426 conn(0x7f7530069d10 msgr2=0x7f753009f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:12.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.518+0000 7f7534991640 1 -- 172.21.15.89:0/3970325426 shutdown_connections 2024-09-16T17:06:12.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.518+0000 7f7534991640 1 -- 172.21.15.89:0/3970325426 wait complete. 2024-09-16T17:06:12.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.518+0000 7f7534991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:12.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.519+0000 7f7534991640 1 Processor -- start 2024-09-16T17:06:12.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.520+0000 7f7534991640 1 -- start start 2024-09-16T17:06:12.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.521+0000 7f7534991640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f753006d380 0x7f75301c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.521+0000 7f7534991640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f753011e550 con 0x7f753006d380 2024-09-16T17:06:12.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.521+0000 7f752e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f753006d380 0x7f75301c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:12.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.521+0000 7f752e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f753006d380 0x7f75301c7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37920/0 (socket says 172.21.15.89:37920) 2024-09-16T17:06:12.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.521+0000 7f752e59c640 1 -- 172.21.15.89:0/854231896 learned_addr learned my addr 172.21.15.89:0/854231896 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:12.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.521+0000 7f752e59c640 1 -- 172.21.15.89:0/854231896 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7530133570 con 0x7f753006d380 2024-09-16T17:06:12.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.521+0000 7f752e59c640 1 --2- 172.21.15.89:0/854231896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f753006d380 0x7f75301c7b10 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.521+0000 7f751effd640 1 -- 172.21.15.89:0/854231896 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f752000ee30 con 0x7f753006d380 2024-09-16T17:06:12.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.521+0000 7f751effd640 1 -- 172.21.15.89:0/854231896 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7520015420 con 0x7f753006d380 2024-09-16T17:06:12.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.521+0000 7f7534991640 1 -- 172.21.15.89:0/854231896 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753011cde0 con 0x7f753006d380 2024-09-16T17:06:12.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.521+0000 7f751effd640 1 -- 172.21.15.89:0/854231896 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f75200156c0 con 0x7f753006d380 2024-09-16T17:06:12.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.521+0000 7f7534991640 1 -- 172.21.15.89:0/854231896 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f753011fe60 con 0x7f753006d380 2024-09-16T17:06:12.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.522+0000 7f7534991640 1 -- 172.21.15.89:0/854231896 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f753011cc70 con 0x7f753006d380 2024-09-16T17:06:12.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.522+0000 7f751effd640 1 -- 172.21.15.89:0/854231896 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f75200158c0 con 0x7f753006d380 2024-09-16T17:06:12.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.523+0000 7f751effd640 1 --2- 172.21.15.89:0/854231896 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f751003e8e0 0x7f7510040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.523+0000 7f751effd640 1 -- 172.21.15.89:0/854231896 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(726..726 src has 406..726) ==== 3431+0+0 (crc 0 0 0) 0x7f7520050fd0 con 0x7f753006d380 2024-09-16T17:06:12.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.523+0000 7f751effd640 1 --2- 172.21.15.89:0/854231896 >> v2:172.21.15.177:6806/229775330 conn(0x7f7510044a20 0x7f7510046f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.523+0000 7f751effd640 1 -- 172.21.15.89:0/854231896 --> v2:172.21.15.177:6806/229775330 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75100475a0 con 0x7f7510044a20 2024-09-16T17:06:12.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.523+0000 7f751effd640 1 -- 172.21.15.89:0/854231896 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=726) ==== 24+0+0 (crc 0 0 0) 0x7f7520053540 con 0x7f753006d380 2024-09-16T17:06:12.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.523+0000 7f752dd9b640 1 --2- 172.21.15.89:0/854231896 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f751003e8e0 0x7f7510040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:12.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.524+0000 7f752dd9b640 1 --2- 172.21.15.89:0/854231896 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f751003e8e0 0x7f7510040df0 crc :-1 s=READY pgs=3883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.524+0000 7f752ed9d640 1 --2- 172.21.15.89:0/854231896 >> v2:172.21.15.177:6806/229775330 conn(0x7f7510044a20 0x7f7510046f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:06:12.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.529+0000 7f752ed9d640 1 --2- 172.21.15.89:0/854231896 >> v2:172.21.15.177:6806/229775330 conn(0x7f7510044a20 0x7f7510046f10 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.531+0000 7f751effd640 1 -- 172.21.15.89:0/854231896 <== osd.2 v2:172.21.15.177:6806/229775330 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f75100475a0 con 0x7f7510044a20 2024-09-16T17:06:12.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.534+0000 7f7534991640 1 -- 172.21.15.89:0/854231896 --> v2:172.21.15.177:6806/229775330 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7530120ab0 con 0x7f7510044a20 2024-09-16T17:06:12.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.536+0000 7f751effd640 1 -- 172.21.15.89:0/854231896 <== osd.2 v2:172.21.15.177:6806/229775330 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f7530120ab0 con 0x7f7510044a20 2024-09-16T17:06:12.537 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-16T17:06:12.537 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "" 2024-09-16T17:06:12.538 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-16T17:06:12.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.537+0000 7f7534991640 1 -- 172.21.15.89:0/854231896 >> v2:172.21.15.177:6806/229775330 conn(0x7f7510044a20 msgr2=0x7f7510046f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.537+0000 7f7534991640 1 --2- 172.21.15.89:0/854231896 >> v2:172.21.15.177:6806/229775330 conn(0x7f7510044a20 0x7f7510046f10 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.537+0000 7f7534991640 1 -- 172.21.15.89:0/854231896 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f751003e8e0 msgr2=0x7f7510040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.537+0000 7f7534991640 1 --2- 172.21.15.89:0/854231896 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f751003e8e0 0x7f7510040df0 crc :-1 s=READY pgs=3883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.537+0000 7f7534991640 1 -- 172.21.15.89:0/854231896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f753006d380 msgr2=0x7f75301c7b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.537+0000 7f7534991640 1 --2- 172.21.15.89:0/854231896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f753006d380 0x7f75301c7b10 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.537+0000 7f7534991640 1 -- 172.21.15.89:0/854231896 shutdown_connections 2024-09-16T17:06:12.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.537+0000 7f7534991640 1 --2- 172.21.15.89:0/854231896 >> v2:172.21.15.177:6806/229775330 conn(0x7f7510044a20 0x7f7510046f10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.537+0000 7f7534991640 1 --2- 172.21.15.89:0/854231896 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f751003e8e0 0x7f7510040df0 unknown :-1 s=CLOSED pgs=3883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.537+0000 7f7534991640 1 --2- 172.21.15.89:0/854231896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f753006d380 0x7f75301c7b10 unknown :-1 s=CLOSED pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.537+0000 7f7534991640 1 -- 172.21.15.89:0/854231896 >> 172.21.15.89:0/854231896 conn(0x7f7530069d10 msgr2=0x7f75300a28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:12.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.537+0000 7f7534991640 1 -- 172.21.15.89:0/854231896 shutdown_connections 2024-09-16T17:06:12.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.537+0000 7f7534991640 1 -- 172.21.15.89:0/854231896 wait complete. 2024-09-16T17:06:12.548 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T17:06:12.657 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.652+0000 7fe81dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:12.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.658+0000 7fe81dd91640 1 Processor -- start 2024-09-16T17:06:12.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.658+0000 7fe81dd91640 1 -- start start 2024-09-16T17:06:12.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.659+0000 7fe81dd91640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe818138720 0x7fe81813ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.659+0000 7fe81dd91640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe818133040 con 0x7fe818132520 2024-09-16T17:06:12.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.659+0000 7fe81dd91640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7fe81806f6d0 con 0x7fe818138720 2024-09-16T17:06:12.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.659+0000 7fe816ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe818138720 0x7fe81813ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:12.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.659+0000 7fe8177fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe818132520 0x7fe818132930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:45842/0 (socket says 172.21.15.89:45842) 2024-09-16T17:06:12.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.659+0000 7fe8177fe640 1 -- 172.21.15.89:0/1473334520 learned_addr learned my addr 172.21.15.89:0/1473334520 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:06:12.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.659+0000 7fe816ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe818138720 0x7fe81813ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37932/0 (socket says 172.21.15.89:37932) 2024-09-16T17:06:12.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.659+0000 7fe816ffd640 1 -- 172.21.15.89:0/1473334520 >> v1:172.21.15.89:6789/0 conn(0x7fe818132520 legacy=0x7fe818132930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.659+0000 7fe816ffd640 1 -- 172.21.15.89:0/1473334520 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81806f3d0 con 0x7fe818138720 2024-09-16T17:06:12.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.659+0000 7fe816ffd640 1 --2- 172.21.15.89:0/1473334520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe818138720 0x7fe81813ab40 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63511dc9b7b266dd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.660+0000 7fe8167fc640 1 -- 172.21.15.89:0/1473334520 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe800009d90 con 0x7fe818138720 2024-09-16T17:06:12.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.660+0000 7fe8167fc640 1 -- 172.21.15.89:0/1473334520 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe80000e230 con 0x7fe818138720 2024-09-16T17:06:12.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.660+0000 7fe8167fc640 1 -- 172.21.15.89:0/1473334520 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe80000e4d0 con 0x7fe818138720 2024-09-16T17:06:12.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.660+0000 7fe81dd91640 1 -- 172.21.15.89:0/1473334520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe818138720 msgr2=0x7fe81813ab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.660+0000 7fe81dd91640 1 --2- 172.21.15.89:0/1473334520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe818138720 0x7fe81813ab40 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.660+0000 7fe81dd91640 1 -- 172.21.15.89:0/1473334520 shutdown_connections 2024-09-16T17:06:12.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.660+0000 7fe81dd91640 1 --2- 172.21.15.89:0/1473334520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe818138720 0x7fe81813ab40 unknown :-1 s=CLOSED pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.660+0000 7fe81dd91640 1 -- 172.21.15.89:0/1473334520 >> 172.21.15.89:0/1473334520 conn(0x7fe81806e490 msgr2=0x7fe81806e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:12.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.660+0000 7fe81dd91640 1 -- 172.21.15.89:0/1473334520 shutdown_connections 2024-09-16T17:06:12.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.660+0000 7fe81dd91640 1 -- 172.21.15.89:0/1473334520 wait complete. 2024-09-16T17:06:12.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.661+0000 7fe81dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:12.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.662+0000 7fe81dd91640 1 Processor -- start 2024-09-16T17:06:12.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.662+0000 7fe81dd91640 1 -- start start 2024-09-16T17:06:12.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.663+0000 7fe81dd91640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe818132520 0x7fe818130c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.663+0000 7fe81dd91640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe8181313d0 con 0x7fe818132520 2024-09-16T17:06:12.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.663+0000 7fe8177fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe818132520 0x7fe818130c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:12.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.663+0000 7fe8177fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe818132520 0x7fe818130c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37942/0 (socket says 172.21.15.89:37942) 2024-09-16T17:06:12.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.663+0000 7fe8177fe640 1 -- 172.21.15.89:0/2425822029 learned_addr learned my addr 172.21.15.89:0/2425822029 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:12.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.663+0000 7fe8177fe640 1 -- 172.21.15.89:0/2425822029 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8180a07b0 con 0x7fe818132520 2024-09-16T17:06:12.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.664+0000 7fe8177fe640 1 --2- 172.21.15.89:0/2425822029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe818132520 0x7fe818130c70 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.664+0000 7fe80ffff640 1 -- 172.21.15.89:0/2425822029 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe8080070b0 con 0x7fe818132520 2024-09-16T17:06:12.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.664+0000 7fe80ffff640 1 -- 172.21.15.89:0/2425822029 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe808007210 con 0x7fe818132520 2024-09-16T17:06:12.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.664+0000 7fe81dd91640 1 -- 172.21.15.89:0/2425822029 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe818120bc0 con 0x7fe818132520 2024-09-16T17:06:12.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.664+0000 7fe80ffff640 1 -- 172.21.15.89:0/2425822029 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe8080074b0 con 0x7fe818132520 2024-09-16T17:06:12.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.664+0000 7fe81dd91640 1 -- 172.21.15.89:0/2425822029 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe818120030 con 0x7fe818132520 2024-09-16T17:06:12.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.665+0000 7fe80ffff640 1 -- 172.21.15.89:0/2425822029 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe808007660 con 0x7fe818132520 2024-09-16T17:06:12.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.665+0000 7fe80ffff640 1 --2- 172.21.15.89:0/2425822029 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe7f803e930 0x7fe7f8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.665+0000 7fe81dd91640 1 -- 172.21.15.89:0/2425822029 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe81806a300 con 0x7fe818132520 2024-09-16T17:06:12.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.665+0000 7fe80ffff640 1 -- 172.21.15.89:0/2425822029 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(726..726 src has 406..726) ==== 3431+0+0 (crc 0 0 0) 0x7fe8080501a0 con 0x7fe818132520 2024-09-16T17:06:12.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.665+0000 7fe816ffd640 1 --2- 172.21.15.89:0/2425822029 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe7f803e930 0x7fe7f8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:12.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.666+0000 7fe816ffd640 1 --2- 172.21.15.89:0/2425822029 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe7f803e930 0x7fe7f8040e40 crc :-1 s=READY pgs=3884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.670+0000 7fe80ffff640 1 -- 172.21.15.89:0/2425822029 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fe80800fae0 con 0x7fe818132520 2024-09-16T17:06:12.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.846+0000 7fe81dd91640 1 -- 172.21.15.89:0/2425822029 --> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fe8180a0640 con 0x7fe7f803e930 2024-09-16T17:06:12.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.847+0000 7fe80ffff640 1 -- 172.21.15.89:0/2425822029 <== mgr.4099 v2:172.21.15.177:6800/1212166405 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fe8180a0640 con 0x7fe7f803e930 2024-09-16T17:06:12.848 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T17:06:12.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.849+0000 7fe81dd91640 1 -- 172.21.15.89:0/2425822029 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe7f803e930 msgr2=0x7fe7f8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.849+0000 7fe81dd91640 1 --2- 172.21.15.89:0/2425822029 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe7f803e930 0x7fe7f8040e40 crc :-1 s=READY pgs=3884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.849+0000 7fe81dd91640 1 -- 172.21.15.89:0/2425822029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe818132520 msgr2=0x7fe818130c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.849+0000 7fe81dd91640 1 --2- 172.21.15.89:0/2425822029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe818132520 0x7fe818130c70 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.849+0000 7fe81dd91640 1 -- 172.21.15.89:0/2425822029 shutdown_connections 2024-09-16T17:06:12.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.849+0000 7fe81dd91640 1 --2- 172.21.15.89:0/2425822029 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fe7f803e930 0x7fe7f8040e40 unknown :-1 s=CLOSED pgs=3884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.849+0000 7fe81dd91640 1 --2- 172.21.15.89:0/2425822029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe818132520 0x7fe818130c70 unknown :-1 s=CLOSED pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.849+0000 7fe81dd91640 1 -- 172.21.15.89:0/2425822029 >> 172.21.15.89:0/2425822029 conn(0x7fe81806e490 msgr2=0x7fe8180a3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:12.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.849+0000 7fe81dd91640 1 -- 172.21.15.89:0/2425822029 shutdown_connections 2024-09-16T17:06:12.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.849+0000 7fe81dd91640 1 -- 172.21.15.89:0/2425822029 wait complete. 2024-09-16T17:06:12.861 INFO:tasks.ceph:Scrubbing osd.3 2024-09-16T17:06:12.861 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:06:12.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.966+0000 7fecc7991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:12.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.975+0000 7fecc7991640 1 Processor -- start 2024-09-16T17:06:12.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.975+0000 7fecc7991640 1 -- start start 2024-09-16T17:06:12.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.976+0000 7fecc7991640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fecc0133530 0x7fecc0133940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.976+0000 7fecc7991640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc0074bf0 con 0x7fecc0133e80 2024-09-16T17:06:12.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.976+0000 7fecc7991640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7fecc01331b0 con 0x7fecc0133530 2024-09-16T17:06:12.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.976+0000 7fecc572d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fecc0133530 0x7fecc0133940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:12.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.976+0000 7fecc572d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fecc0133530 0x7fecc0133940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37946/0 (socket says 172.21.15.89:37946) 2024-09-16T17:06:12.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.976+0000 7fecc4f2c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fecc0133e80 0x7fecc009ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:45850/0 (socket says 172.21.15.89:45850) 2024-09-16T17:06:12.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.976+0000 7fecc572d640 1 -- 172.21.15.89:0/2467246605 learned_addr learned my addr 172.21.15.89:0/2467246605 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:12.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.977+0000 7fecc572d640 1 -- 172.21.15.89:0/2467246605 >> v1:172.21.15.89:6789/0 conn(0x7fecc0133e80 legacy=0x7fecc009ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.977+0000 7fecc572d640 1 -- 172.21.15.89:0/2467246605 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc0072320 con 0x7fecc0133530 2024-09-16T17:06:12.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.977+0000 7fecb7fff640 1 -- 172.21.15.89:0/2467246605 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1402690535 0 0) 0x7fecc0074bf0 con 0x7fecc0133e80 2024-09-16T17:06:12.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.977+0000 7fecc572d640 1 --2- 172.21.15.89:0/2467246605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc0133530 0x7fecc0133940 crc :-1 s=READY pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b771c2bc3d8b8959 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.977+0000 7fecb7fff640 1 -- 172.21.15.89:0/2467246605 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fecbc009e40 con 0x7fecc0133530 2024-09-16T17:06:12.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.977+0000 7fecb7fff640 1 -- 172.21.15.89:0/2467246605 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fecbc00e230 con 0x7fecc0133530 2024-09-16T17:06:12.979 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.977+0000 7fecb7fff640 1 -- 172.21.15.89:0/2467246605 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fecbc00e4d0 con 0x7fecc0133530 2024-09-16T17:06:12.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.978+0000 7fecc7991640 1 -- 172.21.15.89:0/2467246605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc0133530 msgr2=0x7fecc0133940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.978+0000 7fecc7991640 1 --2- 172.21.15.89:0/2467246605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc0133530 0x7fecc0133940 crc :-1 s=READY pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.978+0000 7fecc7991640 1 -- 172.21.15.89:0/2467246605 shutdown_connections 2024-09-16T17:06:12.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.978+0000 7fecc7991640 1 --2- 172.21.15.89:0/2467246605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc0133530 0x7fecc0133940 unknown :-1 s=CLOSED pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.978+0000 7fecc7991640 1 -- 172.21.15.89:0/2467246605 >> 172.21.15.89:0/2467246605 conn(0x7fecc0069d60 msgr2=0x7fecc009e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:12.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.978+0000 7fecc7991640 1 -- 172.21.15.89:0/2467246605 shutdown_connections 2024-09-16T17:06:12.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.978+0000 7fecc7991640 1 -- 172.21.15.89:0/2467246605 wait complete. 2024-09-16T17:06:12.980 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.978+0000 7fecc7991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:12.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.979+0000 7fecc7991640 1 Processor -- start 2024-09-16T17:06:12.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.980+0000 7fecc7991640 1 -- start start 2024-09-16T17:06:12.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.980+0000 7fecc7991640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc0133530 0x7fecc011e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.981+0000 7fecc7991640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fecc011d990 con 0x7fecc0133530 2024-09-16T17:06:12.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.981+0000 7fecc572d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc0133530 0x7fecc011e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:12.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.981+0000 7fecc572d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc0133530 0x7fecc011e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37956/0 (socket says 172.21.15.89:37956) 2024-09-16T17:06:12.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.981+0000 7fecc572d640 1 -- 172.21.15.89:0/1371835996 learned_addr learned my addr 172.21.15.89:0/1371835996 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:12.982 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.981+0000 7fecc572d640 1 -- 172.21.15.89:0/1371835996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc011df20 con 0x7fecc0133530 2024-09-16T17:06:12.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.981+0000 7fecc572d640 1 --2- 172.21.15.89:0/1371835996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc0133530 0x7fecc011e2e0 crc :-1 s=READY pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.981+0000 7fecb5ffb640 1 -- 172.21.15.89:0/1371835996 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fecbc00ee10 con 0x7fecc0133530 2024-09-16T17:06:12.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.981+0000 7fecb5ffb640 1 -- 172.21.15.89:0/1371835996 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fecbc015420 con 0x7fecc0133530 2024-09-16T17:06:12.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.981+0000 7fecc7991640 1 -- 172.21.15.89:0/1371835996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc011fd80 con 0x7fecc0133530 2024-09-16T17:06:12.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.981+0000 7fecb5ffb640 1 -- 172.21.15.89:0/1371835996 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fecbc0156c0 con 0x7fecc0133530 2024-09-16T17:06:12.983 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.981+0000 7fecc7991640 1 -- 172.21.15.89:0/1371835996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc011db80 con 0x7fecc0133530 2024-09-16T17:06:12.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.982+0000 7fecc7991640 1 -- 172.21.15.89:0/1371835996 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fecc009d1e0 con 0x7fecc0133530 2024-09-16T17:06:12.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.982+0000 7fecb5ffb640 1 -- 172.21.15.89:0/1371835996 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fecbc015870 con 0x7fecc0133530 2024-09-16T17:06:12.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.982+0000 7fecb5ffb640 1 --2- 172.21.15.89:0/1371835996 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7feca403e930 0x7feca4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.983+0000 7fecb5ffb640 1 -- 172.21.15.89:0/1371835996 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(726..726 src has 406..726) ==== 3431+0+0 (crc 0 0 0) 0x7fecbc051060 con 0x7fecc0133530 2024-09-16T17:06:12.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.983+0000 7fecb5ffb640 1 --2- 172.21.15.89:0/1371835996 >> v2:172.21.15.177:6807/75130198 conn(0x7feca4044a70 0x7feca4046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:12.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.983+0000 7fecb5ffb640 1 -- 172.21.15.89:0/1371835996 --> v2:172.21.15.177:6807/75130198 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feca40475f0 con 0x7feca4044a70 2024-09-16T17:06:12.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.983+0000 7fecb5ffb640 1 -- 172.21.15.89:0/1371835996 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=726) ==== 24+0+0 (crc 0 0 0) 0x7fecbc053550 con 0x7fecc0133530 2024-09-16T17:06:12.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.983+0000 7fecc4f2c640 1 --2- 172.21.15.89:0/1371835996 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7feca403e930 0x7feca4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:12.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.983+0000 7fecc4f2c640 1 --2- 172.21.15.89:0/1371835996 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7feca403e930 0x7feca4040e40 crc :-1 s=READY pgs=3885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.984+0000 7fecc5f2e640 1 --2- 172.21.15.89:0/1371835996 >> v2:172.21.15.177:6807/75130198 conn(0x7feca4044a70 0x7feca4046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T17:06:12.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.988+0000 7fecc5f2e640 1 --2- 172.21.15.89:0/1371835996 >> v2:172.21.15.177:6807/75130198 conn(0x7feca4044a70 0x7feca4046f60 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:12.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.989+0000 7fecb5ffb640 1 -- 172.21.15.89:0/1371835996 <== osd.3 v2:172.21.15.177:6807/75130198 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7feca40475f0 con 0x7feca4044a70 2024-09-16T17:06:12.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.992+0000 7fecc7991640 1 -- 172.21.15.89:0/1371835996 --> v2:172.21.15.177:6807/75130198 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fecc009fab0 con 0x7feca4044a70 2024-09-16T17:06:12.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.994+0000 7fecb5ffb640 1 -- 172.21.15.89:0/1371835996 <== osd.3 v2:172.21.15.177:6807/75130198 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7fecb800a820 con 0x7feca4044a70 2024-09-16T17:06:12.995 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-16T17:06:12.995 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "" 2024-09-16T17:06:12.996 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-16T17:06:12.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.995+0000 7fecc7991640 1 -- 172.21.15.89:0/1371835996 >> v2:172.21.15.177:6807/75130198 conn(0x7feca4044a70 msgr2=0x7feca4046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.995+0000 7fecc7991640 1 --2- 172.21.15.89:0/1371835996 >> v2:172.21.15.177:6807/75130198 conn(0x7feca4044a70 0x7feca4046f60 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.995+0000 7fecc7991640 1 -- 172.21.15.89:0/1371835996 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7feca403e930 msgr2=0x7feca4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.995+0000 7fecc7991640 1 --2- 172.21.15.89:0/1371835996 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7feca403e930 0x7feca4040e40 crc :-1 s=READY pgs=3885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.995+0000 7fecc7991640 1 -- 172.21.15.89:0/1371835996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc0133530 msgr2=0x7fecc011e2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:12.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.995+0000 7fecc7991640 1 --2- 172.21.15.89:0/1371835996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc0133530 0x7fecc011e2e0 crc :-1 s=READY pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.995+0000 7fecc7991640 1 -- 172.21.15.89:0/1371835996 shutdown_connections 2024-09-16T17:06:12.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.995+0000 7fecc7991640 1 --2- 172.21.15.89:0/1371835996 >> v2:172.21.15.177:6807/75130198 conn(0x7feca4044a70 0x7feca4046f60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.995+0000 7fecc7991640 1 --2- 172.21.15.89:0/1371835996 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7feca403e930 0x7feca4040e40 unknown :-1 s=CLOSED pgs=3885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.995+0000 7fecc7991640 1 --2- 172.21.15.89:0/1371835996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc0133530 0x7fecc011e2e0 unknown :-1 s=CLOSED pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:12.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.995+0000 7fecc7991640 1 -- 172.21.15.89:0/1371835996 >> 172.21.15.89:0/1371835996 conn(0x7fecc0069d60 msgr2=0x7fecc0131d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:12.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.995+0000 7fecc7991640 1 -- 172.21.15.89:0/1371835996 shutdown_connections 2024-09-16T17:06:12.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:12.995+0000 7fecc7991640 1 -- 172.21.15.89:0/1371835996 wait complete. 2024-09-16T17:06:13.006 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-16T17:06:13.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.110+0000 7fad97a46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:13.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.115+0000 7fad97a46640 1 Processor -- start 2024-09-16T17:06:13.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.116+0000 7fad97a46640 1 -- start start 2024-09-16T17:06:13.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.117+0000 7fad97a46640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fad9009c570 0x7fad9013aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:13.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.117+0000 7fad97a46640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad9009d210 con 0x7fad9009ba50 2024-09-16T17:06:13.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.117+0000 7fad97a46640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7fad9009f9e0 con 0x7fad9009c570 2024-09-16T17:06:13.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.117+0000 7fad94fe1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fad9009c570 0x7fad9013aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:13.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.117+0000 7fad94fe1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fad9009c570 0x7fad9013aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37964/0 (socket says 172.21.15.89:37964) 2024-09-16T17:06:13.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.117+0000 7fad94fe1640 1 -- 172.21.15.89:0/1101965205 learned_addr learned my addr 172.21.15.89:0/1101965205 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:13.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.117+0000 7fad957e2640 1 --1- 172.21.15.89:0/1101965205 >> v1:172.21.15.89:6789/0 conn(0x7fad9009ba50 0x7fad9009be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:45866/0 (socket says 172.21.15.89:45866) 2024-09-16T17:06:13.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.117+0000 7fad94fe1640 1 -- 172.21.15.89:0/1101965205 >> v1:172.21.15.89:6789/0 conn(0x7fad9009ba50 legacy=0x7fad9009be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:13.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.117+0000 7fad94fe1640 1 -- 172.21.15.89:0/1101965205 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9009cf30 con 0x7fad9009c570 2024-09-16T17:06:13.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.117+0000 7fad94fe1640 1 --2- 172.21.15.89:0/1101965205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad9009c570 0x7fad9013aa90 crc :-1 s=READY pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f90be3cd14258e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:13.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.117+0000 7fad87fff640 1 -- 172.21.15.89:0/1101965205 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fad80009e50 con 0x7fad9009c570 2024-09-16T17:06:13.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.117+0000 7fad87fff640 1 -- 172.21.15.89:0/1101965205 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fad8000e230 con 0x7fad9009c570 2024-09-16T17:06:13.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.117+0000 7fad87fff640 1 -- 172.21.15.89:0/1101965205 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fad8000e4d0 con 0x7fad9009c570 2024-09-16T17:06:13.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.118+0000 7fad97a46640 1 -- 172.21.15.89:0/1101965205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad9009c570 msgr2=0x7fad9013aa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:13.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.118+0000 7fad97a46640 1 --2- 172.21.15.89:0/1101965205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad9009c570 0x7fad9013aa90 crc :-1 s=READY pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:13.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.118+0000 7fad97a46640 1 -- 172.21.15.89:0/1101965205 shutdown_connections 2024-09-16T17:06:13.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.118+0000 7fad97a46640 1 --2- 172.21.15.89:0/1101965205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad9009c570 0x7fad9013aa90 unknown :-1 s=CLOSED pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:13.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.118+0000 7fad97a46640 1 -- 172.21.15.89:0/1101965205 >> 172.21.15.89:0/1101965205 conn(0x7fad900690e0 msgr2=0x7fad900694f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:13.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.118+0000 7fad97a46640 1 -- 172.21.15.89:0/1101965205 shutdown_connections 2024-09-16T17:06:13.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.118+0000 7fad97a46640 1 -- 172.21.15.89:0/1101965205 wait complete. 2024-09-16T17:06:13.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.119+0000 7fad97a46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:13.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.120+0000 7fad97a46640 1 Processor -- start 2024-09-16T17:06:13.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.120+0000 7fad97a46640 1 -- start start 2024-09-16T17:06:13.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.121+0000 7fad97a46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad9009ba50 0x7fad901239f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:13.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.121+0000 7fad97a46640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fad901252d0 con 0x7fad9009ba50 2024-09-16T17:06:13.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.121+0000 7fad957e2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad9009ba50 0x7fad901239f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:13.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.121+0000 7fad957e2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad9009ba50 0x7fad901239f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37980/0 (socket says 172.21.15.89:37980) 2024-09-16T17:06:13.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.121+0000 7fad957e2640 1 -- 172.21.15.89:0/3687279900 learned_addr learned my addr 172.21.15.89:0/3687279900 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:13.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.121+0000 7fad957e2640 1 -- 172.21.15.89:0/3687279900 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad901235a0 con 0x7fad9009ba50 2024-09-16T17:06:13.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.121+0000 7fad957e2640 1 --2- 172.21.15.89:0/3687279900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad9009ba50 0x7fad901239f0 crc :-1 s=READY pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:13.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.122+0000 7fad85ffb640 1 -- 172.21.15.89:0/3687279900 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fad8c0059a0 con 0x7fad9009ba50 2024-09-16T17:06:13.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.122+0000 7fad85ffb640 1 -- 172.21.15.89:0/3687279900 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fad8c005b00 con 0x7fad9009ba50 2024-09-16T17:06:13.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.122+0000 7fad97a46640 1 -- 172.21.15.89:0/3687279900 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad90124a90 con 0x7fad9009ba50 2024-09-16T17:06:13.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.122+0000 7fad85ffb640 1 -- 172.21.15.89:0/3687279900 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fad8c005da0 con 0x7fad9009ba50 2024-09-16T17:06:13.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.122+0000 7fad97a46640 1 -- 172.21.15.89:0/3687279900 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad90126f10 con 0x7fad9009ba50 2024-09-16T17:06:13.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.123+0000 7fad85ffb640 1 -- 172.21.15.89:0/3687279900 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fad8c0070b0 con 0x7fad9009ba50 2024-09-16T17:06:13.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.123+0000 7fad97a46640 1 -- 172.21.15.89:0/3687279900 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad9009be60 con 0x7fad9009ba50 2024-09-16T17:06:13.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.123+0000 7fad85ffb640 1 --2- 172.21.15.89:0/3687279900 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fad7403e930 0x7fad74040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:13.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.123+0000 7fad85ffb640 1 -- 172.21.15.89:0/3687279900 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(726..726 src has 406..726) ==== 3431+0+0 (crc 0 0 0) 0x7fad8c04f980 con 0x7fad9009ba50 2024-09-16T17:06:13.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.123+0000 7fad94fe1640 1 --2- 172.21.15.89:0/3687279900 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fad7403e930 0x7fad74040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:13.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.124+0000 7fad94fe1640 1 --2- 172.21.15.89:0/3687279900 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fad7403e930 0x7fad74040e40 crc :-1 s=READY pgs=3886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:13.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.128+0000 7fad85ffb640 1 -- 172.21.15.89:0/3687279900 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fad8c00f230 con 0x7fad9009ba50 2024-09-16T17:06:13.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.305+0000 7fad97a46640 1 -- 172.21.15.89:0/3687279900 --> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fad9009cc70 con 0x7fad7403e930 2024-09-16T17:06:13.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.306+0000 7fad85ffb640 1 -- 172.21.15.89:0/3687279900 <== mgr.4099 v2:172.21.15.177:6800/1212166405 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fad80015420 con 0x7fad7403e930 2024-09-16T17:06:13.307 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 3 to deep-scrub 2024-09-16T17:06:13.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.308+0000 7fad97a46640 1 -- 172.21.15.89:0/3687279900 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fad7403e930 msgr2=0x7fad74040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:13.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.308+0000 7fad97a46640 1 --2- 172.21.15.89:0/3687279900 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fad7403e930 0x7fad74040e40 crc :-1 s=READY pgs=3886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:13.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.308+0000 7fad97a46640 1 -- 172.21.15.89:0/3687279900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad9009ba50 msgr2=0x7fad901239f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:13.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.308+0000 7fad97a46640 1 --2- 172.21.15.89:0/3687279900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad9009ba50 0x7fad901239f0 crc :-1 s=READY pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:13.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.308+0000 7fad97a46640 1 -- 172.21.15.89:0/3687279900 shutdown_connections 2024-09-16T17:06:13.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.308+0000 7fad97a46640 1 --2- 172.21.15.89:0/3687279900 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fad7403e930 0x7fad74040e40 unknown :-1 s=CLOSED pgs=3886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:13.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.308+0000 7fad97a46640 1 --2- 172.21.15.89:0/3687279900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad9009ba50 0x7fad901239f0 unknown :-1 s=CLOSED pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:13.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.308+0000 7fad97a46640 1 -- 172.21.15.89:0/3687279900 >> 172.21.15.89:0/3687279900 conn(0x7fad900690e0 msgr2=0x7fad900a2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:13.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.308+0000 7fad97a46640 1 -- 172.21.15.89:0/3687279900 shutdown_connections 2024-09-16T17:06:13.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.308+0000 7fad97a46640 1 -- 172.21.15.89:0/3687279900 wait complete. 2024-09-16T17:06:13.322 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:06:13.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.426+0000 7fa335151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:13.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.431+0000 7fa335151640 1 Processor -- start 2024-09-16T17:06:13.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.431+0000 7fa335151640 1 -- start start 2024-09-16T17:06:13.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.432+0000 7fa335151640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa33009ec50 0x7fa33006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:13.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.432+0000 7fa335151640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3300a0d00 con 0x7fa33006d380 2024-09-16T17:06:13.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.432+0000 7fa335151640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7fa3300a0a30 con 0x7fa33009ec50 2024-09-16T17:06:13.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.432+0000 7fa32ed9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa33009ec50 0x7fa33006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:13.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.432+0000 7fa327fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa33006d380 0x7fa33012ffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:45868/0 (socket says 172.21.15.89:45868) 2024-09-16T17:06:13.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.432+0000 7fa32ed9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa33009ec50 0x7fa33006ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37996/0 (socket says 172.21.15.89:37996) 2024-09-16T17:06:13.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.432+0000 7fa327fff640 1 -- 172.21.15.89:0/914192556 learned_addr learned my addr 172.21.15.89:0/914192556 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:06:13.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.432+0000 7fa32ed9d640 1 -- 172.21.15.89:0/914192556 >> v1:172.21.15.89:6789/0 conn(0x7fa33006d380 legacy=0x7fa33012ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:13.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.432+0000 7fa32ed9d640 1 -- 172.21.15.89:0/914192556 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3300710b0 con 0x7fa33009ec50 2024-09-16T17:06:13.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.432+0000 7fa32e59c640 1 -- 172.21.15.89:0/914192556 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2370846870 0 0) 0x7fa3300a0d00 con 0x7fa33006d380 2024-09-16T17:06:13.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.433+0000 7fa32ed9d640 1 --2- 172.21.15.89:0/914192556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa33009ec50 0x7fa33006ce40 crc :-1 s=READY pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cb6818cf123ec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:13.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.433+0000 7fa32e59c640 1 -- 172.21.15.89:0/914192556 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa320009d90 con 0x7fa33009ec50 2024-09-16T17:06:13.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.433+0000 7fa32e59c640 1 -- 172.21.15.89:0/914192556 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa32000e230 con 0x7fa33009ec50 2024-09-16T17:06:13.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.433+0000 7fa32e59c640 1 -- 172.21.15.89:0/914192556 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa32000e4d0 con 0x7fa33009ec50 2024-09-16T17:06:13.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.433+0000 7fa335151640 1 -- 172.21.15.89:0/914192556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa33009ec50 msgr2=0x7fa33006ce40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:13.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.433+0000 7fa335151640 1 --2- 172.21.15.89:0/914192556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa33009ec50 0x7fa33006ce40 crc :-1 s=READY pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:13.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.434+0000 7fa335151640 1 -- 172.21.15.89:0/914192556 shutdown_connections 2024-09-16T17:06:13.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.434+0000 7fa335151640 1 --2- 172.21.15.89:0/914192556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa33009ec50 0x7fa33006ce40 unknown :-1 s=CLOSED pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:13.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.434+0000 7fa335151640 1 -- 172.21.15.89:0/914192556 >> 172.21.15.89:0/914192556 conn(0x7fa330069d10 msgr2=0x7fa33009f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:13.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.434+0000 7fa335151640 1 -- 172.21.15.89:0/914192556 shutdown_connections 2024-09-16T17:06:13.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.434+0000 7fa335151640 1 -- 172.21.15.89:0/914192556 wait complete. 2024-09-16T17:06:13.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.434+0000 7fa335151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:13.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.435+0000 7fa335151640 1 Processor -- start 2024-09-16T17:06:13.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.435+0000 7fa335151640 1 -- start start 2024-09-16T17:06:13.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.436+0000 7fa335151640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa33006d380 0x7fa3301c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:13.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.436+0000 7fa335151640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa33011ef20 con 0x7fa33006d380 2024-09-16T17:06:13.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.437+0000 7fa32ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa33006d380 0x7fa3301c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:13.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.437+0000 7fa32ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa33006d380 0x7fa3301c7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37998/0 (socket says 172.21.15.89:37998) 2024-09-16T17:06:13.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.437+0000 7fa32ed9d640 1 -- 172.21.15.89:0/2820656030 learned_addr learned my addr 172.21.15.89:0/2820656030 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:13.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.437+0000 7fa32ed9d640 1 -- 172.21.15.89:0/2820656030 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33011ce20 con 0x7fa33006d380 2024-09-16T17:06:13.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.437+0000 7fa32ed9d640 1 --2- 172.21.15.89:0/2820656030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa33006d380 0x7fa3301c7b80 crc :-1 s=READY pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:13.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.437+0000 7fa3277fe640 1 -- 172.21.15.89:0/2820656030 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa320014540 con 0x7fa33006d380 2024-09-16T17:06:13.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.437+0000 7fa3277fe640 1 -- 172.21.15.89:0/2820656030 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa3200146a0 con 0x7fa33006d380 2024-09-16T17:06:13.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.437+0000 7fa335151640 1 -- 172.21.15.89:0/2820656030 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa330133550 con 0x7fa33006d380 2024-09-16T17:06:13.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.437+0000 7fa3277fe640 1 -- 172.21.15.89:0/2820656030 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa320014940 con 0x7fa33006d380 2024-09-16T17:06:13.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.437+0000 7fa335151640 1 -- 172.21.15.89:0/2820656030 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa33011ca80 con 0x7fa33006d380 2024-09-16T17:06:13.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.438+0000 7fa335151640 1 -- 172.21.15.89:0/2820656030 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa330120950 con 0x7fa33006d380 2024-09-16T17:06:13.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.438+0000 7fa3277fe640 1 -- 172.21.15.89:0/2820656030 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa320014af0 con 0x7fa33006d380 2024-09-16T17:06:13.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.439+0000 7fa3277fe640 1 --2- 172.21.15.89:0/2820656030 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fa31003e930 0x7fa310040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:13.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.439+0000 7fa3277fe640 1 -- 172.21.15.89:0/2820656030 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(726..726 src has 406..726) ==== 3431+0+0 (crc 0 0 0) 0x7fa320019040 con 0x7fa33006d380 2024-09-16T17:06:13.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.439+0000 7fa327fff640 1 --2- 172.21.15.89:0/2820656030 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fa31003e930 0x7fa310040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:13.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.439+0000 7fa327fff640 1 --2- 172.21.15.89:0/2820656030 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fa31003e930 0x7fa310040e40 crc :-1 s=READY pgs=3887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:13.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.444+0000 7fa3277fe640 1 -- 172.21.15.89:0/2820656030 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fa320018190 con 0x7fa33006d380 2024-09-16T17:06:13.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.615+0000 7fa335151640 1 -- 172.21.15.89:0/2820656030 --> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa330133550 con 0x7fa31003e930 2024-09-16T17:06:13.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.618+0000 7fa3277fe640 1 -- 172.21.15.89:0/2820656030 <== mgr.4099 v2:172.21.15.177:6800/1212166405 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109434 (crc 0 0 0) 0x7fa330133550 con 0x7fa31003e930 2024-09-16T17:06:13.620 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T17:06:13.620 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-16T17:06:13.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.620+0000 7fa335151640 1 -- 172.21.15.89:0/2820656030 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fa31003e930 msgr2=0x7fa310040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:13.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.620+0000 7fa335151640 1 --2- 172.21.15.89:0/2820656030 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fa31003e930 0x7fa310040e40 crc :-1 s=READY pgs=3887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:13.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.620+0000 7fa335151640 1 -- 172.21.15.89:0/2820656030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa33006d380 msgr2=0x7fa3301c7b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:13.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.620+0000 7fa335151640 1 --2- 172.21.15.89:0/2820656030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa33006d380 0x7fa3301c7b80 crc :-1 s=READY pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:13.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.620+0000 7fa335151640 1 -- 172.21.15.89:0/2820656030 shutdown_connections 2024-09-16T17:06:13.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.620+0000 7fa335151640 1 --2- 172.21.15.89:0/2820656030 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fa31003e930 0x7fa310040e40 unknown :-1 s=CLOSED pgs=3887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:13.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.620+0000 7fa335151640 1 --2- 172.21.15.89:0/2820656030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa33006d380 0x7fa3301c7b80 unknown :-1 s=CLOSED pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:13.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.620+0000 7fa335151640 1 -- 172.21.15.89:0/2820656030 >> 172.21.15.89:0/2820656030 conn(0x7fa330069d10 msgr2=0x7fa3301bb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:13.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.620+0000 7fa335151640 1 -- 172.21.15.89:0/2820656030 shutdown_connections 2024-09-16T17:06:13.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:13.620+0000 7fa335151640 1 -- 172.21.15.89:0/2820656030 wait complete. 2024-09-16T17:06:13.633 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":1303,"stamp":"2024-09-16T17:06:13.411892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":22932,"kb_used_data":22932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209167980,"statfs":{"total":214211493888,"available":214188011520,"internally_reserved":0,"allocated":23482368,"data_stored":23482368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001831"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.385403+0000","last_change":"2024-09-16T17:06:12.413899+0000","last_active":"2024-09-16T17:06:12.385403+0000","last_peered":"2024-09-16T17:06:12.385403+0000","last_clean":"2024-09-16T17:06:12.385403+0000","last_became_active":"2024-09-16T16:52:01.016850+0000","last_became_peered":"2024-09-16T16:52:01.016850+0000","last_unstale":"2024-09-16T17:06:12.385403+0000","last_undegraded":"2024-09-16T17:06:12.385403+0000","last_fullsized":"2024-09-16T17:06:12.385403+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.413594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.413594+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.904604+0000","last_change":"2024-09-16T17:06:11.941057+0000","last_active":"2024-09-16T17:06:11.904604+0000","last_peered":"2024-09-16T17:06:11.904604+0000","last_clean":"2024-09-16T17:06:11.904604+0000","last_became_active":"2024-09-16T16:52:01.048635+0000","last_became_peered":"2024-09-16T16:52:01.048635+0000","last_unstale":"2024-09-16T17:06:11.904604+0000","last_undegraded":"2024-09-16T17:06:11.904604+0000","last_fullsized":"2024-09-16T17:06:11.904604+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.940880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.940880+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.855405+0000","last_change":"2024-09-16T17:06:12.879234+0000","last_active":"2024-09-16T17:06:12.855405+0000","last_peered":"2024-09-16T17:06:12.855405+0000","last_clean":"2024-09-16T17:06:12.855405+0000","last_became_active":"2024-09-16T16:52:01.077074+0000","last_became_peered":"2024-09-16T16:52:01.077074+0000","last_unstale":"2024-09-16T17:06:12.855405+0000","last_undegraded":"2024-09-16T17:06:12.855405+0000","last_fullsized":"2024-09-16T17:06:12.855405+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.879060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.879060+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.517291+0000","last_change":"2024-09-16T16:52:01.007501+0000","last_active":"2024-09-16T17:06:08.517291+0000","last_peered":"2024-09-16T17:06:08.517291+0000","last_clean":"2024-09-16T17:06:08.517291+0000","last_became_active":"2024-09-16T16:52:00.995826+0000","last_became_peered":"2024-09-16T16:52:00.995826+0000","last_unstale":"2024-09-16T17:06:08.517291+0000","last_undegraded":"2024-09-16T17:06:08.517291+0000","last_fullsized":"2024-09-16T17:06:08.517291+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.382235+0000","last_change":"2024-09-16T17:06:12.407948+0000","last_active":"2024-09-16T17:06:12.382235+0000","last_peered":"2024-09-16T17:06:12.382235+0000","last_clean":"2024-09-16T17:06:12.382235+0000","last_became_active":"2024-09-16T16:52:01.066170+0000","last_became_peered":"2024-09-16T16:52:01.066170+0000","last_unstale":"2024-09-16T17:06:12.382235+0000","last_undegraded":"2024-09-16T17:06:12.382235+0000","last_fullsized":"2024-09-16T17:06:12.382235+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.407757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.407757+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.902295+0000","last_change":"2024-09-16T17:06:11.942426+0000","last_active":"2024-09-16T17:06:11.902295+0000","last_peered":"2024-09-16T17:06:11.902295+0000","last_clean":"2024-09-16T17:06:11.902295+0000","last_became_active":"2024-09-16T16:52:01.137358+0000","last_became_peered":"2024-09-16T16:52:01.137358+0000","last_unstale":"2024-09-16T17:06:11.902295+0000","last_undegraded":"2024-09-16T17:06:11.902295+0000","last_fullsized":"2024-09-16T17:06:11.902295+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.942266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.942266+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.902293+0000","last_change":"2024-09-16T17:06:11.936621+0000","last_active":"2024-09-16T17:06:11.902293+0000","last_peered":"2024-09-16T17:06:11.902293+0000","last_clean":"2024-09-16T17:06:11.902293+0000","last_became_active":"2024-09-16T16:52:01.018449+0000","last_became_peered":"2024-09-16T16:52:01.018449+0000","last_unstale":"2024-09-16T17:06:11.902293+0000","last_undegraded":"2024-09-16T17:06:11.902293+0000","last_fullsized":"2024-09-16T17:06:11.902293+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.936460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.936460+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.901425+0000","last_change":"2024-09-16T17:06:11.934761+0000","last_active":"2024-09-16T17:06:11.901425+0000","last_peered":"2024-09-16T17:06:11.901425+0000","last_clean":"2024-09-16T17:06:11.901425+0000","last_became_active":"2024-09-16T16:52:01.043446+0000","last_became_peered":"2024-09-16T16:52:01.043446+0000","last_unstale":"2024-09-16T17:06:11.901425+0000","last_undegraded":"2024-09-16T17:06:11.901425+0000","last_fullsized":"2024-09-16T17:06:11.901425+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.934556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.934556+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.509706+0000","last_change":"2024-09-16T16:52:01.002820+0000","last_active":"2024-09-16T17:06:08.509706+0000","last_peered":"2024-09-16T17:06:08.509706+0000","last_clean":"2024-09-16T17:06:08.509706+0000","last_became_active":"2024-09-16T16:52:00.984993+0000","last_became_peered":"2024-09-16T16:52:00.984993+0000","last_unstale":"2024-09-16T17:06:08.509706+0000","last_undegraded":"2024-09-16T17:06:08.509706+0000","last_fullsized":"2024-09-16T17:06:08.509706+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.858177+0000","last_change":"2024-09-16T17:06:12.882102+0000","last_active":"2024-09-16T17:06:12.858177+0000","last_peered":"2024-09-16T17:06:12.858177+0000","last_clean":"2024-09-16T17:06:12.858177+0000","last_became_active":"2024-09-16T16:52:01.118033+0000","last_became_peered":"2024-09-16T16:52:01.118033+0000","last_unstale":"2024-09-16T17:06:12.858177+0000","last_undegraded":"2024-09-16T17:06:12.858177+0000","last_fullsized":"2024-09-16T17:06:12.858177+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.881935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.881935+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.513633+0000","last_change":"2024-09-16T16:52:01.047718+0000","last_active":"2024-09-16T17:06:08.513633+0000","last_peered":"2024-09-16T17:06:08.513633+0000","last_clean":"2024-09-16T17:06:08.513633+0000","last_became_active":"2024-09-16T16:52:01.018199+0000","last_became_peered":"2024-09-16T16:52:01.018199+0000","last_unstale":"2024-09-16T17:06:08.513633+0000","last_undegraded":"2024-09-16T17:06:08.513633+0000","last_fullsized":"2024-09-16T17:06:08.513633+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.898355+0000","last_change":"2024-09-16T17:06:11.945674+0000","last_active":"2024-09-16T17:06:11.898355+0000","last_peered":"2024-09-16T17:06:11.898355+0000","last_clean":"2024-09-16T17:06:11.898355+0000","last_became_active":"2024-09-16T16:52:01.098860+0000","last_became_peered":"2024-09-16T16:52:01.098860+0000","last_unstale":"2024-09-16T17:06:11.898355+0000","last_undegraded":"2024-09-16T17:06:11.898355+0000","last_fullsized":"2024-09-16T17:06:11.898355+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.945520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.945520+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.517960+0000","last_change":"2024-09-16T16:52:01.038538+0000","last_active":"2024-09-16T17:06:08.517960+0000","last_peered":"2024-09-16T17:06:08.517960+0000","last_clean":"2024-09-16T17:06:08.517960+0000","last_became_active":"2024-09-16T16:52:01.014800+0000","last_became_peered":"2024-09-16T16:52:01.014800+0000","last_unstale":"2024-09-16T17:06:08.517960+0000","last_undegraded":"2024-09-16T17:06:08.517960+0000","last_fullsized":"2024-09-16T17:06:08.517960+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.518834+0000","last_change":"2024-09-16T16:52:01.079983+0000","last_active":"2024-09-16T17:06:08.518834+0000","last_peered":"2024-09-16T17:06:08.518834+0000","last_clean":"2024-09-16T17:06:08.518834+0000","last_became_active":"2024-09-16T16:52:01.070554+0000","last_became_peered":"2024-09-16T16:52:01.070554+0000","last_unstale":"2024-09-16T17:06:08.518834+0000","last_undegraded":"2024-09-16T17:06:08.518834+0000","last_fullsized":"2024-09-16T17:06:08.518834+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.900151+0000","last_change":"2024-09-16T17:06:11.942457+0000","last_active":"2024-09-16T17:06:11.900151+0000","last_peered":"2024-09-16T17:06:11.900151+0000","last_clean":"2024-09-16T17:06:11.900151+0000","last_became_active":"2024-09-16T16:52:01.163260+0000","last_became_peered":"2024-09-16T16:52:01.163260+0000","last_unstale":"2024-09-16T17:06:11.900151+0000","last_undegraded":"2024-09-16T17:06:11.900151+0000","last_fullsized":"2024-09-16T17:06:11.900151+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.942294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.942294+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.896700+0000","last_change":"2024-09-16T17:06:11.947009+0000","last_active":"2024-09-16T17:06:11.896700+0000","last_peered":"2024-09-16T17:06:11.896700+0000","last_clean":"2024-09-16T17:06:11.896700+0000","last_became_active":"2024-09-16T16:52:01.039791+0000","last_became_peered":"2024-09-16T16:52:01.039791+0000","last_unstale":"2024-09-16T17:06:11.896700+0000","last_undegraded":"2024-09-16T17:06:11.896700+0000","last_fullsized":"2024-09-16T17:06:11.896700+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.946845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.946845+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.897711+0000","last_change":"2024-09-16T17:06:11.927273+0000","last_active":"2024-09-16T17:06:11.897711+0000","last_peered":"2024-09-16T17:06:11.897711+0000","last_clean":"2024-09-16T17:06:11.897711+0000","last_became_active":"2024-09-16T16:52:01.063909+0000","last_became_peered":"2024-09-16T16:52:01.063909+0000","last_unstale":"2024-09-16T17:06:11.897711+0000","last_undegraded":"2024-09-16T17:06:11.897711+0000","last_fullsized":"2024-09-16T17:06:11.897711+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.927109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.927109+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.512849+0000","last_change":"2024-09-16T16:52:01.160111+0000","last_active":"2024-09-16T17:06:08.512849+0000","last_peered":"2024-09-16T17:06:08.512849+0000","last_clean":"2024-09-16T17:06:08.512849+0000","last_became_active":"2024-09-16T16:52:01.138167+0000","last_became_peered":"2024-09-16T16:52:01.138167+0000","last_unstale":"2024-09-16T17:06:08.512849+0000","last_undegraded":"2024-09-16T17:06:08.512849+0000","last_fullsized":"2024-09-16T17:06:08.512849+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.856462+0000","last_change":"2024-09-16T17:06:12.880151+0000","last_active":"2024-09-16T17:06:12.856462+0000","last_peered":"2024-09-16T17:06:12.856462+0000","last_clean":"2024-09-16T17:06:12.856462+0000","last_became_active":"2024-09-16T16:52:01.016490+0000","last_became_peered":"2024-09-16T16:52:01.016490+0000","last_unstale":"2024-09-16T17:06:12.856462+0000","last_undegraded":"2024-09-16T17:06:12.856462+0000","last_fullsized":"2024-09-16T17:06:12.856462+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.879985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.879985+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.380967+0000","last_change":"2024-09-16T17:06:12.407871+0000","last_active":"2024-09-16T17:06:12.380967+0000","last_peered":"2024-09-16T17:06:12.380967+0000","last_clean":"2024-09-16T17:06:12.380967+0000","last_became_active":"2024-09-16T16:52:00.998521+0000","last_became_peered":"2024-09-16T16:52:00.998521+0000","last_unstale":"2024-09-16T17:06:12.380967+0000","last_undegraded":"2024-09-16T17:06:12.380967+0000","last_fullsized":"2024-09-16T17:06:12.380967+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.407611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.407611+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.382297+0000","last_change":"2024-09-16T17:06:12.420719+0000","last_active":"2024-09-16T17:06:12.382297+0000","last_peered":"2024-09-16T17:06:12.382297+0000","last_clean":"2024-09-16T17:06:12.382297+0000","last_became_active":"2024-09-16T16:52:01.040747+0000","last_became_peered":"2024-09-16T16:52:01.040747+0000","last_unstale":"2024-09-16T17:06:12.382297+0000","last_undegraded":"2024-09-16T17:06:12.382297+0000","last_fullsized":"2024-09-16T17:06:12.382297+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.420426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.420426+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.379154+0000","last_change":"2024-09-16T17:06:12.410421+0000","last_active":"2024-09-16T17:06:12.379154+0000","last_peered":"2024-09-16T17:06:12.379154+0000","last_clean":"2024-09-16T17:06:12.379154+0000","last_became_active":"2024-09-16T16:52:01.017647+0000","last_became_peered":"2024-09-16T16:52:01.017647+0000","last_unstale":"2024-09-16T17:06:12.379154+0000","last_undegraded":"2024-09-16T17:06:12.379154+0000","last_fullsized":"2024-09-16T17:06:12.379154+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.410209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.410209+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.853660+0000","last_change":"2024-09-16T17:06:12.877972+0000","last_active":"2024-09-16T17:06:12.853660+0000","last_peered":"2024-09-16T17:06:12.853660+0000","last_clean":"2024-09-16T17:06:12.853660+0000","last_became_active":"2024-09-16T16:52:01.096609+0000","last_became_peered":"2024-09-16T16:52:01.096609+0000","last_unstale":"2024-09-16T17:06:12.853660+0000","last_undegraded":"2024-09-16T17:06:12.853660+0000","last_fullsized":"2024-09-16T17:06:12.853660+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.877755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.877755+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.510458+0000","last_change":"2024-09-16T16:52:01.188616+0000","last_active":"2024-09-16T17:06:08.510458+0000","last_peered":"2024-09-16T17:06:08.510458+0000","last_clean":"2024-09-16T17:06:08.510458+0000","last_became_active":"2024-09-16T16:52:01.182688+0000","last_became_peered":"2024-09-16T16:52:01.182688+0000","last_unstale":"2024-09-16T17:06:08.510458+0000","last_undegraded":"2024-09-16T17:06:08.510458+0000","last_fullsized":"2024-09-16T17:06:08.510458+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.519473+0000","last_change":"2024-09-16T16:52:01.046742+0000","last_active":"2024-09-16T17:06:08.519473+0000","last_peered":"2024-09-16T17:06:08.519473+0000","last_clean":"2024-09-16T17:06:08.519473+0000","last_became_active":"2024-09-16T16:52:01.022683+0000","last_became_peered":"2024-09-16T16:52:01.022683+0000","last_unstale":"2024-09-16T17:06:08.519473+0000","last_undegraded":"2024-09-16T17:06:08.519473+0000","last_fullsized":"2024-09-16T17:06:08.519473+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.900284+0000","last_change":"2024-09-16T17:06:11.932236+0000","last_active":"2024-09-16T17:06:11.900284+0000","last_peered":"2024-09-16T17:06:11.900284+0000","last_clean":"2024-09-16T17:06:11.900284+0000","last_became_active":"2024-09-16T16:52:01.014432+0000","last_became_peered":"2024-09-16T16:52:01.014432+0000","last_unstale":"2024-09-16T17:06:11.900284+0000","last_undegraded":"2024-09-16T17:06:11.900284+0000","last_fullsized":"2024-09-16T17:06:11.900284+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.932073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.932073+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.517146+0000","last_change":"2024-09-16T16:52:01.168350+0000","last_active":"2024-09-16T17:06:08.517146+0000","last_peered":"2024-09-16T17:06:08.517146+0000","last_clean":"2024-09-16T17:06:08.517146+0000","last_became_active":"2024-09-16T16:52:01.150691+0000","last_became_peered":"2024-09-16T16:52:01.150691+0000","last_unstale":"2024-09-16T17:06:08.517146+0000","last_undegraded":"2024-09-16T17:06:08.517146+0000","last_fullsized":"2024-09-16T17:06:08.517146+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.894406+0000","last_change":"2024-09-16T17:06:11.944420+0000","last_active":"2024-09-16T17:06:11.894406+0000","last_peered":"2024-09-16T17:06:11.894406+0000","last_clean":"2024-09-16T17:06:11.894406+0000","last_became_active":"2024-09-16T16:52:01.054274+0000","last_became_peered":"2024-09-16T16:52:01.054274+0000","last_unstale":"2024-09-16T17:06:11.894406+0000","last_undegraded":"2024-09-16T17:06:11.894406+0000","last_fullsized":"2024-09-16T17:06:11.894406+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.944220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.944220+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.896238+0000","last_change":"2024-09-16T17:06:11.930721+0000","last_active":"2024-09-16T17:06:11.896238+0000","last_peered":"2024-09-16T17:06:11.896238+0000","last_clean":"2024-09-16T17:06:11.896238+0000","last_became_active":"2024-09-16T16:52:01.056754+0000","last_became_peered":"2024-09-16T16:52:01.056754+0000","last_unstale":"2024-09-16T17:06:11.896238+0000","last_undegraded":"2024-09-16T17:06:11.896238+0000","last_fullsized":"2024-09-16T17:06:11.896238+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.930437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.930437+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.892840+0000","last_change":"2024-09-16T17:06:11.935786+0000","last_active":"2024-09-16T17:06:11.892840+0000","last_peered":"2024-09-16T17:06:11.892840+0000","last_clean":"2024-09-16T17:06:11.892840+0000","last_became_active":"2024-09-16T16:52:01.142598+0000","last_became_peered":"2024-09-16T16:52:01.142598+0000","last_unstale":"2024-09-16T17:06:11.892840+0000","last_undegraded":"2024-09-16T17:06:11.892840+0000","last_fullsized":"2024-09-16T17:06:11.892840+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.935616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.935616+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1484,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.380013+0000","last_change":"2024-09-16T17:06:12.433296+0000","last_active":"2024-09-16T17:06:12.380013+0000","last_peered":"2024-09-16T17:06:12.380013+0000","last_clean":"2024-09-16T17:06:12.380013+0000","last_became_active":"2024-09-16T16:52:01.029529+0000","last_became_peered":"2024-09-16T16:52:01.029529+0000","last_unstale":"2024-09-16T17:06:12.380013+0000","last_undegraded":"2024-09-16T17:06:12.380013+0000","last_fullsized":"2024-09-16T17:06:12.380013+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"239'7","last_scrub_stamp":"2024-09-16T17:06:12.433093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.433093+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.855401+0000","last_change":"2024-09-16T17:06:12.878428+0000","last_active":"2024-09-16T17:06:12.855401+0000","last_peered":"2024-09-16T17:06:12.855401+0000","last_clean":"2024-09-16T17:06:12.855401+0000","last_became_active":"2024-09-16T16:52:00.988610+0000","last_became_peered":"2024-09-16T16:52:00.988610+0000","last_unstale":"2024-09-16T17:06:12.855401+0000","last_undegraded":"2024-09-16T17:06:12.855401+0000","last_fullsized":"2024-09-16T17:06:12.855401+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.878256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.878256+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2150,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.378398+0000","last_change":"2024-09-16T17:06:12.398213+0000","last_active":"2024-09-16T17:06:12.378398+0000","last_peered":"2024-09-16T17:06:12.378398+0000","last_clean":"2024-09-16T17:06:12.378398+0000","last_became_active":"2024-09-16T16:46:48.301220+0000","last_became_peered":"2024-09-16T16:46:48.301220+0000","last_unstale":"2024-09-16T17:06:12.378398+0000","last_undegraded":"2024-09-16T17:06:12.378398+0000","last_fullsized":"2024-09-16T17:06:12.378398+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.397938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.397938+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2150,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.853826+0000","last_change":"2024-09-16T17:06:12.881416+0000","last_active":"2024-09-16T17:06:12.853826+0000","last_peered":"2024-09-16T17:06:12.853826+0000","last_clean":"2024-09-16T17:06:12.853826+0000","last_became_active":"2024-09-16T16:46:48.285243+0000","last_became_peered":"2024-09-16T16:46:48.285243+0000","last_unstale":"2024-09-16T17:06:12.853826+0000","last_undegraded":"2024-09-16T17:06:12.853826+0000","last_fullsized":"2024-09-16T17:06:12.853826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.881245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.881245+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2148,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.517850+0000","last_change":"2024-09-16T16:46:50.249574+0000","last_active":"2024-09-16T17:06:08.517850+0000","last_peered":"2024-09-16T17:06:08.517850+0000","last_clean":"2024-09-16T17:06:08.517850+0000","last_became_active":"2024-09-16T16:46:48.295184+0000","last_became_peered":"2024-09-16T16:46:48.295184+0000","last_unstale":"2024-09-16T17:06:08.517850+0000","last_undegraded":"2024-09-16T17:06:08.517850+0000","last_fullsized":"2024-09-16T17:06:08.517850+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2150,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.850588+0000","last_change":"2024-09-16T17:06:12.869474+0000","last_active":"2024-09-16T17:06:12.850588+0000","last_peered":"2024-09-16T17:06:12.850588+0000","last_clean":"2024-09-16T17:06:12.850588+0000","last_became_active":"2024-09-16T16:46:48.280354+0000","last_became_peered":"2024-09-16T16:46:48.280354+0000","last_unstale":"2024-09-16T17:06:12.850588+0000","last_undegraded":"2024-09-16T17:06:12.850588+0000","last_fullsized":"2024-09-16T17:06:12.850588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.869142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.869142+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2152,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.892802+0000","last_change":"2024-09-16T17:06:11.928864+0000","last_active":"2024-09-16T17:06:11.892802+0000","last_peered":"2024-09-16T17:06:11.892802+0000","last_clean":"2024-09-16T17:06:11.892802+0000","last_became_active":"2024-09-16T16:46:48.303026+0000","last_became_peered":"2024-09-16T16:46:48.303026+0000","last_unstale":"2024-09-16T17:06:11.892802+0000","last_undegraded":"2024-09-16T17:06:11.892802+0000","last_fullsized":"2024-09-16T17:06:11.892802+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2024-09-16T17:06:11.928668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.928668+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2150,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.376442+0000","last_change":"2024-09-16T17:06:12.403638+0000","last_active":"2024-09-16T17:06:12.376442+0000","last_peered":"2024-09-16T17:06:12.376442+0000","last_clean":"2024-09-16T17:06:12.376442+0000","last_became_active":"2024-09-16T16:46:48.285463+0000","last_became_peered":"2024-09-16T16:46:48.285463+0000","last_unstale":"2024-09-16T17:06:12.376442+0000","last_undegraded":"2024-09-16T17:06:12.376442+0000","last_fullsized":"2024-09-16T17:06:12.376442+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.403458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.403458+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2150,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.892792+0000","last_change":"2024-09-16T17:06:11.916677+0000","last_active":"2024-09-16T17:06:11.892792+0000","last_peered":"2024-09-16T17:06:11.892792+0000","last_clean":"2024-09-16T17:06:11.892792+0000","last_became_active":"2024-09-16T16:46:48.281970+0000","last_became_peered":"2024-09-16T16:46:48.281970+0000","last_unstale":"2024-09-16T17:06:11.892792+0000","last_undegraded":"2024-09-16T17:06:11.892792+0000","last_fullsized":"2024-09-16T17:06:11.892792+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.916511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.916511+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2151,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.378241+0000","last_change":"2024-09-16T17:06:12.430714+0000","last_active":"2024-09-16T17:06:12.378241+0000","last_peered":"2024-09-16T17:06:12.378241+0000","last_clean":"2024-09-16T17:06:12.378241+0000","last_became_active":"2024-09-16T16:46:48.282002+0000","last_became_peered":"2024-09-16T16:46:48.282002+0000","last_unstale":"2024-09-16T17:06:12.378241+0000","last_undegraded":"2024-09-16T17:06:12.378241+0000","last_fullsized":"2024-09-16T17:06:12.378241+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2024-09-16T17:06:12.430518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.430518+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2220,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.502406+0000","last_change":"2024-09-16T16:46:46.272094+0000","last_active":"2024-09-16T17:06:08.502406+0000","last_peered":"2024-09-16T17:06:08.502406+0000","last_clean":"2024-09-16T17:06:08.502406+0000","last_became_active":"2024-09-16T16:46:46.253718+0000","last_became_peered":"2024-09-16T16:46:46.253718+0000","last_unstale":"2024-09-16T17:06:08.502406+0000","last_undegraded":"2024-09-16T17:06:08.502406+0000","last_fullsized":"2024-09-16T17:06:08.502406+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.198151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.198151+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.198151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214188011520,"internally_reserved":0,"allocated":23482368,"data_stored":23482368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214188011520,"internally_reserved":0,"allocated":23482368,"data_stored":23482368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53546643456,"internally_reserved":0,"allocated":6230016,"data_stored":6230016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6084,"kb_used_data":6084,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291644,"statfs":{"total":53552873472,"available":53546643456,"internally_reserved":0,"allocated":6230016,"data_stored":6230016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5196,"kb_used_data":5196,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292532,"statfs":{"total":53552873472,"available":53547552768,"internally_reserved":0,"allocated":5320704,"data_stored":5320704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5176,"kb_used_data":5176,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292552,"statfs":{"total":53552873472,"available":53547573248,"internally_reserved":0,"allocated":5300224,"data_stored":5300224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6476,"kb_used_data":6476,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291252,"statfs":{"total":53552873472,"available":53546242048,"internally_reserved":0,"allocated":6631424,"data_stored":6631424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53546643456,"internally_reserved":0,"allocated":6230016,"data_stored":6230016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53546242048,"internally_reserved":0,"allocated":6631424,"data_stored":6631424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53547573248,"internally_reserved":0,"allocated":5300224,"data_stored":5300224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53547552768,"internally_reserved":0,"allocated":5320704,"data_stored":5320704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53546643456,"internally_reserved":0,"allocated":6230016,"data_stored":6230016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":53552873472,"available":53546242048,"internally_reserved":0,"allocated":6631424,"data_stored":6631424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":53552873472,"available":53547573248,"internally_reserved":0,"allocated":5300224,"data_stored":5300224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":53552873472,"available":53547552768,"internally_reserved":0,"allocated":5320704,"data_stored":5320704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":53552873472,"available":53546643456,"internally_reserved":0,"allocated":6230016,"data_stored":6230016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:06:13.639 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:13.639 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:13.639 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:13.639 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:13.640 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:13.640 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:13.640 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:13.640 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:13.640 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:13.641 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T16:46:47.206999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:13.641 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T16:46:45.198151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:13.641 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T17:06:33.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:06:33.762 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.758+0000 7fbfc4591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:33.763 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.762+0000 7fbfc4591640 1 Processor -- start 2024-09-16T17:06:33.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.763+0000 7fbfc4591640 1 -- start start 2024-09-16T17:06:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.764+0000 7fbfc4591640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbfbc09cfc0 0x7fbfbc09ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.764+0000 7fbfc4591640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfbc09cd70 con 0x7fbfbc09bf90 2024-09-16T17:06:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.764+0000 7fbfc4591640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7fbfbc09d560 con 0x7fbfbc09cfc0 2024-09-16T17:06:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.764+0000 7fbfc232d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbfbc09cfc0 0x7fbfbc09ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.764+0000 7fbfc1b2c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fbfbc09bf90 0x7fbfbc132240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49782/0 (socket says 172.21.15.89:49782) 2024-09-16T17:06:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.764+0000 7fbfc1b2c640 1 -- 172.21.15.89:0/1847756872 learned_addr learned my addr 172.21.15.89:0/1847756872 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:06:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.764+0000 7fbfc232d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbfbc09cfc0 0x7fbfbc09ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47574/0 (socket says 172.21.15.89:47574) 2024-09-16T17:06:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.764+0000 7fbfc232d640 1 -- 172.21.15.89:0/1847756872 >> v1:172.21.15.89:6789/0 conn(0x7fbfbc09bf90 legacy=0x7fbfbc132240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:33.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.764+0000 7fbfc232d640 1 -- 172.21.15.89:0/1847756872 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfbc071cb0 con 0x7fbfbc09cfc0 2024-09-16T17:06:33.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.764+0000 7fbfc132b640 1 -- 172.21.15.89:0/1847756872 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3639179579 0 0) 0x7fbfac001110 con 0x7fbfbc09bf90 2024-09-16T17:06:33.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.764+0000 7fbfc232d640 1 --2- 172.21.15.89:0/1847756872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc09cfc0 0x7fbfbc09ba50 crc :-1 s=READY pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5f0a8effe1904c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:33.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.765+0000 7fbfc132b640 1 -- 172.21.15.89:0/1847756872 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbfb8009d90 con 0x7fbfbc09cfc0 2024-09-16T17:06:33.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.765+0000 7fbfc132b640 1 -- 172.21.15.89:0/1847756872 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbfb800e230 con 0x7fbfbc09cfc0 2024-09-16T17:06:33.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.765+0000 7fbfc132b640 1 -- 172.21.15.89:0/1847756872 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbfb800e4d0 con 0x7fbfbc09cfc0 2024-09-16T17:06:33.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.765+0000 7fbfc4591640 1 -- 172.21.15.89:0/1847756872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc09cfc0 msgr2=0x7fbfbc09ba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:33.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.765+0000 7fbfc4591640 1 --2- 172.21.15.89:0/1847756872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc09cfc0 0x7fbfbc09ba50 crc :-1 s=READY pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:33.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.765+0000 7fbfc4591640 1 -- 172.21.15.89:0/1847756872 shutdown_connections 2024-09-16T17:06:33.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.765+0000 7fbfc4591640 1 --2- 172.21.15.89:0/1847756872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc09cfc0 0x7fbfbc09ba50 unknown :-1 s=CLOSED pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:33.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.765+0000 7fbfc4591640 1 -- 172.21.15.89:0/1847756872 >> 172.21.15.89:0/1847756872 conn(0x7fbfbc0690e0 msgr2=0x7fbfbc0694f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:33.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.766+0000 7fbfc4591640 1 -- 172.21.15.89:0/1847756872 shutdown_connections 2024-09-16T17:06:33.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.766+0000 7fbfc4591640 1 -- 172.21.15.89:0/1847756872 wait complete. 2024-09-16T17:06:33.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.766+0000 7fbfc4591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:33.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.767+0000 7fbfc4591640 1 Processor -- start 2024-09-16T17:06:33.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.767+0000 7fbfc4591640 1 -- start start 2024-09-16T17:06:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.768+0000 7fbfc4591640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc09bf90 0x7fbfbc121120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.768+0000 7fbfc4591640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc1321c0 con 0x7fbfbc09bf90 2024-09-16T17:06:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.768+0000 7fbfc232d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc09bf90 0x7fbfbc121120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.768+0000 7fbfc232d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc09bf90 0x7fbfbc121120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47580/0 (socket says 172.21.15.89:47580) 2024-09-16T17:06:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.768+0000 7fbfc232d640 1 -- 172.21.15.89:0/2302134341 learned_addr learned my addr 172.21.15.89:0/2302134341 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:33.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.769+0000 7fbfc232d640 1 -- 172.21.15.89:0/2302134341 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfbc11f9e0 con 0x7fbfbc09bf90 2024-09-16T17:06:33.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.769+0000 7fbfc232d640 1 --2- 172.21.15.89:0/2302134341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc09bf90 0x7fbfbc121120 crc :-1 s=READY pgs=13021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:33.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.769+0000 7fbfb2ffd640 1 -- 172.21.15.89:0/2302134341 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbfb8013530 con 0x7fbfbc09bf90 2024-09-16T17:06:33.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.769+0000 7fbfb2ffd640 1 -- 172.21.15.89:0/2302134341 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbfb8013690 con 0x7fbfbc09bf90 2024-09-16T17:06:33.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.769+0000 7fbfc4591640 1 -- 172.21.15.89:0/2302134341 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfbc11f390 con 0x7fbfbc09bf90 2024-09-16T17:06:33.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.769+0000 7fbfb2ffd640 1 -- 172.21.15.89:0/2302134341 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbfb8013930 con 0x7fbfbc09bf90 2024-09-16T17:06:33.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.769+0000 7fbfc4591640 1 -- 172.21.15.89:0/2302134341 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfbc11f080 con 0x7fbfbc09bf90 2024-09-16T17:06:33.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.770+0000 7fbfb2ffd640 1 -- 172.21.15.89:0/2302134341 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fbfb8013ae0 con 0x7fbfbc09bf90 2024-09-16T17:06:33.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.770+0000 7fbfb2ffd640 1 --2- 172.21.15.89:0/2302134341 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fbfa003e930 0x7fbfa0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:33.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.770+0000 7fbfb2ffd640 1 -- 172.21.15.89:0/2302134341 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(726..726 src has 406..726) ==== 3431+0+0 (crc 0 0 0) 0x7fbfb8018040 con 0x7fbfbc09bf90 2024-09-16T17:06:33.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.770+0000 7fbfc4591640 1 -- 172.21.15.89:0/2302134341 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfbc121e30 con 0x7fbfbc09bf90 2024-09-16T17:06:33.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.770+0000 7fbfc1b2c640 1 --2- 172.21.15.89:0/2302134341 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fbfa003e930 0x7fbfa0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:33.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.771+0000 7fbfc1b2c640 1 --2- 172.21.15.89:0/2302134341 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fbfa003e930 0x7fbfa0040e40 crc :-1 s=READY pgs=3888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:33.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.776+0000 7fbfb2ffd640 1 -- 172.21.15.89:0/2302134341 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fbfb8011380 con 0x7fbfbc09bf90 2024-09-16T17:06:33.948 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.947+0000 7fbfc4591640 1 -- 172.21.15.89:0/2302134341 --> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbfbc09ba50 con 0x7fbfa003e930 2024-09-16T17:06:33.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.950+0000 7fbfb2ffd640 1 -- 172.21.15.89:0/2302134341 <== mgr.4099 v2:172.21.15.177:6800/1212166405 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109420 (crc 0 0 0) 0x7fbfbc09ba50 con 0x7fbfa003e930 2024-09-16T17:06:33.951 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T17:06:33.952 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-16T17:06:33.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.952+0000 7fbfc4591640 1 -- 172.21.15.89:0/2302134341 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fbfa003e930 msgr2=0x7fbfa0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:33.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.952+0000 7fbfc4591640 1 --2- 172.21.15.89:0/2302134341 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fbfa003e930 0x7fbfa0040e40 crc :-1 s=READY pgs=3888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:33.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.952+0000 7fbfc4591640 1 -- 172.21.15.89:0/2302134341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc09bf90 msgr2=0x7fbfbc121120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:33.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.952+0000 7fbfc4591640 1 --2- 172.21.15.89:0/2302134341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc09bf90 0x7fbfbc121120 crc :-1 s=READY pgs=13021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:33.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.952+0000 7fbfc4591640 1 -- 172.21.15.89:0/2302134341 shutdown_connections 2024-09-16T17:06:33.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.952+0000 7fbfc4591640 1 --2- 172.21.15.89:0/2302134341 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7fbfa003e930 0x7fbfa0040e40 unknown :-1 s=CLOSED pgs=3888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:33.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.952+0000 7fbfc4591640 1 --2- 172.21.15.89:0/2302134341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfbc09bf90 0x7fbfbc121120 unknown :-1 s=CLOSED pgs=13021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:33.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.952+0000 7fbfc4591640 1 -- 172.21.15.89:0/2302134341 >> 172.21.15.89:0/2302134341 conn(0x7fbfbc0690e0 msgr2=0x7fbfbc0a1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:33.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.952+0000 7fbfc4591640 1 -- 172.21.15.89:0/2302134341 shutdown_connections 2024-09-16T17:06:33.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:33.952+0000 7fbfc4591640 1 -- 172.21.15.89:0/2302134341 wait complete. 2024-09-16T17:06:33.964 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":1313,"stamp":"2024-09-16T17:06:33.416761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":22932,"kb_used_data":22932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209167980,"statfs":{"total":214211493888,"available":214188011520,"internally_reserved":0,"allocated":23482368,"data_stored":23482368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003021"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.385403+0000","last_change":"2024-09-16T17:06:12.413899+0000","last_active":"2024-09-16T17:06:12.385403+0000","last_peered":"2024-09-16T17:06:12.385403+0000","last_clean":"2024-09-16T17:06:12.385403+0000","last_became_active":"2024-09-16T16:52:01.016850+0000","last_became_peered":"2024-09-16T16:52:01.016850+0000","last_unstale":"2024-09-16T17:06:12.385403+0000","last_undegraded":"2024-09-16T17:06:12.385403+0000","last_fullsized":"2024-09-16T17:06:12.385403+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.413594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.413594+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.904604+0000","last_change":"2024-09-16T17:06:11.941057+0000","last_active":"2024-09-16T17:06:11.904604+0000","last_peered":"2024-09-16T17:06:11.904604+0000","last_clean":"2024-09-16T17:06:11.904604+0000","last_became_active":"2024-09-16T16:52:01.048635+0000","last_became_peered":"2024-09-16T16:52:01.048635+0000","last_unstale":"2024-09-16T17:06:11.904604+0000","last_undegraded":"2024-09-16T17:06:11.904604+0000","last_fullsized":"2024-09-16T17:06:11.904604+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.940880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.940880+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.855405+0000","last_change":"2024-09-16T17:06:12.879234+0000","last_active":"2024-09-16T17:06:12.855405+0000","last_peered":"2024-09-16T17:06:12.855405+0000","last_clean":"2024-09-16T17:06:12.855405+0000","last_became_active":"2024-09-16T16:52:01.077074+0000","last_became_peered":"2024-09-16T16:52:01.077074+0000","last_unstale":"2024-09-16T17:06:12.855405+0000","last_undegraded":"2024-09-16T17:06:12.855405+0000","last_fullsized":"2024-09-16T17:06:12.855405+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.879060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.879060+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.517291+0000","last_change":"2024-09-16T16:52:01.007501+0000","last_active":"2024-09-16T17:06:08.517291+0000","last_peered":"2024-09-16T17:06:08.517291+0000","last_clean":"2024-09-16T17:06:08.517291+0000","last_became_active":"2024-09-16T16:52:00.995826+0000","last_became_peered":"2024-09-16T16:52:00.995826+0000","last_unstale":"2024-09-16T17:06:08.517291+0000","last_undegraded":"2024-09-16T17:06:08.517291+0000","last_fullsized":"2024-09-16T17:06:08.517291+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.382235+0000","last_change":"2024-09-16T17:06:12.407948+0000","last_active":"2024-09-16T17:06:12.382235+0000","last_peered":"2024-09-16T17:06:12.382235+0000","last_clean":"2024-09-16T17:06:12.382235+0000","last_became_active":"2024-09-16T16:52:01.066170+0000","last_became_peered":"2024-09-16T16:52:01.066170+0000","last_unstale":"2024-09-16T17:06:12.382235+0000","last_undegraded":"2024-09-16T17:06:12.382235+0000","last_fullsized":"2024-09-16T17:06:12.382235+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.407757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.407757+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.902295+0000","last_change":"2024-09-16T17:06:11.942426+0000","last_active":"2024-09-16T17:06:11.902295+0000","last_peered":"2024-09-16T17:06:11.902295+0000","last_clean":"2024-09-16T17:06:11.902295+0000","last_became_active":"2024-09-16T16:52:01.137358+0000","last_became_peered":"2024-09-16T16:52:01.137358+0000","last_unstale":"2024-09-16T17:06:11.902295+0000","last_undegraded":"2024-09-16T17:06:11.902295+0000","last_fullsized":"2024-09-16T17:06:11.902295+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.942266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.942266+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.902293+0000","last_change":"2024-09-16T17:06:11.936621+0000","last_active":"2024-09-16T17:06:11.902293+0000","last_peered":"2024-09-16T17:06:11.902293+0000","last_clean":"2024-09-16T17:06:11.902293+0000","last_became_active":"2024-09-16T16:52:01.018449+0000","last_became_peered":"2024-09-16T16:52:01.018449+0000","last_unstale":"2024-09-16T17:06:11.902293+0000","last_undegraded":"2024-09-16T17:06:11.902293+0000","last_fullsized":"2024-09-16T17:06:11.902293+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.936460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.936460+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.901425+0000","last_change":"2024-09-16T17:06:11.934761+0000","last_active":"2024-09-16T17:06:11.901425+0000","last_peered":"2024-09-16T17:06:11.901425+0000","last_clean":"2024-09-16T17:06:11.901425+0000","last_became_active":"2024-09-16T16:52:01.043446+0000","last_became_peered":"2024-09-16T16:52:01.043446+0000","last_unstale":"2024-09-16T17:06:11.901425+0000","last_undegraded":"2024-09-16T17:06:11.901425+0000","last_fullsized":"2024-09-16T17:06:11.901425+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.934556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.934556+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.509706+0000","last_change":"2024-09-16T16:52:01.002820+0000","last_active":"2024-09-16T17:06:08.509706+0000","last_peered":"2024-09-16T17:06:08.509706+0000","last_clean":"2024-09-16T17:06:08.509706+0000","last_became_active":"2024-09-16T16:52:00.984993+0000","last_became_peered":"2024-09-16T16:52:00.984993+0000","last_unstale":"2024-09-16T17:06:08.509706+0000","last_undegraded":"2024-09-16T17:06:08.509706+0000","last_fullsized":"2024-09-16T17:06:08.509706+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.858177+0000","last_change":"2024-09-16T17:06:12.882102+0000","last_active":"2024-09-16T17:06:12.858177+0000","last_peered":"2024-09-16T17:06:12.858177+0000","last_clean":"2024-09-16T17:06:12.858177+0000","last_became_active":"2024-09-16T16:52:01.118033+0000","last_became_peered":"2024-09-16T16:52:01.118033+0000","last_unstale":"2024-09-16T17:06:12.858177+0000","last_undegraded":"2024-09-16T17:06:12.858177+0000","last_fullsized":"2024-09-16T17:06:12.858177+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.881935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.881935+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.513633+0000","last_change":"2024-09-16T16:52:01.047718+0000","last_active":"2024-09-16T17:06:08.513633+0000","last_peered":"2024-09-16T17:06:08.513633+0000","last_clean":"2024-09-16T17:06:08.513633+0000","last_became_active":"2024-09-16T16:52:01.018199+0000","last_became_peered":"2024-09-16T16:52:01.018199+0000","last_unstale":"2024-09-16T17:06:08.513633+0000","last_undegraded":"2024-09-16T17:06:08.513633+0000","last_fullsized":"2024-09-16T17:06:08.513633+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.898355+0000","last_change":"2024-09-16T17:06:11.945674+0000","last_active":"2024-09-16T17:06:11.898355+0000","last_peered":"2024-09-16T17:06:11.898355+0000","last_clean":"2024-09-16T17:06:11.898355+0000","last_became_active":"2024-09-16T16:52:01.098860+0000","last_became_peered":"2024-09-16T16:52:01.098860+0000","last_unstale":"2024-09-16T17:06:11.898355+0000","last_undegraded":"2024-09-16T17:06:11.898355+0000","last_fullsized":"2024-09-16T17:06:11.898355+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.945520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.945520+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.517960+0000","last_change":"2024-09-16T16:52:01.038538+0000","last_active":"2024-09-16T17:06:08.517960+0000","last_peered":"2024-09-16T17:06:08.517960+0000","last_clean":"2024-09-16T17:06:08.517960+0000","last_became_active":"2024-09-16T16:52:01.014800+0000","last_became_peered":"2024-09-16T16:52:01.014800+0000","last_unstale":"2024-09-16T17:06:08.517960+0000","last_undegraded":"2024-09-16T17:06:08.517960+0000","last_fullsized":"2024-09-16T17:06:08.517960+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.518834+0000","last_change":"2024-09-16T16:52:01.079983+0000","last_active":"2024-09-16T17:06:08.518834+0000","last_peered":"2024-09-16T17:06:08.518834+0000","last_clean":"2024-09-16T17:06:08.518834+0000","last_became_active":"2024-09-16T16:52:01.070554+0000","last_became_peered":"2024-09-16T16:52:01.070554+0000","last_unstale":"2024-09-16T17:06:08.518834+0000","last_undegraded":"2024-09-16T17:06:08.518834+0000","last_fullsized":"2024-09-16T17:06:08.518834+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.900151+0000","last_change":"2024-09-16T17:06:11.942457+0000","last_active":"2024-09-16T17:06:11.900151+0000","last_peered":"2024-09-16T17:06:11.900151+0000","last_clean":"2024-09-16T17:06:11.900151+0000","last_became_active":"2024-09-16T16:52:01.163260+0000","last_became_peered":"2024-09-16T16:52:01.163260+0000","last_unstale":"2024-09-16T17:06:11.900151+0000","last_undegraded":"2024-09-16T17:06:11.900151+0000","last_fullsized":"2024-09-16T17:06:11.900151+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.942294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.942294+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.896700+0000","last_change":"2024-09-16T17:06:11.947009+0000","last_active":"2024-09-16T17:06:11.896700+0000","last_peered":"2024-09-16T17:06:11.896700+0000","last_clean":"2024-09-16T17:06:11.896700+0000","last_became_active":"2024-09-16T16:52:01.039791+0000","last_became_peered":"2024-09-16T16:52:01.039791+0000","last_unstale":"2024-09-16T17:06:11.896700+0000","last_undegraded":"2024-09-16T17:06:11.896700+0000","last_fullsized":"2024-09-16T17:06:11.896700+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.946845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.946845+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.897711+0000","last_change":"2024-09-16T17:06:11.927273+0000","last_active":"2024-09-16T17:06:11.897711+0000","last_peered":"2024-09-16T17:06:11.897711+0000","last_clean":"2024-09-16T17:06:11.897711+0000","last_became_active":"2024-09-16T16:52:01.063909+0000","last_became_peered":"2024-09-16T16:52:01.063909+0000","last_unstale":"2024-09-16T17:06:11.897711+0000","last_undegraded":"2024-09-16T17:06:11.897711+0000","last_fullsized":"2024-09-16T17:06:11.897711+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.927109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.927109+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.512849+0000","last_change":"2024-09-16T16:52:01.160111+0000","last_active":"2024-09-16T17:06:08.512849+0000","last_peered":"2024-09-16T17:06:08.512849+0000","last_clean":"2024-09-16T17:06:08.512849+0000","last_became_active":"2024-09-16T16:52:01.138167+0000","last_became_peered":"2024-09-16T16:52:01.138167+0000","last_unstale":"2024-09-16T17:06:08.512849+0000","last_undegraded":"2024-09-16T17:06:08.512849+0000","last_fullsized":"2024-09-16T17:06:08.512849+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.856462+0000","last_change":"2024-09-16T17:06:12.880151+0000","last_active":"2024-09-16T17:06:12.856462+0000","last_peered":"2024-09-16T17:06:12.856462+0000","last_clean":"2024-09-16T17:06:12.856462+0000","last_became_active":"2024-09-16T16:52:01.016490+0000","last_became_peered":"2024-09-16T16:52:01.016490+0000","last_unstale":"2024-09-16T17:06:12.856462+0000","last_undegraded":"2024-09-16T17:06:12.856462+0000","last_fullsized":"2024-09-16T17:06:12.856462+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.879985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.879985+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.380967+0000","last_change":"2024-09-16T17:06:12.407871+0000","last_active":"2024-09-16T17:06:12.380967+0000","last_peered":"2024-09-16T17:06:12.380967+0000","last_clean":"2024-09-16T17:06:12.380967+0000","last_became_active":"2024-09-16T16:52:00.998521+0000","last_became_peered":"2024-09-16T16:52:00.998521+0000","last_unstale":"2024-09-16T17:06:12.380967+0000","last_undegraded":"2024-09-16T17:06:12.380967+0000","last_fullsized":"2024-09-16T17:06:12.380967+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.407611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.407611+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.382297+0000","last_change":"2024-09-16T17:06:12.420719+0000","last_active":"2024-09-16T17:06:12.382297+0000","last_peered":"2024-09-16T17:06:12.382297+0000","last_clean":"2024-09-16T17:06:12.382297+0000","last_became_active":"2024-09-16T16:52:01.040747+0000","last_became_peered":"2024-09-16T16:52:01.040747+0000","last_unstale":"2024-09-16T17:06:12.382297+0000","last_undegraded":"2024-09-16T17:06:12.382297+0000","last_fullsized":"2024-09-16T17:06:12.382297+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.420426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.420426+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.379154+0000","last_change":"2024-09-16T17:06:12.410421+0000","last_active":"2024-09-16T17:06:12.379154+0000","last_peered":"2024-09-16T17:06:12.379154+0000","last_clean":"2024-09-16T17:06:12.379154+0000","last_became_active":"2024-09-16T16:52:01.017647+0000","last_became_peered":"2024-09-16T16:52:01.017647+0000","last_unstale":"2024-09-16T17:06:12.379154+0000","last_undegraded":"2024-09-16T17:06:12.379154+0000","last_fullsized":"2024-09-16T17:06:12.379154+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.410209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.410209+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.853660+0000","last_change":"2024-09-16T17:06:12.877972+0000","last_active":"2024-09-16T17:06:12.853660+0000","last_peered":"2024-09-16T17:06:12.853660+0000","last_clean":"2024-09-16T17:06:12.853660+0000","last_became_active":"2024-09-16T16:52:01.096609+0000","last_became_peered":"2024-09-16T16:52:01.096609+0000","last_unstale":"2024-09-16T17:06:12.853660+0000","last_undegraded":"2024-09-16T17:06:12.853660+0000","last_fullsized":"2024-09-16T17:06:12.853660+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.877755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.877755+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.510458+0000","last_change":"2024-09-16T16:52:01.188616+0000","last_active":"2024-09-16T17:06:08.510458+0000","last_peered":"2024-09-16T17:06:08.510458+0000","last_clean":"2024-09-16T17:06:08.510458+0000","last_became_active":"2024-09-16T16:52:01.182688+0000","last_became_peered":"2024-09-16T16:52:01.182688+0000","last_unstale":"2024-09-16T17:06:08.510458+0000","last_undegraded":"2024-09-16T17:06:08.510458+0000","last_fullsized":"2024-09-16T17:06:08.510458+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.519473+0000","last_change":"2024-09-16T16:52:01.046742+0000","last_active":"2024-09-16T17:06:08.519473+0000","last_peered":"2024-09-16T17:06:08.519473+0000","last_clean":"2024-09-16T17:06:08.519473+0000","last_became_active":"2024-09-16T16:52:01.022683+0000","last_became_peered":"2024-09-16T16:52:01.022683+0000","last_unstale":"2024-09-16T17:06:08.519473+0000","last_undegraded":"2024-09-16T17:06:08.519473+0000","last_fullsized":"2024-09-16T17:06:08.519473+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.900284+0000","last_change":"2024-09-16T17:06:11.932236+0000","last_active":"2024-09-16T17:06:11.900284+0000","last_peered":"2024-09-16T17:06:11.900284+0000","last_clean":"2024-09-16T17:06:11.900284+0000","last_became_active":"2024-09-16T16:52:01.014432+0000","last_became_peered":"2024-09-16T16:52:01.014432+0000","last_unstale":"2024-09-16T17:06:11.900284+0000","last_undegraded":"2024-09-16T17:06:11.900284+0000","last_fullsized":"2024-09-16T17:06:11.900284+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.932073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.932073+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1469,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.517146+0000","last_change":"2024-09-16T16:52:01.168350+0000","last_active":"2024-09-16T17:06:08.517146+0000","last_peered":"2024-09-16T17:06:08.517146+0000","last_clean":"2024-09-16T17:06:08.517146+0000","last_became_active":"2024-09-16T16:52:01.150691+0000","last_became_peered":"2024-09-16T16:52:01.150691+0000","last_unstale":"2024-09-16T17:06:08.517146+0000","last_undegraded":"2024-09-16T17:06:08.517146+0000","last_fullsized":"2024-09-16T17:06:08.517146+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:51:59.874352+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.894406+0000","last_change":"2024-09-16T17:06:11.944420+0000","last_active":"2024-09-16T17:06:11.894406+0000","last_peered":"2024-09-16T17:06:11.894406+0000","last_clean":"2024-09-16T17:06:11.894406+0000","last_became_active":"2024-09-16T16:52:01.054274+0000","last_became_peered":"2024-09-16T16:52:01.054274+0000","last_unstale":"2024-09-16T17:06:11.894406+0000","last_undegraded":"2024-09-16T17:06:11.894406+0000","last_fullsized":"2024-09-16T17:06:11.894406+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.944220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.944220+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.896238+0000","last_change":"2024-09-16T17:06:11.930721+0000","last_active":"2024-09-16T17:06:11.896238+0000","last_peered":"2024-09-16T17:06:11.896238+0000","last_clean":"2024-09-16T17:06:11.896238+0000","last_became_active":"2024-09-16T16:52:01.056754+0000","last_became_peered":"2024-09-16T16:52:01.056754+0000","last_unstale":"2024-09-16T17:06:11.896238+0000","last_undegraded":"2024-09-16T17:06:11.896238+0000","last_fullsized":"2024-09-16T17:06:11.896238+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.930437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.930437+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.892840+0000","last_change":"2024-09-16T17:06:11.935786+0000","last_active":"2024-09-16T17:06:11.892840+0000","last_peered":"2024-09-16T17:06:11.892840+0000","last_clean":"2024-09-16T17:06:11.892840+0000","last_became_active":"2024-09-16T16:52:01.142598+0000","last_became_peered":"2024-09-16T16:52:01.142598+0000","last_unstale":"2024-09-16T17:06:11.892840+0000","last_undegraded":"2024-09-16T17:06:11.892840+0000","last_fullsized":"2024-09-16T17:06:11.892840+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.935616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.935616+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1484,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.380013+0000","last_change":"2024-09-16T17:06:12.433296+0000","last_active":"2024-09-16T17:06:12.380013+0000","last_peered":"2024-09-16T17:06:12.380013+0000","last_clean":"2024-09-16T17:06:12.380013+0000","last_became_active":"2024-09-16T16:52:01.029529+0000","last_became_peered":"2024-09-16T16:52:01.029529+0000","last_unstale":"2024-09-16T17:06:12.380013+0000","last_undegraded":"2024-09-16T17:06:12.380013+0000","last_fullsized":"2024-09-16T17:06:12.380013+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"239'7","last_scrub_stamp":"2024-09-16T17:06:12.433093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.433093+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.855401+0000","last_change":"2024-09-16T17:06:12.878428+0000","last_active":"2024-09-16T17:06:12.855401+0000","last_peered":"2024-09-16T17:06:12.855401+0000","last_clean":"2024-09-16T17:06:12.855401+0000","last_became_active":"2024-09-16T16:52:00.988610+0000","last_became_peered":"2024-09-16T16:52:00.988610+0000","last_unstale":"2024-09-16T17:06:12.855401+0000","last_undegraded":"2024-09-16T17:06:12.855401+0000","last_fullsized":"2024-09-16T17:06:12.855401+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.878256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.878256+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2150,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.378398+0000","last_change":"2024-09-16T17:06:12.398213+0000","last_active":"2024-09-16T17:06:12.378398+0000","last_peered":"2024-09-16T17:06:12.378398+0000","last_clean":"2024-09-16T17:06:12.378398+0000","last_became_active":"2024-09-16T16:46:48.301220+0000","last_became_peered":"2024-09-16T16:46:48.301220+0000","last_unstale":"2024-09-16T17:06:12.378398+0000","last_undegraded":"2024-09-16T17:06:12.378398+0000","last_fullsized":"2024-09-16T17:06:12.378398+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.397938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.397938+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2150,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.853826+0000","last_change":"2024-09-16T17:06:12.881416+0000","last_active":"2024-09-16T17:06:12.853826+0000","last_peered":"2024-09-16T17:06:12.853826+0000","last_clean":"2024-09-16T17:06:12.853826+0000","last_became_active":"2024-09-16T16:46:48.285243+0000","last_became_peered":"2024-09-16T16:46:48.285243+0000","last_unstale":"2024-09-16T17:06:12.853826+0000","last_undegraded":"2024-09-16T17:06:12.853826+0000","last_fullsized":"2024-09-16T17:06:12.853826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.881245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.881245+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2148,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.517850+0000","last_change":"2024-09-16T16:46:50.249574+0000","last_active":"2024-09-16T17:06:08.517850+0000","last_peered":"2024-09-16T17:06:08.517850+0000","last_clean":"2024-09-16T17:06:08.517850+0000","last_became_active":"2024-09-16T16:46:48.295184+0000","last_became_peered":"2024-09-16T16:46:48.295184+0000","last_unstale":"2024-09-16T17:06:08.517850+0000","last_undegraded":"2024-09-16T17:06:08.517850+0000","last_fullsized":"2024-09-16T17:06:08.517850+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.206999+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2150,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.850588+0000","last_change":"2024-09-16T17:06:12.869474+0000","last_active":"2024-09-16T17:06:12.850588+0000","last_peered":"2024-09-16T17:06:12.850588+0000","last_clean":"2024-09-16T17:06:12.850588+0000","last_became_active":"2024-09-16T16:46:48.280354+0000","last_became_peered":"2024-09-16T16:46:48.280354+0000","last_unstale":"2024-09-16T17:06:12.850588+0000","last_undegraded":"2024-09-16T17:06:12.850588+0000","last_fullsized":"2024-09-16T17:06:12.850588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.869142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.869142+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2152,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.892802+0000","last_change":"2024-09-16T17:06:11.928864+0000","last_active":"2024-09-16T17:06:11.892802+0000","last_peered":"2024-09-16T17:06:11.892802+0000","last_clean":"2024-09-16T17:06:11.892802+0000","last_became_active":"2024-09-16T16:46:48.303026+0000","last_became_peered":"2024-09-16T16:46:48.303026+0000","last_unstale":"2024-09-16T17:06:11.892802+0000","last_undegraded":"2024-09-16T17:06:11.892802+0000","last_fullsized":"2024-09-16T17:06:11.892802+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2024-09-16T17:06:11.928668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.928668+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2150,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.376442+0000","last_change":"2024-09-16T17:06:12.403638+0000","last_active":"2024-09-16T17:06:12.376442+0000","last_peered":"2024-09-16T17:06:12.376442+0000","last_clean":"2024-09-16T17:06:12.376442+0000","last_became_active":"2024-09-16T16:46:48.285463+0000","last_became_peered":"2024-09-16T16:46:48.285463+0000","last_unstale":"2024-09-16T17:06:12.376442+0000","last_undegraded":"2024-09-16T17:06:12.376442+0000","last_fullsized":"2024-09-16T17:06:12.376442+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.403458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.403458+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2150,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.892792+0000","last_change":"2024-09-16T17:06:11.916677+0000","last_active":"2024-09-16T17:06:11.892792+0000","last_peered":"2024-09-16T17:06:11.892792+0000","last_clean":"2024-09-16T17:06:11.892792+0000","last_became_active":"2024-09-16T16:46:48.281970+0000","last_became_peered":"2024-09-16T16:46:48.281970+0000","last_unstale":"2024-09-16T17:06:11.892792+0000","last_undegraded":"2024-09-16T17:06:11.892792+0000","last_fullsized":"2024-09-16T17:06:11.892792+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.916511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.916511+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2151,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.378241+0000","last_change":"2024-09-16T17:06:12.430714+0000","last_active":"2024-09-16T17:06:12.378241+0000","last_peered":"2024-09-16T17:06:12.378241+0000","last_clean":"2024-09-16T17:06:12.378241+0000","last_became_active":"2024-09-16T16:46:48.282002+0000","last_became_peered":"2024-09-16T16:46:48.282002+0000","last_unstale":"2024-09-16T17:06:12.378241+0000","last_undegraded":"2024-09-16T17:06:12.378241+0000","last_fullsized":"2024-09-16T17:06:12.378241+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2024-09-16T17:06:12.430518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.430518+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2220,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:08.502406+0000","last_change":"2024-09-16T16:46:46.272094+0000","last_active":"2024-09-16T17:06:08.502406+0000","last_peered":"2024-09-16T17:06:08.502406+0000","last_clean":"2024-09-16T17:06:08.502406+0000","last_became_active":"2024-09-16T16:46:46.253718+0000","last_became_peered":"2024-09-16T16:46:46.253718+0000","last_unstale":"2024-09-16T17:06:08.502406+0000","last_undegraded":"2024-09-16T17:06:08.502406+0000","last_fullsized":"2024-09-16T17:06:08.502406+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.198151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.198151+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.198151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214188011520,"internally_reserved":0,"allocated":23482368,"data_stored":23482368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214188011520,"internally_reserved":0,"allocated":23482368,"data_stored":23482368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53546643456,"internally_reserved":0,"allocated":6230016,"data_stored":6230016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6084,"kb_used_data":6084,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291644,"statfs":{"total":53552873472,"available":53546643456,"internally_reserved":0,"allocated":6230016,"data_stored":6230016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5196,"kb_used_data":5196,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292532,"statfs":{"total":53552873472,"available":53547552768,"internally_reserved":0,"allocated":5320704,"data_stored":5320704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5176,"kb_used_data":5176,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292552,"statfs":{"total":53552873472,"available":53547573248,"internally_reserved":0,"allocated":5300224,"data_stored":5300224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6476,"kb_used_data":6476,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291252,"statfs":{"total":53552873472,"available":53546242048,"internally_reserved":0,"allocated":6631424,"data_stored":6631424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53546643456,"internally_reserved":0,"allocated":6230016,"data_stored":6230016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53546242048,"internally_reserved":0,"allocated":6631424,"data_stored":6631424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53547573248,"internally_reserved":0,"allocated":5300224,"data_stored":5300224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53547552768,"internally_reserved":0,"allocated":5320704,"data_stored":5320704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53546643456,"internally_reserved":0,"allocated":6230016,"data_stored":6230016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":53552873472,"available":53546242048,"internally_reserved":0,"allocated":6631424,"data_stored":6631424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":53552873472,"available":53547573248,"internally_reserved":0,"allocated":5300224,"data_stored":5300224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":53552873472,"available":53547552768,"internally_reserved":0,"allocated":5320704,"data_stored":5320704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":53552873472,"available":53546643456,"internally_reserved":0,"allocated":6230016,"data_stored":6230016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:06:33.966 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:33.966 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:33.967 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:33.967 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:33.967 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:33.967 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:33.967 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:33.967 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:33.967 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-09-16T16:51:59.874352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:33.967 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T16:46:47.206999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:33.968 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T16:46:45.198151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=6, tm_sec=10, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:06:33.968 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T17:06:53.968 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:06:54.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.085+0000 7ff01b751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:54.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.090+0000 7ff01b751640 1 Processor -- start 2024-09-16T17:06:54.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.090+0000 7ff01b751640 1 -- start start 2024-09-16T17:06:54.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.091+0000 7ff01b751640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0141325b0 0x7ff0141329c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:54.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.091+0000 7ff01b751640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff014074ba0 con 0x7ff01409cb60 2024-09-16T17:06:54.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.092+0000 7ff01b751640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7ff0141320d0 con 0x7ff0141325b0 2024-09-16T17:06:54.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.092+0000 7ff0194ed640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0141325b0 0x7ff0141329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:54.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.092+0000 7ff018cec640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff01409cb60 0x7ff01409cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51308/0 (socket says 172.21.15.89:51308) 2024-09-16T17:06:54.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.092+0000 7ff018cec640 1 -- 172.21.15.89:0/2887399200 learned_addr learned my addr 172.21.15.89:0/2887399200 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:06:54.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.092+0000 7ff0194ed640 1 -- 172.21.15.89:0/2887399200 >> v1:172.21.15.89:6789/0 conn(0x7ff01409cb60 legacy=0x7ff01409cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:54.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.092+0000 7ff0194ed640 1 -- 172.21.15.89:0/2887399200 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff014132f00 con 0x7ff0141325b0 2024-09-16T17:06:54.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.092+0000 7ff0194ed640 1 --2- 172.21.15.89:0/2887399200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0141325b0 0x7ff0141329c0 crc :-1 s=READY pgs=13023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e8be6ffcbaaf5f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:54.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.092+0000 7ff00bfff640 1 -- 172.21.15.89:0/2887399200 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff010009d90 con 0x7ff0141325b0 2024-09-16T17:06:54.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.092+0000 7ff00bfff640 1 -- 172.21.15.89:0/2887399200 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff01000e230 con 0x7ff0141325b0 2024-09-16T17:06:54.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.092+0000 7ff00bfff640 1 -- 172.21.15.89:0/2887399200 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff01000e4d0 con 0x7ff0141325b0 2024-09-16T17:06:54.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.093+0000 7ff01b751640 1 -- 172.21.15.89:0/2887399200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0141325b0 msgr2=0x7ff0141329c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:54.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.093+0000 7ff01b751640 1 --2- 172.21.15.89:0/2887399200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0141325b0 0x7ff0141329c0 crc :-1 s=READY pgs=13023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:54.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.093+0000 7ff01b751640 1 -- 172.21.15.89:0/2887399200 shutdown_connections 2024-09-16T17:06:54.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.093+0000 7ff01b751640 1 --2- 172.21.15.89:0/2887399200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0141325b0 0x7ff0141329c0 unknown :-1 s=CLOSED pgs=13023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:54.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.093+0000 7ff01b751640 1 -- 172.21.15.89:0/2887399200 >> 172.21.15.89:0/2887399200 conn(0x7ff014069d60 msgr2=0x7ff01409e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:54.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.093+0000 7ff01b751640 1 -- 172.21.15.89:0/2887399200 shutdown_connections 2024-09-16T17:06:54.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.093+0000 7ff01b751640 1 -- 172.21.15.89:0/2887399200 wait complete. 2024-09-16T17:06:54.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.093+0000 7ff01b751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:54.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.095+0000 7ff01b751640 1 Processor -- start 2024-09-16T17:06:54.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.095+0000 7ff01b751640 1 -- start start 2024-09-16T17:06:54.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.096+0000 7ff01b751640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff01409cb60 0x7ff014121240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:54.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.096+0000 7ff01b751640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff014122600 con 0x7ff01409cb60 2024-09-16T17:06:54.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.096+0000 7ff0194ed640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff01409cb60 0x7ff014121240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:54.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.096+0000 7ff0194ed640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff01409cb60 0x7ff014121240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53658/0 (socket says 172.21.15.89:53658) 2024-09-16T17:06:54.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.096+0000 7ff0194ed640 1 -- 172.21.15.89:0/1143414639 learned_addr learned my addr 172.21.15.89:0/1143414639 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:54.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.096+0000 7ff0194ed640 1 -- 172.21.15.89:0/1143414639 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff014122cc0 con 0x7ff01409cb60 2024-09-16T17:06:54.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.096+0000 7ff0194ed640 1 --2- 172.21.15.89:0/1143414639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff01409cb60 0x7ff014121240 crc :-1 s=READY pgs=13024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:54.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.096+0000 7ff009ffb640 1 -- 172.21.15.89:0/1143414639 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff010018040 con 0x7ff01409cb60 2024-09-16T17:06:54.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.096+0000 7ff009ffb640 1 -- 172.21.15.89:0/1143414639 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff010012650 con 0x7ff01409cb60 2024-09-16T17:06:54.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.097+0000 7ff009ffb640 1 -- 172.21.15.89:0/1143414639 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff0100128f0 con 0x7ff01409cb60 2024-09-16T17:06:54.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.097+0000 7ff01b751640 1 -- 172.21.15.89:0/1143414639 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0141251b0 con 0x7ff01409cb60 2024-09-16T17:06:54.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.097+0000 7ff01b751640 1 -- 172.21.15.89:0/1143414639 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff014124580 con 0x7ff01409cb60 2024-09-16T17:06:54.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.098+0000 7ff009ffb640 1 -- 172.21.15.89:0/1143414639 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff010012aa0 con 0x7ff01409cb60 2024-09-16T17:06:54.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.098+0000 7ff01b751640 1 -- 172.21.15.89:0/1143414639 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0140a0020 con 0x7ff01409cb60 2024-09-16T17:06:54.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.098+0000 7ff009ffb640 1 --2- 172.21.15.89:0/1143414639 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7feff803e930 0x7feff8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:54.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.098+0000 7ff009ffb640 1 -- 172.21.15.89:0/1143414639 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(726..726 src has 676..726) ==== 3431+0+0 (crc 0 0 0) 0x7ff010052830 con 0x7ff01409cb60 2024-09-16T17:06:54.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.098+0000 7ff018cec640 1 --2- 172.21.15.89:0/1143414639 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7feff803e930 0x7feff8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:54.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.099+0000 7ff018cec640 1 --2- 172.21.15.89:0/1143414639 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7feff803e930 0x7feff8040e40 crc :-1 s=READY pgs=3889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:54.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.103+0000 7ff009ffb640 1 -- 172.21.15.89:0/1143414639 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7ff010017bf0 con 0x7ff01409cb60 2024-09-16T17:06:54.282 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.281+0000 7ff01b751640 1 -- 172.21.15.89:0/1143414639 --> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff014122490 con 0x7feff803e930 2024-09-16T17:06:54.285 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.284+0000 7ff009ffb640 1 -- 172.21.15.89:0/1143414639 <== mgr.4099 v2:172.21.15.177:6800/1212166405 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109422 (crc 0 0 0) 0x7ff014122490 con 0x7feff803e930 2024-09-16T17:06:54.286 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-16T17:06:54.286 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-16T17:06:54.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.286+0000 7ff01b751640 1 -- 172.21.15.89:0/1143414639 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7feff803e930 msgr2=0x7feff8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:54.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.286+0000 7ff01b751640 1 --2- 172.21.15.89:0/1143414639 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7feff803e930 0x7feff8040e40 crc :-1 s=READY pgs=3889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:54.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.286+0000 7ff01b751640 1 -- 172.21.15.89:0/1143414639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff01409cb60 msgr2=0x7ff014121240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:54.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.286+0000 7ff01b751640 1 --2- 172.21.15.89:0/1143414639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff01409cb60 0x7ff014121240 crc :-1 s=READY pgs=13024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:54.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.286+0000 7ff01b751640 1 -- 172.21.15.89:0/1143414639 shutdown_connections 2024-09-16T17:06:54.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.286+0000 7ff01b751640 1 --2- 172.21.15.89:0/1143414639 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7feff803e930 0x7feff8040e40 unknown :-1 s=CLOSED pgs=3889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:54.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.286+0000 7ff01b751640 1 --2- 172.21.15.89:0/1143414639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff01409cb60 0x7ff014121240 unknown :-1 s=CLOSED pgs=13024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:54.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.286+0000 7ff01b751640 1 -- 172.21.15.89:0/1143414639 >> 172.21.15.89:0/1143414639 conn(0x7ff014069d60 msgr2=0x7ff014073c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:54.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.286+0000 7ff01b751640 1 -- 172.21.15.89:0/1143414639 shutdown_connections 2024-09-16T17:06:54.289 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.286+0000 7ff01b751640 1 -- 172.21.15.89:0/1143414639 wait complete. 2024-09-16T17:06:54.299 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":1323,"stamp":"2024-09-16T17:06:53.422044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":22932,"kb_used_data":22932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209167980,"statfs":{"total":214211493888,"available":214188011520,"internally_reserved":0,"allocated":23482368,"data_stored":23482368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003225"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.385403+0000","last_change":"2024-09-16T17:06:12.413899+0000","last_active":"2024-09-16T17:06:12.385403+0000","last_peered":"2024-09-16T17:06:12.385403+0000","last_clean":"2024-09-16T17:06:12.385403+0000","last_became_active":"2024-09-16T16:52:01.016850+0000","last_became_peered":"2024-09-16T16:52:01.016850+0000","last_unstale":"2024-09-16T17:06:12.385403+0000","last_undegraded":"2024-09-16T17:06:12.385403+0000","last_fullsized":"2024-09-16T17:06:12.385403+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.413594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.413594+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.904604+0000","last_change":"2024-09-16T17:06:11.941057+0000","last_active":"2024-09-16T17:06:11.904604+0000","last_peered":"2024-09-16T17:06:11.904604+0000","last_clean":"2024-09-16T17:06:11.904604+0000","last_became_active":"2024-09-16T16:52:01.048635+0000","last_became_peered":"2024-09-16T16:52:01.048635+0000","last_unstale":"2024-09-16T17:06:11.904604+0000","last_undegraded":"2024-09-16T17:06:11.904604+0000","last_fullsized":"2024-09-16T17:06:11.904604+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.940880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.940880+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.855405+0000","last_change":"2024-09-16T17:06:12.879234+0000","last_active":"2024-09-16T17:06:12.855405+0000","last_peered":"2024-09-16T17:06:12.855405+0000","last_clean":"2024-09-16T17:06:12.855405+0000","last_became_active":"2024-09-16T16:52:01.077074+0000","last_became_peered":"2024-09-16T16:52:01.077074+0000","last_unstale":"2024-09-16T17:06:12.855405+0000","last_undegraded":"2024-09-16T17:06:12.855405+0000","last_fullsized":"2024-09-16T17:06:12.855405+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.879060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.879060+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:13.319081+0000","last_change":"2024-09-16T17:06:13.361670+0000","last_active":"2024-09-16T17:06:13.319081+0000","last_peered":"2024-09-16T17:06:13.319081+0000","last_clean":"2024-09-16T17:06:13.319081+0000","last_became_active":"2024-09-16T16:52:00.995826+0000","last_became_peered":"2024-09-16T16:52:00.995826+0000","last_unstale":"2024-09-16T17:06:13.319081+0000","last_undegraded":"2024-09-16T17:06:13.319081+0000","last_fullsized":"2024-09-16T17:06:13.319081+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:13.361506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:13.361506+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.382235+0000","last_change":"2024-09-16T17:06:12.407948+0000","last_active":"2024-09-16T17:06:12.382235+0000","last_peered":"2024-09-16T17:06:12.382235+0000","last_clean":"2024-09-16T17:06:12.382235+0000","last_became_active":"2024-09-16T16:52:01.066170+0000","last_became_peered":"2024-09-16T16:52:01.066170+0000","last_unstale":"2024-09-16T17:06:12.382235+0000","last_undegraded":"2024-09-16T17:06:12.382235+0000","last_fullsized":"2024-09-16T17:06:12.382235+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.407757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.407757+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.902295+0000","last_change":"2024-09-16T17:06:11.942426+0000","last_active":"2024-09-16T17:06:11.902295+0000","last_peered":"2024-09-16T17:06:11.902295+0000","last_clean":"2024-09-16T17:06:11.902295+0000","last_became_active":"2024-09-16T16:52:01.137358+0000","last_became_peered":"2024-09-16T16:52:01.137358+0000","last_unstale":"2024-09-16T17:06:11.902295+0000","last_undegraded":"2024-09-16T17:06:11.902295+0000","last_fullsized":"2024-09-16T17:06:11.902295+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.942266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.942266+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.902293+0000","last_change":"2024-09-16T17:06:11.936621+0000","last_active":"2024-09-16T17:06:11.902293+0000","last_peered":"2024-09-16T17:06:11.902293+0000","last_clean":"2024-09-16T17:06:11.902293+0000","last_became_active":"2024-09-16T16:52:01.018449+0000","last_became_peered":"2024-09-16T16:52:01.018449+0000","last_unstale":"2024-09-16T17:06:11.902293+0000","last_undegraded":"2024-09-16T17:06:11.902293+0000","last_fullsized":"2024-09-16T17:06:11.902293+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.936460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.936460+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.901425+0000","last_change":"2024-09-16T17:06:11.934761+0000","last_active":"2024-09-16T17:06:11.901425+0000","last_peered":"2024-09-16T17:06:11.901425+0000","last_clean":"2024-09-16T17:06:11.901425+0000","last_became_active":"2024-09-16T16:52:01.043446+0000","last_became_peered":"2024-09-16T16:52:01.043446+0000","last_unstale":"2024-09-16T17:06:11.901425+0000","last_undegraded":"2024-09-16T17:06:11.901425+0000","last_fullsized":"2024-09-16T17:06:11.901425+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.934556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.934556+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:13.316826+0000","last_change":"2024-09-16T17:06:13.358300+0000","last_active":"2024-09-16T17:06:13.316826+0000","last_peered":"2024-09-16T17:06:13.316826+0000","last_clean":"2024-09-16T17:06:13.316826+0000","last_became_active":"2024-09-16T16:52:00.984993+0000","last_became_peered":"2024-09-16T16:52:00.984993+0000","last_unstale":"2024-09-16T17:06:13.316826+0000","last_undegraded":"2024-09-16T17:06:13.316826+0000","last_fullsized":"2024-09-16T17:06:13.316826+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:13.358146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:13.358146+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.858177+0000","last_change":"2024-09-16T17:06:12.882102+0000","last_active":"2024-09-16T17:06:12.858177+0000","last_peered":"2024-09-16T17:06:12.858177+0000","last_clean":"2024-09-16T17:06:12.858177+0000","last_became_active":"2024-09-16T16:52:01.118033+0000","last_became_peered":"2024-09-16T16:52:01.118033+0000","last_unstale":"2024-09-16T17:06:12.858177+0000","last_undegraded":"2024-09-16T17:06:12.858177+0000","last_fullsized":"2024-09-16T17:06:12.858177+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.881935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.881935+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:13.315220+0000","last_change":"2024-09-16T17:06:13.357626+0000","last_active":"2024-09-16T17:06:13.315220+0000","last_peered":"2024-09-16T17:06:13.315220+0000","last_clean":"2024-09-16T17:06:13.315220+0000","last_became_active":"2024-09-16T16:52:01.018199+0000","last_became_peered":"2024-09-16T16:52:01.018199+0000","last_unstale":"2024-09-16T17:06:13.315220+0000","last_undegraded":"2024-09-16T17:06:13.315220+0000","last_fullsized":"2024-09-16T17:06:13.315220+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:13.357467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:13.357467+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.898355+0000","last_change":"2024-09-16T17:06:11.945674+0000","last_active":"2024-09-16T17:06:11.898355+0000","last_peered":"2024-09-16T17:06:11.898355+0000","last_clean":"2024-09-16T17:06:11.898355+0000","last_became_active":"2024-09-16T16:52:01.098860+0000","last_became_peered":"2024-09-16T16:52:01.098860+0000","last_unstale":"2024-09-16T17:06:11.898355+0000","last_undegraded":"2024-09-16T17:06:11.898355+0000","last_fullsized":"2024-09-16T17:06:11.898355+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.945520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.945520+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:13.315690+0000","last_change":"2024-09-16T17:06:13.353036+0000","last_active":"2024-09-16T17:06:13.315690+0000","last_peered":"2024-09-16T17:06:13.315690+0000","last_clean":"2024-09-16T17:06:13.315690+0000","last_became_active":"2024-09-16T16:52:01.014800+0000","last_became_peered":"2024-09-16T16:52:01.014800+0000","last_unstale":"2024-09-16T17:06:13.315690+0000","last_undegraded":"2024-09-16T17:06:13.315690+0000","last_fullsized":"2024-09-16T17:06:13.315690+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:13.352845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:13.352845+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:13.316287+0000","last_change":"2024-09-16T17:06:13.356484+0000","last_active":"2024-09-16T17:06:13.316287+0000","last_peered":"2024-09-16T17:06:13.316287+0000","last_clean":"2024-09-16T17:06:13.316287+0000","last_became_active":"2024-09-16T16:52:01.070554+0000","last_became_peered":"2024-09-16T16:52:01.070554+0000","last_unstale":"2024-09-16T17:06:13.316287+0000","last_undegraded":"2024-09-16T17:06:13.316287+0000","last_fullsized":"2024-09-16T17:06:13.316287+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:13.356319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:13.356319+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.900151+0000","last_change":"2024-09-16T17:06:11.942457+0000","last_active":"2024-09-16T17:06:11.900151+0000","last_peered":"2024-09-16T17:06:11.900151+0000","last_clean":"2024-09-16T17:06:11.900151+0000","last_became_active":"2024-09-16T16:52:01.163260+0000","last_became_peered":"2024-09-16T16:52:01.163260+0000","last_unstale":"2024-09-16T17:06:11.900151+0000","last_undegraded":"2024-09-16T17:06:11.900151+0000","last_fullsized":"2024-09-16T17:06:11.900151+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.942294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.942294+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.896700+0000","last_change":"2024-09-16T17:06:11.947009+0000","last_active":"2024-09-16T17:06:11.896700+0000","last_peered":"2024-09-16T17:06:11.896700+0000","last_clean":"2024-09-16T17:06:11.896700+0000","last_became_active":"2024-09-16T16:52:01.039791+0000","last_became_peered":"2024-09-16T16:52:01.039791+0000","last_unstale":"2024-09-16T17:06:11.896700+0000","last_undegraded":"2024-09-16T17:06:11.896700+0000","last_fullsized":"2024-09-16T17:06:11.896700+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.946845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.946845+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.897711+0000","last_change":"2024-09-16T17:06:11.927273+0000","last_active":"2024-09-16T17:06:11.897711+0000","last_peered":"2024-09-16T17:06:11.897711+0000","last_clean":"2024-09-16T17:06:11.897711+0000","last_became_active":"2024-09-16T16:52:01.063909+0000","last_became_peered":"2024-09-16T16:52:01.063909+0000","last_unstale":"2024-09-16T17:06:11.897711+0000","last_undegraded":"2024-09-16T17:06:11.897711+0000","last_fullsized":"2024-09-16T17:06:11.897711+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.927109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.927109+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:13.312408+0000","last_change":"2024-09-16T17:06:13.351340+0000","last_active":"2024-09-16T17:06:13.312408+0000","last_peered":"2024-09-16T17:06:13.312408+0000","last_clean":"2024-09-16T17:06:13.312408+0000","last_became_active":"2024-09-16T16:52:01.138167+0000","last_became_peered":"2024-09-16T16:52:01.138167+0000","last_unstale":"2024-09-16T17:06:13.312408+0000","last_undegraded":"2024-09-16T17:06:13.312408+0000","last_fullsized":"2024-09-16T17:06:13.312408+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:13.351175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:13.351175+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.856462+0000","last_change":"2024-09-16T17:06:12.880151+0000","last_active":"2024-09-16T17:06:12.856462+0000","last_peered":"2024-09-16T17:06:12.856462+0000","last_clean":"2024-09-16T17:06:12.856462+0000","last_became_active":"2024-09-16T16:52:01.016490+0000","last_became_peered":"2024-09-16T16:52:01.016490+0000","last_unstale":"2024-09-16T17:06:12.856462+0000","last_undegraded":"2024-09-16T17:06:12.856462+0000","last_fullsized":"2024-09-16T17:06:12.856462+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.879985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.879985+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.380967+0000","last_change":"2024-09-16T17:06:12.407871+0000","last_active":"2024-09-16T17:06:12.380967+0000","last_peered":"2024-09-16T17:06:12.380967+0000","last_clean":"2024-09-16T17:06:12.380967+0000","last_became_active":"2024-09-16T16:52:00.998521+0000","last_became_peered":"2024-09-16T16:52:00.998521+0000","last_unstale":"2024-09-16T17:06:12.380967+0000","last_undegraded":"2024-09-16T17:06:12.380967+0000","last_fullsized":"2024-09-16T17:06:12.380967+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.407611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.407611+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.382297+0000","last_change":"2024-09-16T17:06:12.420719+0000","last_active":"2024-09-16T17:06:12.382297+0000","last_peered":"2024-09-16T17:06:12.382297+0000","last_clean":"2024-09-16T17:06:12.382297+0000","last_became_active":"2024-09-16T16:52:01.040747+0000","last_became_peered":"2024-09-16T16:52:01.040747+0000","last_unstale":"2024-09-16T17:06:12.382297+0000","last_undegraded":"2024-09-16T17:06:12.382297+0000","last_fullsized":"2024-09-16T17:06:12.382297+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.420426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.420426+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.379154+0000","last_change":"2024-09-16T17:06:12.410421+0000","last_active":"2024-09-16T17:06:12.379154+0000","last_peered":"2024-09-16T17:06:12.379154+0000","last_clean":"2024-09-16T17:06:12.379154+0000","last_became_active":"2024-09-16T16:52:01.017647+0000","last_became_peered":"2024-09-16T16:52:01.017647+0000","last_unstale":"2024-09-16T17:06:12.379154+0000","last_undegraded":"2024-09-16T17:06:12.379154+0000","last_fullsized":"2024-09-16T17:06:12.379154+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.410209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.410209+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.853660+0000","last_change":"2024-09-16T17:06:12.877972+0000","last_active":"2024-09-16T17:06:12.853660+0000","last_peered":"2024-09-16T17:06:12.853660+0000","last_clean":"2024-09-16T17:06:12.853660+0000","last_became_active":"2024-09-16T16:52:01.096609+0000","last_became_peered":"2024-09-16T16:52:01.096609+0000","last_unstale":"2024-09-16T17:06:12.853660+0000","last_undegraded":"2024-09-16T17:06:12.853660+0000","last_fullsized":"2024-09-16T17:06:12.853660+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.877755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.877755+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:13.313541+0000","last_change":"2024-09-16T17:06:13.355591+0000","last_active":"2024-09-16T17:06:13.313541+0000","last_peered":"2024-09-16T17:06:13.313541+0000","last_clean":"2024-09-16T17:06:13.313541+0000","last_became_active":"2024-09-16T16:52:01.182688+0000","last_became_peered":"2024-09-16T16:52:01.182688+0000","last_unstale":"2024-09-16T17:06:13.313541+0000","last_undegraded":"2024-09-16T17:06:13.313541+0000","last_fullsized":"2024-09-16T17:06:13.313541+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:13.355430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:13.355430+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:13.311643+0000","last_change":"2024-09-16T17:06:13.344084+0000","last_active":"2024-09-16T17:06:13.311643+0000","last_peered":"2024-09-16T17:06:13.311643+0000","last_clean":"2024-09-16T17:06:13.311643+0000","last_became_active":"2024-09-16T16:52:01.022683+0000","last_became_peered":"2024-09-16T16:52:01.022683+0000","last_unstale":"2024-09-16T17:06:13.311643+0000","last_undegraded":"2024-09-16T17:06:13.311643+0000","last_fullsized":"2024-09-16T17:06:13.311643+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:13.343870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:13.343870+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.900284+0000","last_change":"2024-09-16T17:06:11.932236+0000","last_active":"2024-09-16T17:06:11.900284+0000","last_peered":"2024-09-16T17:06:11.900284+0000","last_clean":"2024-09-16T17:06:11.900284+0000","last_became_active":"2024-09-16T16:52:01.014432+0000","last_became_peered":"2024-09-16T16:52:01.014432+0000","last_unstale":"2024-09-16T17:06:11.900284+0000","last_undegraded":"2024-09-16T17:06:11.900284+0000","last_fullsized":"2024-09-16T17:06:11.900284+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.932073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.932073+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:13.311894+0000","last_change":"2024-09-16T17:06:13.334274+0000","last_active":"2024-09-16T17:06:13.311894+0000","last_peered":"2024-09-16T17:06:13.311894+0000","last_clean":"2024-09-16T17:06:13.311894+0000","last_became_active":"2024-09-16T16:52:01.150691+0000","last_became_peered":"2024-09-16T16:52:01.150691+0000","last_unstale":"2024-09-16T17:06:13.311894+0000","last_undegraded":"2024-09-16T17:06:13.311894+0000","last_fullsized":"2024-09-16T17:06:13.311894+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:13.333959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:13.333959+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.894406+0000","last_change":"2024-09-16T17:06:11.944420+0000","last_active":"2024-09-16T17:06:11.894406+0000","last_peered":"2024-09-16T17:06:11.894406+0000","last_clean":"2024-09-16T17:06:11.894406+0000","last_became_active":"2024-09-16T16:52:01.054274+0000","last_became_peered":"2024-09-16T16:52:01.054274+0000","last_unstale":"2024-09-16T17:06:11.894406+0000","last_undegraded":"2024-09-16T17:06:11.894406+0000","last_fullsized":"2024-09-16T17:06:11.894406+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.944220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.944220+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.896238+0000","last_change":"2024-09-16T17:06:11.930721+0000","last_active":"2024-09-16T17:06:11.896238+0000","last_peered":"2024-09-16T17:06:11.896238+0000","last_clean":"2024-09-16T17:06:11.896238+0000","last_became_active":"2024-09-16T16:52:01.056754+0000","last_became_peered":"2024-09-16T16:52:01.056754+0000","last_unstale":"2024-09-16T17:06:11.896238+0000","last_undegraded":"2024-09-16T17:06:11.896238+0000","last_fullsized":"2024-09-16T17:06:11.896238+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.930437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.930437+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.892840+0000","last_change":"2024-09-16T17:06:11.935786+0000","last_active":"2024-09-16T17:06:11.892840+0000","last_peered":"2024-09-16T17:06:11.892840+0000","last_clean":"2024-09-16T17:06:11.892840+0000","last_became_active":"2024-09-16T16:52:01.142598+0000","last_became_peered":"2024-09-16T16:52:01.142598+0000","last_unstale":"2024-09-16T17:06:11.892840+0000","last_undegraded":"2024-09-16T17:06:11.892840+0000","last_fullsized":"2024-09-16T17:06:11.892840+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.935616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.935616+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1484,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.380013+0000","last_change":"2024-09-16T17:06:12.433296+0000","last_active":"2024-09-16T17:06:12.380013+0000","last_peered":"2024-09-16T17:06:12.380013+0000","last_clean":"2024-09-16T17:06:12.380013+0000","last_became_active":"2024-09-16T16:52:01.029529+0000","last_became_peered":"2024-09-16T16:52:01.029529+0000","last_unstale":"2024-09-16T17:06:12.380013+0000","last_undegraded":"2024-09-16T17:06:12.380013+0000","last_fullsized":"2024-09-16T17:06:12.380013+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"239'7","last_scrub_stamp":"2024-09-16T17:06:12.433093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.433093+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1471,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.855401+0000","last_change":"2024-09-16T17:06:12.878428+0000","last_active":"2024-09-16T17:06:12.855401+0000","last_peered":"2024-09-16T17:06:12.855401+0000","last_clean":"2024-09-16T17:06:12.855401+0000","last_became_active":"2024-09-16T16:52:00.988610+0000","last_became_peered":"2024-09-16T16:52:00.988610+0000","last_unstale":"2024-09-16T17:06:12.855401+0000","last_undegraded":"2024-09-16T17:06:12.855401+0000","last_fullsized":"2024-09-16T17:06:12.855401+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.878256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.878256+0000","last_clean_scrub_stamp":"2024-09-16T16:51:59.874352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2150,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.378398+0000","last_change":"2024-09-16T17:06:12.398213+0000","last_active":"2024-09-16T17:06:12.378398+0000","last_peered":"2024-09-16T17:06:12.378398+0000","last_clean":"2024-09-16T17:06:12.378398+0000","last_became_active":"2024-09-16T16:46:48.301220+0000","last_became_peered":"2024-09-16T16:46:48.301220+0000","last_unstale":"2024-09-16T17:06:12.378398+0000","last_undegraded":"2024-09-16T17:06:12.378398+0000","last_fullsized":"2024-09-16T17:06:12.378398+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.397938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.397938+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2150,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.853826+0000","last_change":"2024-09-16T17:06:12.881416+0000","last_active":"2024-09-16T17:06:12.853826+0000","last_peered":"2024-09-16T17:06:12.853826+0000","last_clean":"2024-09-16T17:06:12.853826+0000","last_became_active":"2024-09-16T16:46:48.285243+0000","last_became_peered":"2024-09-16T16:46:48.285243+0000","last_unstale":"2024-09-16T17:06:12.853826+0000","last_undegraded":"2024-09-16T17:06:12.853826+0000","last_fullsized":"2024-09-16T17:06:12.853826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.881245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.881245+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2150,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:13.312815+0000","last_change":"2024-09-16T17:06:13.339343+0000","last_active":"2024-09-16T17:06:13.312815+0000","last_peered":"2024-09-16T17:06:13.312815+0000","last_clean":"2024-09-16T17:06:13.312815+0000","last_became_active":"2024-09-16T16:46:48.295184+0000","last_became_peered":"2024-09-16T16:46:48.295184+0000","last_unstale":"2024-09-16T17:06:13.312815+0000","last_undegraded":"2024-09-16T17:06:13.312815+0000","last_fullsized":"2024-09-16T17:06:13.312815+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:13.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:13.339019+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2150,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.850588+0000","last_change":"2024-09-16T17:06:12.869474+0000","last_active":"2024-09-16T17:06:12.850588+0000","last_peered":"2024-09-16T17:06:12.850588+0000","last_clean":"2024-09-16T17:06:12.850588+0000","last_became_active":"2024-09-16T16:46:48.280354+0000","last_became_peered":"2024-09-16T16:46:48.280354+0000","last_unstale":"2024-09-16T17:06:12.850588+0000","last_undegraded":"2024-09-16T17:06:12.850588+0000","last_fullsized":"2024-09-16T17:06:12.850588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.869142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.869142+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2152,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.892802+0000","last_change":"2024-09-16T17:06:11.928864+0000","last_active":"2024-09-16T17:06:11.892802+0000","last_peered":"2024-09-16T17:06:11.892802+0000","last_clean":"2024-09-16T17:06:11.892802+0000","last_became_active":"2024-09-16T16:46:48.303026+0000","last_became_peered":"2024-09-16T16:46:48.303026+0000","last_unstale":"2024-09-16T17:06:11.892802+0000","last_undegraded":"2024-09-16T17:06:11.892802+0000","last_fullsized":"2024-09-16T17:06:11.892802+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2024-09-16T17:06:11.928668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.928668+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2150,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.376442+0000","last_change":"2024-09-16T17:06:12.403638+0000","last_active":"2024-09-16T17:06:12.376442+0000","last_peered":"2024-09-16T17:06:12.376442+0000","last_clean":"2024-09-16T17:06:12.376442+0000","last_became_active":"2024-09-16T16:46:48.285463+0000","last_became_peered":"2024-09-16T16:46:48.285463+0000","last_unstale":"2024-09-16T17:06:12.376442+0000","last_undegraded":"2024-09-16T17:06:12.376442+0000","last_fullsized":"2024-09-16T17:06:12.376442+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:12.403458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.403458+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2150,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:11.892792+0000","last_change":"2024-09-16T17:06:11.916677+0000","last_active":"2024-09-16T17:06:11.892792+0000","last_peered":"2024-09-16T17:06:11.892792+0000","last_clean":"2024-09-16T17:06:11.892792+0000","last_became_active":"2024-09-16T16:46:48.281970+0000","last_became_peered":"2024-09-16T16:46:48.281970+0000","last_unstale":"2024-09-16T17:06:11.892792+0000","last_undegraded":"2024-09-16T17:06:11.892792+0000","last_fullsized":"2024-09-16T17:06:11.892792+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:06:11.916511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:11.916511+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2151,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:12.378241+0000","last_change":"2024-09-16T17:06:12.430714+0000","last_active":"2024-09-16T17:06:12.378241+0000","last_peered":"2024-09-16T17:06:12.378241+0000","last_clean":"2024-09-16T17:06:12.378241+0000","last_became_active":"2024-09-16T16:46:48.282002+0000","last_became_peered":"2024-09-16T16:46:48.282002+0000","last_unstale":"2024-09-16T17:06:12.378241+0000","last_undegraded":"2024-09-16T17:06:12.378241+0000","last_fullsized":"2024-09-16T17:06:12.378241+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2024-09-16T17:06:12.430518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:12.430518+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.206999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2222,"reported_epoch":726,"state":"active+clean","last_fresh":"2024-09-16T17:06:13.309628+0000","last_change":"2024-09-16T17:06:13.375267+0000","last_active":"2024-09-16T17:06:13.309628+0000","last_peered":"2024-09-16T17:06:13.309628+0000","last_clean":"2024-09-16T17:06:13.309628+0000","last_became_active":"2024-09-16T16:46:46.253718+0000","last_became_peered":"2024-09-16T16:46:46.253718+0000","last_unstale":"2024-09-16T17:06:13.309628+0000","last_undegraded":"2024-09-16T17:06:13.309628+0000","last_fullsized":"2024-09-16T17:06:13.309628+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"11'52","last_scrub_stamp":"2024-09-16T17:06:13.375056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:06:13.375056+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.198151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214188011520,"internally_reserved":0,"allocated":23482368,"data_stored":23482368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214188011520,"internally_reserved":0,"allocated":23482368,"data_stored":23482368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53546643456,"internally_reserved":0,"allocated":6230016,"data_stored":6230016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6084,"kb_used_data":6084,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291644,"statfs":{"total":53552873472,"available":53546643456,"internally_reserved":0,"allocated":6230016,"data_stored":6230016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5196,"kb_used_data":5196,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292532,"statfs":{"total":53552873472,"available":53547552768,"internally_reserved":0,"allocated":5320704,"data_stored":5320704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5176,"kb_used_data":5176,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292552,"statfs":{"total":53552873472,"available":53547573248,"internally_reserved":0,"allocated":5300224,"data_stored":5300224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6476,"kb_used_data":6476,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291252,"statfs":{"total":53552873472,"available":53546242048,"internally_reserved":0,"allocated":6631424,"data_stored":6631424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53546643456,"internally_reserved":0,"allocated":6230016,"data_stored":6230016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53546242048,"internally_reserved":0,"allocated":6631424,"data_stored":6631424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53547573248,"internally_reserved":0,"allocated":5300224,"data_stored":5300224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53547552768,"internally_reserved":0,"allocated":5320704,"data_stored":5320704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53546643456,"internally_reserved":0,"allocated":6230016,"data_stored":6230016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":53552873472,"available":53546242048,"internally_reserved":0,"allocated":6631424,"data_stored":6631424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":53552873472,"available":53547573248,"internally_reserved":0,"allocated":5300224,"data_stored":5300224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":53552873472,"available":53547552768,"internally_reserved":0,"allocated":5320704,"data_stored":5320704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":53552873472,"available":53546643456,"internally_reserved":0,"allocated":6230016,"data_stored":6230016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:06:54.302 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T17:06:54.410 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.401+0000 7f1935d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:54.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.410+0000 7f1935d51640 1 Processor -- start 2024-09-16T17:06:54.411 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.410+0000 7f1935d51640 1 -- start start 2024-09-16T17:06:54.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.411+0000 7f1935d51640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1930135300 0x7f1930135710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:54.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.411+0000 7f1935d51640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19300a1bc0 con 0x7f1930135c50 2024-09-16T17:06:54.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.411+0000 7f1935d51640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 -- 0x7f193006f800 con 0x7f1930135300 2024-09-16T17:06:54.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.411+0000 7f192f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1930135300 0x7f1930135710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:54.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.411+0000 7f1927fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1930135c50 0x7f1930132160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51316/0 (socket says 172.21.15.89:51316) 2024-09-16T17:06:54.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.411+0000 7f1927fff640 1 -- 172.21.15.89:0/23965129 learned_addr learned my addr 172.21.15.89:0/23965129 (peer_addr_for_me v1:172.21.15.89:0/0) 2024-09-16T17:06:54.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.411+0000 7f192f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1930135300 0x7f1930135710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53668/0 (socket says 172.21.15.89:53668) 2024-09-16T17:06:54.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.411+0000 7f192f7fe640 1 -- 172.21.15.89:0/23965129 >> v1:172.21.15.89:6789/0 conn(0x7f1930135c50 legacy=0x7f1930132160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:54.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.411+0000 7f192effd640 1 -- 172.21.15.89:0/23965129 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1712006490 0 0) 0x7f19300a1bc0 con 0x7f1930135c50 2024-09-16T17:06:54.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.411+0000 7f192f7fe640 1 -- 172.21.15.89:0/23965129 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193006f2b0 con 0x7f1930135300 2024-09-16T17:06:54.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.412+0000 7f192f7fe640 1 --2- 172.21.15.89:0/23965129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1930135300 0x7f1930135710 crc :-1 s=READY pgs=13026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57b065e49d5aeb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:54.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.412+0000 7f192effd640 1 -- 172.21.15.89:0/23965129 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1920009d90 con 0x7f1930135300 2024-09-16T17:06:54.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.412+0000 7f192effd640 1 -- 172.21.15.89:0/23965129 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f192000e230 con 0x7f1930135300 2024-09-16T17:06:54.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.412+0000 7f192effd640 1 -- 172.21.15.89:0/23965129 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f192000e4d0 con 0x7f1930135300 2024-09-16T17:06:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.412+0000 7f1935d51640 1 -- 172.21.15.89:0/23965129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1930135300 msgr2=0x7f1930135710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.412+0000 7f1935d51640 1 --2- 172.21.15.89:0/23965129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1930135300 0x7f1930135710 crc :-1 s=READY pgs=13026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.413+0000 7f1935d51640 1 -- 172.21.15.89:0/23965129 shutdown_connections 2024-09-16T17:06:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.413+0000 7f1935d51640 1 --2- 172.21.15.89:0/23965129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1930135300 0x7f1930135710 unknown :-1 s=CLOSED pgs=13026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.413+0000 7f1935d51640 1 -- 172.21.15.89:0/23965129 >> 172.21.15.89:0/23965129 conn(0x7f193006e3e0 msgr2=0x7f193006e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.413+0000 7f1935d51640 1 -- 172.21.15.89:0/23965129 shutdown_connections 2024-09-16T17:06:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.413+0000 7f1935d51640 1 -- 172.21.15.89:0/23965129 wait complete. 2024-09-16T17:06:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.413+0000 7f1935d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:06:54.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.414+0000 7f1935d51640 1 Processor -- start 2024-09-16T17:06:54.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.414+0000 7f1935d51640 1 -- start start 2024-09-16T17:06:54.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.415+0000 7f1935d51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1930135300 0x7f193011f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:54.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.415+0000 7f1935d51640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1930122fc0 con 0x7f1930135300 2024-09-16T17:06:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.415+0000 7f192f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1930135300 0x7f193011f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.415+0000 7f192f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1930135300 0x7f193011f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53678/0 (socket says 172.21.15.89:53678) 2024-09-16T17:06:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.415+0000 7f192f7fe640 1 -- 172.21.15.89:0/3142707709 learned_addr learned my addr 172.21.15.89:0/3142707709 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-16T17:06:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.416+0000 7f192f7fe640 1 -- 172.21.15.89:0/3142707709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1930132d40 con 0x7f1930135300 2024-09-16T17:06:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.416+0000 7f192f7fe640 1 --2- 172.21.15.89:0/3142707709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1930135300 0x7f193011f020 crc :-1 s=READY pgs=13027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.416+0000 7f192cff9640 1 -- 172.21.15.89:0/3142707709 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1920013610 con 0x7f1930135300 2024-09-16T17:06:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.416+0000 7f192cff9640 1 -- 172.21.15.89:0/3142707709 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1920013770 con 0x7f1930135300 2024-09-16T17:06:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.416+0000 7f1935d51640 1 -- 172.21.15.89:0/3142707709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1930120a60 con 0x7f1930135300 2024-09-16T17:06:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.416+0000 7f192cff9640 1 -- 172.21.15.89:0/3142707709 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1920013a10 con 0x7f1930135300 2024-09-16T17:06:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.416+0000 7f1935d51640 1 -- 172.21.15.89:0/3142707709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1930121880 con 0x7f1930135300 2024-09-16T17:06:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.417+0000 7f1935d51640 1 -- 172.21.15.89:0/3142707709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f193006a300 con 0x7f1930135300 2024-09-16T17:06:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.417+0000 7f192cff9640 1 -- 172.21.15.89:0/3142707709 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1920013bc0 con 0x7f1930135300 2024-09-16T17:06:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.417+0000 7f192cff9640 1 --2- 172.21.15.89:0/3142707709 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f191003e960 0x7f1910040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T17:06:54.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.417+0000 7f192cff9640 1 -- 172.21.15.89:0/3142707709 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(726..726 src has 676..726) ==== 3431+0+0 (crc 0 0 0) 0x7f1920018040 con 0x7f1930135300 2024-09-16T17:06:54.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.417+0000 7f1927fff640 1 --2- 172.21.15.89:0/3142707709 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f191003e960 0x7f1910040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T17:06:54.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.418+0000 7f1927fff640 1 --2- 172.21.15.89:0/3142707709 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f191003e960 0x7f1910040e70 crc :-1 s=READY pgs=3890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T17:06:54.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.422+0000 7f192cff9640 1 -- 172.21.15.89:0/3142707709 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f1920011570 con 0x7f1930135300 2024-09-16T17:06:54.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.598+0000 7f1935d51640 1 -- 172.21.15.89:0/3142707709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f193009ba90 con 0x7f1930135300 2024-09-16T17:06:54.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.602+0000 7f192cff9640 1 -- 172.21.15.89:0/3142707709 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (crc 0 0 0) 0x7f1920018bf0 con 0x7f1930135300 2024-09-16T17:06:54.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.603+0000 7f192cff9640 1 -- 172.21.15.89:0/3142707709 <== mon.0 v2:172.21.15.89:3300/0 8 ==== config(1 keys) ==== 35+0+0 (crc 0 0 0) 0x7f1920013e70 con 0x7f1930135300 2024-09-16T17:06:54.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.604+0000 7f1935d51640 1 -- 172.21.15.89:0/3142707709 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f191003e960 msgr2=0x7f1910040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:54.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.604+0000 7f1935d51640 1 --2- 172.21.15.89:0/3142707709 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f191003e960 0x7f1910040e70 crc :-1 s=READY pgs=3890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:54.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.604+0000 7f1935d51640 1 -- 172.21.15.89:0/3142707709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1930135300 msgr2=0x7f193011f020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T17:06:54.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.604+0000 7f1935d51640 1 --2- 172.21.15.89:0/3142707709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1930135300 0x7f193011f020 crc :-1 s=READY pgs=13027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:54.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.604+0000 7f1935d51640 1 -- 172.21.15.89:0/3142707709 shutdown_connections 2024-09-16T17:06:54.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.604+0000 7f1935d51640 1 --2- 172.21.15.89:0/3142707709 >> [v2:172.21.15.177:6800/1212166405,v1:172.21.15.177:6801/1212166405] conn(0x7f191003e960 0x7f1910040e70 unknown :-1 s=CLOSED pgs=3890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:54.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.604+0000 7f1935d51640 1 --2- 172.21.15.89:0/3142707709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1930135300 0x7f193011f020 unknown :-1 s=CLOSED pgs=13027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T17:06:54.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.604+0000 7f1935d51640 1 -- 172.21.15.89:0/3142707709 >> 172.21.15.89:0/3142707709 conn(0x7f193006e3e0 msgr2=0x7f19300a58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T17:06:54.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.604+0000 7f1935d51640 1 -- 172.21.15.89:0/3142707709 shutdown_connections 2024-09-16T17:06:54.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-16T17:06:54.605+0000 7f1935d51640 1 -- 172.21.15.89:0/3142707709 wait complete. 2024-09-16T17:06:54.619 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T17:06:54.619 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T17:06:54.619 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T17:06:54.619 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:06:54.698 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T17:06:54.699 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T17:06:54.699 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:06:54.772 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T17:06:54.772 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T17:06:54.773 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:06:54.844 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T17:06:54.844 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T17:06:54.844 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:06:54.926 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T17:06:54.926 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T17:06:54.926 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T17:06:54.926 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:06:54.956 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T17:06:54.956 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T17:06:54.957 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T17:06:54.957 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:06:54.971 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T17:06:54.971 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T17:06:54.971 DEBUG:teuthology.orchestra.run.smithi089:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-09-16T17:06:55.040 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-16T17:06:55.040 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T17:06:55.280 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-16T17:06:55.280 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T17:06:55.370 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T17:06:55.370 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T17:06:55.456 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T17:06:55.456 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T17:06:55.542 INFO:tasks.ceph:Archiving mon data... 2024-09-16T17:06:55.544 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907388/data/mon.a.tgz 2024-09-16T17:06:55.544 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-09-16T17:06:55.559 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.F6Jq6cGRGF 2024-09-16T17:06:55.560 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.F6Jq6cGRGF 2024-09-16T17:06:55.697 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.F6Jq6cGRGF 2024-09-16T17:06:55.779 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.F6Jq6cGRGF is 299KB 2024-09-16T17:06:55.876 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.F6Jq6cGRGF 2024-09-16T17:06:55.891 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T17:06:55.891 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T17:06:55.933 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T17:06:56.010 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T17:06:56.026 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T17:06:56.026 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T17:06:56.027 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907388/remote/smithi089/crash 2024-09-16T17:06:56.028 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T17:06:56.074 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907388/remote/smithi177/crash 2024-09-16T17:06:56.075 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T17:06:56.109 INFO:tasks.ceph:Compressing logs... 2024-09-16T17:06:56.109 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T17:06:56.118 DEBUG:teuthology.orchestra.run.smithi177:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T17:06:56.139 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T17:06:56.139 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96442.log 2024-09-16T17:06:56.142 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28382.log 2024-09-16T17:06:56.142 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.96442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93747.log 2024-09-16T17:06:56.142 INFO:teuthology.orchestra.run.smithi089.stderr: 85.9%/var/log/ceph/ceph-client.admin.28382.log: -- replaced with /var/log/ceph/ceph-client.admin.96442.log.gz 2024-09-16T17:06:56.142 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96778.log 2024-09-16T17:06:56.142 INFO:teuthology.orchestra.run.smithi089.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.28382.log.gz 2024-09-16T17:06:56.143 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95877.log 2024-09-16T17:06:56.143 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93747.log: /var/log/ceph/ceph-client.admin.96778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94922.log 2024-09-16T17:06:56.143 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30758.log 2024-09-16T17:06:56.143 INFO:teuthology.orchestra.run.smithi089.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.96778.log.gz 2024-09-16T17:06:56.143 INFO:teuthology.orchestra.run.smithi089.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.93747.log.gz 2024-09-16T17:06:56.143 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.94922.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95877.log.gz 2024-09-16T17:06:56.143 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96232.log 2024-09-16T17:06:56.143 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28297.log 2024-09-16T17:06:56.143 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92994.log 2024-09-16T17:06:56.143 INFO:teuthology.orchestra.run.smithi089.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.96232.log.gz 2024-09-16T17:06:56.143 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93900.log 2024-09-16T17:06:56.186 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27758.log 2024-09-16T17:06:56.187 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27798.log 2024-09-16T17:06:56.187 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27718.log 2024-09-16T17:06:56.187 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.27758.log: /var/log/ceph/ceph-client.admin.27798.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T17:06:56.187 INFO:teuthology.orchestra.run.smithi177.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.27758.log.gz 2024-09-16T17:06:56.187 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.27718.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.27798.log.gz 2024-09-16T17:06:56.187 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T17:06:56.187 INFO:teuthology.orchestra.run.smithi177.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.27718.log.gz 2024-09-16T17:06:56.187 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-16T17:06:56.187 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27667.log 2024-09-16T17:06:56.187 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.27667.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.27667.log.gz 2024-09-16T17:06:56.211 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28297.log: /var/log/ceph/ceph-client.admin.92994.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.28297.log.gz 2024-09-16T17:06:56.211 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96526.log 2024-09-16T17:06:56.211 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96358.log 2024-09-16T17:06:56.212 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96526.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.94922.log.gz 2024-09-16T17:06:56.212 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93748.log 2024-09-16T17:06:56.212 INFO:teuthology.orchestra.run.smithi089.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.96526.log.gz 2024-09-16T17:06:56.212 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96358.log: gzip -5 --verbose -- 91.0% /var/log/ceph/ceph-client.admin.95898.log 2024-09-16T17:06:56.212 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.92994.log.gz 2024-09-16T17:06:56.212 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93900.log.gz 2024-09-16T17:06:56.212 INFO:teuthology.orchestra.run.smithi089.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96358.log.gz 2024-09-16T17:06:56.212 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93937.log 2024-09-16T17:06:56.212 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95898.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T17:06:56.212 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93748.log.gz 2024-09-16T17:06:56.212 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95898.log.gz 2024-09-16T17:06:56.212 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96070.log 2024-09-16T17:06:56.213 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96860.log 2024-09-16T17:06:56.213 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92926.log 2024-09-16T17:06:56.213 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96070.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93937.log.gz 2024-09-16T17:06:56.213 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96860.log: gzip 86.5% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.96070.log.gz 2024-09-16T17:06:56.213 INFO:teuthology.orchestra.run.smithi089.stderr: /var/log/ceph/ceph-client.admin.95090.log 2024-09-16T17:06:56.213 INFO:teuthology.orchestra.run.smithi089.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.96860.log.gz 2024-09-16T17:06:56.213 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.92926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95365.log 2024-09-16T17:06:56.213 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28522.log 2024-09-16T17:06:56.213 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95090.log: /var/log/ceph/ceph-client.admin.95365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93901.log 2024-09-16T17:06:56.213 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7%/var/log/ceph/ceph-client.admin.28522.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95090.log.gz 2024-09-16T17:06:56.213 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95365.log.gz 2024-09-16T17:06:56.213 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94144.log 2024-09-16T17:06:56.213 INFO:teuthology.orchestra.run.smithi089.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.28522.log.gz 2024-09-16T17:06:56.214 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93901.log: gzip -5 90.7% -- replaced with /var/log/ceph/ceph-client.admin.92926.log.gz 2024-09-16T17:06:56.214 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.93588.log 2024-09-16T17:06:56.214 INFO:teuthology.orchestra.run.smithi089.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.93901.log.gz 2024-09-16T17:06:56.214 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.94144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96316.log 2024-09-16T17:06:56.214 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30643.log 2024-09-16T17:06:56.214 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28918.log 2024-09-16T17:06:56.214 INFO:teuthology.orchestra.run.smithi089.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.96316.log.gz 2024-09-16T17:06:56.214 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96652.log 2024-09-16T17:06:56.214 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28918.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.30643.log.gz 2024-09-16T17:06:56.214 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28748.log 2024-09-16T17:06:56.214 INFO:teuthology.orchestra.run.smithi089.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.93588.log.gz 2024-09-16T17:06:56.214 INFO:teuthology.orchestra.run.smithi089.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.28918.log.gz 2024-09-16T17:06:56.214 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94012.log 2024-09-16T17:06:56.214 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96652.log: /var/log/ceph/ceph-client.admin.28748.log: gzip -5 --verbose 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96652.log.gz 2024-09-16T17:06:56.215 INFO:teuthology.orchestra.run.smithi089.stderr: -- /var/log/ceph/ceph-client.admin.94695.log 2024-09-16T17:06:56.215 INFO:teuthology.orchestra.run.smithi089.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.28748.log.gz 2024-09-16T17:06:56.215 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.94012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29110.log 2024-09-16T17:06:56.215 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.94695.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.94012.log.gz 2024-09-16T17:06:56.215 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 92.0% -- replaced with /var/log/ceph/ceph-client.admin.94144.log.gz 2024-09-16T17:06:56.215 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.28325.log 2024-09-16T17:06:56.215 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95856.log 2024-09-16T17:06:56.215 INFO:teuthology.orchestra.run.smithi089.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29110.log.gz 2024-09-16T17:06:56.215 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95648.log 2024-09-16T17:06:56.215 INFO:teuthology.orchestra.run.smithi089.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.28325.log.gz 2024-09-16T17:06:56.215 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95555.log 2024-09-16T17:06:56.215 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95856.log.gz 2024-09-16T17:06:56.215 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95648.log: --verbose -- /var/log/ceph/ceph-client.admin.30590.log 2024-09-16T17:06:56.215 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95555.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.95648.log.gz 2024-09-16T17:06:56.216 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28915.log 2024-09-16T17:06:56.216 INFO:teuthology.orchestra.run.smithi089.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95555.log.gz 2024-09-16T17:06:56.216 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94010.log 2024-09-16T17:06:56.216 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5/var/log/ceph/ceph-client.admin.28915.log: --verbose -- /var/log/ceph/ceph-client.admin.28917.log 2024-09-16T17:06:56.216 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.94010.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.28915.log.gz 2024-09-16T17:06:56.216 INFO:teuthology.orchestra.run.smithi089.stderr:gzip 90.2% -- replaced with /var/log/ceph/ceph-client.admin.30590.log.gz 2024-09-16T17:06:56.216 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95269.log 2024-09-16T17:06:56.216 INFO:teuthology.orchestra.run.smithi089.stderr: 92.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.94695.log.gz 2024-09-16T17:06:56.216 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose/var/log/ceph/ceph-client.admin.28917.log: -- /var/log/ceph/ceph-client.admin.93380.log 2024-09-16T17:06:56.216 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94010.log.gz 2024-09-16T17:06:56.216 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95269.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28917.log.gz 2024-09-16T17:06:56.216 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93644.log 2024-09-16T17:06:56.216 INFO:teuthology.orchestra.run.smithi089.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.95269.log.gz 2024-09-16T17:06:56.216 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92405.log 2024-09-16T17:06:56.217 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93380.log: /var/log/ceph/ceph-client.admin.93644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28648.log 2024-09-16T17:06:56.217 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.92405.log: gzip 88.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.93608.log 2024-09-16T17:06:56.217 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93644.log.gz 2024-09-16T17:06:56.217 INFO:teuthology.orchestra.run.smithi089.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.93380.log.gz 2024-09-16T17:06:56.217 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95512.log 2024-09-16T17:06:56.217 INFO:teuthology.orchestra.run.smithi089.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.28648.log.gz 2024-09-16T17:06:56.217 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93645.log 2024-09-16T17:06:56.217 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5/var/log/ceph/ceph-client.admin.95512.log: --verbose -- /var/log/ceph/ceph-client.admin.95835.log 2024-09-16T17:06:56.217 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93645.log: 88.5% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95512.log.gz 2024-09-16T17:06:56.217 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93608.log.gz 2024-09-16T17:06:56.217 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28916.log 2024-09-16T17:06:56.217 INFO:teuthology.orchestra.run.smithi089.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.93645.log.gz 2024-09-16T17:06:56.217 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T17:06:56.218 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95835.log: /var/log/ceph/ceph-client.admin.28916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28438.log 2024-09-16T17:06:56.218 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95835.log.gz 2024-09-16T17:06:56.218 INFO:teuthology.orchestra.run.smithi089.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.28916.log.gz 2024-09-16T17:06:56.218 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96400.log 2024-09-16T17:06:56.218 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93749.log 2024-09-16T17:06:56.218 INFO:teuthology.orchestra.run.smithi089.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.28438.log.gz 2024-09-16T17:06:56.218 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95386.log 2024-09-16T17:06:56.218 INFO:teuthology.orchestra.run.smithi089.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96400.log.gz 2024-09-16T17:06:56.218 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93459.log 2024-09-16T17:06:56.218 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95386.log: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T17:06:56.218 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94011.log 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93749.log.gz 2024-09-16T17:06:56.218 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-16T17:06:56.218 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95386.log.gz 2024-09-16T17:06:56.218 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95647.log 2024-09-16T17:06:56.219 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.94011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95940.log 2024-09-16T17:06:56.219 INFO:teuthology.orchestra.run.smithi089.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.94011.log.gz/var/log/ceph/ceph-client.admin.95647.log: 2024-09-16T17:06:56.219 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93832.log 2024-09-16T17:06:56.219 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95647.log.gz 2024-09-16T17:06:56.219 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30682.log 2024-09-16T17:06:56.219 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95940.log.gz 2024-09-16T17:06:56.219 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30720.log 2024-09-16T17:06:56.219 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96046.log 2024-09-16T17:06:56.219 INFO:teuthology.orchestra.run.smithi089.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93832.log.gz/var/log/ceph/ceph-client.admin.30720.log: 2024-09-16T17:06:56.219 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28749.log 2024-09-16T17:06:56.219 INFO:teuthology.orchestra.run.smithi089.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30720.log.gz 2024-09-16T17:06:56.219 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96095.log 2024-09-16T17:06:56.219 INFO:teuthology.orchestra.run.smithi089.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.96046.log.gz 2024-09-16T17:06:56.220 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93746.log 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28749.log.gz 2024-09-16T17:06:56.220 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-16T17:06:56.220 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28606.log 2024-09-16T17:06:56.220 INFO:teuthology.orchestra.run.smithi089.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96095.log.gz 2024-09-16T17:06:56.220 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28747.log 2024-09-16T17:06:56.220 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28606.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93746.log.gz 2024-09-16T17:06:56.220 INFO:teuthology.orchestra.run.smithi089.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28606.log.gz 2024-09-16T17:06:56.220 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96820.log 2024-09-16T17:06:56.220 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28747.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27261.log 2024-09-16T17:06:56.220 INFO:teuthology.orchestra.run.smithi089.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.28747.log.gz 2024-09-16T17:06:56.220 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94127.log 2024-09-16T17:06:56.220 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.tmp-client.admin.27261.log: 95.1% 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27261.log.gz 2024-09-16T17:06:56.220 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.92405.log.gz 85.6% -- replaced with /var/log/ceph/ceph-client.admin.96820.log.gz 2024-09-16T17:06:56.221 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-16T17:06:56.221 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96025.log 2024-09-16T17:06:56.221 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.94127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92869.log 2024-09-16T17:06:56.221 INFO:teuthology.orchestra.run.smithi089.stderr: 86.1%/var/log/ceph/ceph-client.admin.96025.log: -- replaced with /var/log/ceph/ceph-client.admin.94127.log.gz 2024-09-16T17:06:56.221 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95556.log 2024-09-16T17:06:56.221 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96025.log.gz 2024-09-16T17:06:56.221 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T17:06:56.221 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.92869.log: /var/log/ceph/ceph-client.admin.95556.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.93459.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95621.log 2024-09-16T17:06:56.221 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-16T17:06:56.221 INFO:teuthology.orchestra.run.smithi089.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.95556.log.gz 2024-09-16T17:06:56.221 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.a.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92869.log.gz 2024-09-16T17:06:56.221 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95982.log 2024-09-16T17:06:56.221 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94588.log 2024-09-16T17:06:56.221 INFO:teuthology.orchestra.run.smithi089.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.95621.log.gz 2024-09-16T17:06:56.222 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96568.log 2024-09-16T17:06:56.222 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95982.log.gz 2024-09-16T17:06:56.222 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94404.log 2024-09-16T17:06:56.222 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96568.log: /var/log/ceph/ceph-client.admin.94588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93646.log 2024-09-16T17:06:56.222 INFO:teuthology.orchestra.run.smithi089.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.30682.log.gz 2024-09-16T17:06:56.222 INFO:teuthology.orchestra.run.smithi089.stderr: 86.8%/var/log/ceph/ceph-client.admin.94404.log: -- replaced with /var/log/ceph/ceph-client.admin.96568.log.gz 2024-09-16T17:06:56.222 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92477.log 2024-09-16T17:06:56.222 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92850.log 2024-09-16T17:06:56.222 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.92477.log: 89.6% 91.7% -- replaced with /var/log/ceph/ceph-client.admin.94588.log.gz 2024-09-16T17:06:56.222 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93646.log.gz 2024-09-16T17:06:56.222 INFO:teuthology.orchestra.run.smithi089.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92477.log.gz 2024-09-16T17:06:56.222 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95600.log 2024-09-16T17:06:56.222 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.92850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93975.log 2024-09-16T17:06:56.223 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95407.log 2024-09-16T17:06:56.223 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92850.log.gz 2024-09-16T17:06:56.223 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95600.log.gz 2024-09-16T17:06:56.223 INFO:teuthology.orchestra.run.smithi089.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.94404.log.gz 2024-09-16T17:06:56.223 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28140.log 2024-09-16T17:06:56.223 INFO:teuthology.orchestra.run.smithi089.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.93975.log.gz 2024-09-16T17:06:56.223 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30739.log 2024-09-16T17:06:56.223 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28140.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29068.log 2024-09-16T17:06:56.223 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95407.log.gz 2024-09-16T17:06:56.223 INFO:teuthology.orchestra.run.smithi089.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.28140.log.gz 2024-09-16T17:06:56.223 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92697.log 2024-09-16T17:06:56.223 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93609.log 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30739.log.gz 2024-09-16T17:06:56.223 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-16T17:06:56.223 INFO:teuthology.orchestra.run.smithi089.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29068.log.gz 2024-09-16T17:06:56.223 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.92697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95319.log 2024-09-16T17:06:56.224 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95344.log 2024-09-16T17:06:56.224 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95319.log: gzip 89.8% -- replaced with /var/log/ceph/ceph-client.admin.92697.log.gz -5 2024-09-16T17:06:56.224 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.95428.log 2024-09-16T17:06:56.224 INFO:teuthology.orchestra.run.smithi089.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.93609.log.gz 2024-09-16T17:06:56.224 INFO:teuthology.orchestra.run.smithi089.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.95319.log.gz 2024-09-16T17:06:56.224 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29026.log 2024-09-16T17:06:56.224 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95428.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95344.log.gz 2024-09-16T17:06:56.224 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T17:06:56.224 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29026.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95428.log.gz 2024-09-16T17:06:56.224 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92734.log 2024-09-16T17:06:56.224 INFO:teuthology.orchestra.run.smithi089.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.29026.log.gz 2024-09-16T17:06:56.224 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93607.log 2024-09-16T17:06:56.224 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.92734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28750.log 2024-09-16T17:06:56.224 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93834.log 2024-09-16T17:06:56.225 INFO:teuthology.orchestra.run.smithi089.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.93607.log.gz 2024-09-16T17:06:56.225 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28750.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28750.log.gz 2024-09-16T17:06:56.225 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96694.log 2024-09-16T17:06:56.225 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96274.log 2024-09-16T17:06:56.225 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93834.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.92734.log.gz 2024-09-16T17:06:56.225 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94063.log 2024-09-16T17:06:56.225 INFO:teuthology.orchestra.run.smithi089.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.96694.log.gz 2024-09-16T17:06:56.225 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96274.log: 88.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T17:06:56.225 INFO:teuthology.orchestra.run.smithi089.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93834.log.gz 2024-09-16T17:06:56.225 INFO:teuthology.orchestra.run.smithi089.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.96274.log.gz 2024-09-16T17:06:56.225 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95295.log 2024-09-16T17:06:56.225 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.94063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28471.log 2024-09-16T17:06:56.225 INFO:teuthology.orchestra.run.smithi089.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.94063.log.gz 2024-09-16T17:06:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95961.log 2024-09-16T17:06:56.226 INFO:teuthology.orchestra.run.smithi089.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.95295.log.gz 2024-09-16T17:06:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:gzip/var/log/ceph/ceph-client.admin.28471.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.95449.log 2024-09-16T17:06:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95961.log: gzip -5 --verbose 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28471.log.gz 2024-09-16T17:06:56.226 INFO:teuthology.orchestra.run.smithi089.stderr: -- /var/log/ceph/ceph-client.admin.93695.log 2024-09-16T17:06:56.226 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95961.log.gz 2024-09-16T17:06:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29330.log 2024-09-16T17:06:56.226 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95449.log.gz 2024-09-16T17:06:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95716.log 2024-09-16T17:06:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92515.log 2024-09-16T17:06:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95716.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93695.log.gz 2024-09-16T17:06:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30624.log 2024-09-16T17:06:56.226 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95716.log.gz 2024-09-16T17:06:56.226 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.92515.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.92515.log.gz 2024-09-16T17:06:56.227 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94080.log 2024-09-16T17:06:56.227 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.30624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93938.log 2024-09-16T17:06:56.227 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.94080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96610.log 2024-09-16T17:06:56.227 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93938.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.29330.log.gz 2024-09-16T17:06:56.227 INFO:teuthology.orchestra.run.smithi089.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.93938.log.gz 2024-09-16T17:06:56.227 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93696.log 2024-09-16T17:06:56.227 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96610.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.94080.log.gz 2024-09-16T17:06:56.227 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92907.log 2024-09-16T17:06:56.227 INFO:teuthology.orchestra.run.smithi089.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.96610.log.gz 2024-09-16T17:06:56.227 INFO:teuthology.orchestra.run.smithi089.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.30624.log.gz 2024-09-16T17:06:56.227 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95122.log 2024-09-16T17:06:56.227 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96484.log 2024-09-16T17:06:56.227 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.92907.log: /var/log/ceph/ceph-client.admin.95122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94357.log 2024-09-16T17:06:56.227 INFO:teuthology.orchestra.run.smithi089.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.93696.log.gz 2024-09-16T17:06:56.228 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95764.log 2024-09-16T17:06:56.228 INFO:teuthology.orchestra.run.smithi089.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96484.log.gz 2024-09-16T17:06:56.228 INFO:teuthology.orchestra.run.smithi089.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.92907.log.gz 2024-09-16T17:06:56.228 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.94357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93697.log 2024-09-16T17:06:56.228 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95919.log 2024-09-16T17:06:56.228 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93697.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.95764.log.gz 2024-09-16T17:06:56.228 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95738.log 2024-09-16T17:06:56.228 INFO:teuthology.orchestra.run.smithi089.stderr: 88.5%/var/log/ceph/ceph-client.admin.95919.log: -- replaced with /var/log/ceph/ceph-client.admin.93697.log.gz 2024-09-16T17:06:56.228 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95919.log.gz 2024-09-16T17:06:56.228 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28564.log 2024-09-16T17:06:56.228 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92888.log 2024-09-16T17:06:56.228 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.28564.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.95738.log.gz 2024-09-16T17:06:56.228 INFO:teuthology.orchestra.run.smithi089.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.28564.log.gz 2024-09-16T17:06:56.229 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93045.log 2024-09-16T17:06:56.229 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.92888.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.92888.log.gz 2024-09-16T17:06:56.229 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93974.log 2024-09-16T17:06:56.229 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95533.log 2024-09-16T17:06:56.229 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.93974.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93974.log.gz 2024-09-16T17:06:56.229 INFO:teuthology.orchestra.run.smithi089.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.94357.log.gz 2024-09-16T17:06:56.229 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96736.log 2024-09-16T17:06:56.229 INFO:teuthology.orchestra.run.smithi089.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.95122.log.gz 2024-09-16T17:06:56.229 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95470.log 2024-09-16T17:06:56.229 INFO:teuthology.orchestra.run.smithi089.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95533.log.gz 2024-09-16T17:06:56.229 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96119.log 2024-09-16T17:06:56.229 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96736.log: /var/log/ceph/ceph-client.admin.95470.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.93045.log.gz 2024-09-16T17:06:56.229 INFO:teuthology.orchestra.run.smithi089.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.96736.log.gz 2024-09-16T17:06:56.229 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95470.log.gz 2024-09-16T17:06:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95491.log 2024-09-16T17:06:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95788.log 2024-09-16T17:06:56.230 INFO:teuthology.orchestra.run.smithi089.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96119.log.gz 2024-09-16T17:06:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93750.log 2024-09-16T17:06:56.230 INFO:teuthology.orchestra.run.smithi089.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95491.log.gz 2024-09-16T17:06:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29799.log 2024-09-16T17:06:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95788.log: /var/log/ceph/ceph-client.admin.93750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95814.log 2024-09-16T17:06:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.29799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95692.log 2024-09-16T17:06:56.230 INFO:teuthology.orchestra.run.smithi089.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.95788.log.gz 2024-09-16T17:06:56.230 INFO:teuthology.orchestra.run.smithi089.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.93750.log.gz 2024-09-16T17:06:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93833.log 2024-09-16T17:06:56.230 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95814.log.gz 2024-09-16T17:06:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96003.log 2024-09-16T17:06:56.230 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.95692.log: /var/log/ceph/ceph-client.admin.93833.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.95692.log.gz 2024-09-16T17:06:56.231 INFO:teuthology.orchestra.run.smithi089.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.93833.log.gz 2024-09-16T17:06:56.231 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28061.log 2024-09-16T17:06:56.231 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.96003.log: /var/log/ceph/ceph-client.admin.28061.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96003.log.gz 2024-09-16T17:06:56.231 INFO:teuthology.orchestra.run.smithi089.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.28061.log.gz 2024-09-16T17:06:56.231 INFO:teuthology.orchestra.run.smithi089.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.29799.log.gz 2024-09-16T17:06:56.368 INFO:teuthology.orchestra.run.smithi177.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T17:06:56.597 INFO:teuthology.orchestra.run.smithi089.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.30758.log.gz 2024-09-16T17:06:57.709 INFO:teuthology.orchestra.run.smithi089.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T17:06:59.251 INFO:teuthology.orchestra.run.smithi177.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T17:06:59.269 INFO:teuthology.orchestra.run.smithi089.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T17:06:59.627 INFO:teuthology.orchestra.run.smithi177.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-16T17:06:59.629 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-09-16T17:06:59.629 INFO:teuthology.orchestra.run.smithi177.stderr:real 0m3.458s 2024-09-16T17:06:59.629 INFO:teuthology.orchestra.run.smithi177.stderr:user 0m6.424s 2024-09-16T17:06:59.629 INFO:teuthology.orchestra.run.smithi177.stderr:sys 0m0.288s 2024-09-16T17:06:59.637 INFO:teuthology.orchestra.run.smithi089.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T17:06:59.639 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-16T17:06:59.639 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m3.509s 2024-09-16T17:06:59.639 INFO:teuthology.orchestra.run.smithi089.stderr:user 0m8.415s 2024-09-16T17:06:59.639 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m0.446s 2024-09-16T17:06:59.639 INFO:tasks.ceph:Archiving logs... 2024-09-16T17:06:59.639 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907388/remote/smithi089/log 2024-09-16T17:06:59.640 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T17:07:01.012 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907388/remote/smithi177/log 2024-09-16T17:07:01.013 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T17:07:01.909 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T17:07:01.917 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T17:07:01.918 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T17:07:01.920 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T17:07:02.008 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T17:07:02.016 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T17:07:02.016 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T17:07:02.019 DEBUG:teuthology.orchestra.run.smithi177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T17:07:02.032 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-09-16T17:07:02.035 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2024-09-16T17:07:02.037 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T17:07:02.037 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-09-16T17:07:02.038 INFO:teuthology.orchestra.run.smithi089.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 -281us[ -279us] +/- 42ms 2024-09-16T17:07:02.038 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 65 -43us[ -40us] +/- 75ms 2024-09-16T17:07:02.038 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 65 +488us[ +491us] +/- 63ms 2024-09-16T17:07:02.038 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T17:07:02.039 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T17:07:02.039 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-09-16T17:07:02.039 INFO:teuthology.orchestra.run.smithi177.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 -284us[ -274us] +/- 42ms 2024-09-16T17:07:02.039 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -40us[ -30us] +/- 75ms 2024-09-16T17:07:02.039 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 +492us[ +492us] +/- 64ms 2024-09-16T17:07:02.039 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T17:07:02.040 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T17:07:02.048 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T17:07:02.049 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T17:07:02.056 DEBUG:teuthology.orchestra.run.smithi089:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T17:07:02.144 DEBUG:teuthology.orchestra.run.smithi177:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T17:07:02.206 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T17:07:02.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:07:02.236 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T17:07:02.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:07:02.264 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T17:07:02.273 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T17:07:02.281 INFO:teuthology.task.internal:Duration was 1890.425687 seconds 2024-09-16T17:07:02.282 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T17:07:02.290 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T17:07:02.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T17:07:02.292 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T17:07:02.329 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T17:07:02.342 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T17:07:02.686 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T17:07:02.686 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2024-09-16T17:07:02.686 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T17:07:02.707 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T17:07:02.707 DEBUG:teuthology.orchestra.run.smithi177:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T17:07:02.746 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T17:07:02.746 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T17:07:02.749 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T17:07:02.813 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T17:07:02.813 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T17:07:02.816 DEBUG:teuthology.orchestra.run.smithi177:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T17:07:02.951 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T17:07:02.960 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T17:07:02.961 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T17:07:02.985 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T17:07:03.010 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T17:07:03.020 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:07:03.028 DEBUG:teuthology.orchestra.run.smithi177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:07:03.049 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2024-09-16T17:07:03.074 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = core 2024-09-16T17:07:03.111 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:07:03.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:07:03.127 DEBUG:teuthology.orchestra.run.smithi177:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:07:03.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:07:03.166 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T17:07:03.176 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T17:07:03.177 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907388/remote/smithi089 2024-09-16T17:07:03.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T17:07:03.209 DEBUG:teuthology.misc:Transferring archived files from smithi177:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907388/remote/smithi177 2024-09-16T17:07:03.210 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T17:07:03.241 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T17:07:03.242 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T17:07:03.247 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T17:07:03.292 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T17:07:03.302 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T17:07:03.302 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T17:07:03.352 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T17:07:03.352 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T17:07:03.355 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T17:07:03.367 INFO:teuthology.orchestra.run.smithi089.stdout: 265778 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 17:07 /home/ubuntu/cephtest 2024-09-16T17:07:03.369 INFO:teuthology.orchestra.run.smithi177.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 17:07 /home/ubuntu/cephtest 2024-09-16T17:07:03.370 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T17:07:03.380 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T17:07:03.400 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rados_api_tests} duration: 1890.4256873130798 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-16T17:07:03.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T17:07:03.497 INFO:teuthology.run:pass