2024-09-15T12:08:13.011 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T12:08:13.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T12:08:13.125 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905495 branch: wip-matanb-crimson-testing-59543 description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests} email: null first_in_suite: false job_id: '7905495' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-59543 ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 1236 sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK4XCTVXXytf+PNXlukMuLpKCXwjoBa3y9cc2wnmGpM++RNPiZaWtt6KAWUHps5GFGXDqEIAtkgt098weo6If2I= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNwoxx05g/M6jPDsdqx6/pdHYLiDlvezET7gzo3kAI17zyPb1J1XiFEh4XSybUVwbPTkVG5VubwsOfhh+PTwZtg= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh --crimson - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_11:59:21 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T12:08:13.126 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-15T12:08:13.127 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-15T12:08:13.127 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T12:08:13.128 INFO:teuthology.task.internal:Checking packages... 2024-09-15T12:08:13.149 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '81fedcb3b484c843d22ffbc8d179cb567b7083b5' 2024-09-15T12:08:13.149 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T12:08:13.149 INFO:teuthology.packaging:ref: None 2024-09-15T12:08:13.149 INFO:teuthology.packaging:tag: None 2024-09-15T12:08:13.149 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-59543 2024-09-15T12:08:13.149 INFO:teuthology.packaging:sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-15T12:08:13.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-59543 2024-09-15T12:08:13.291 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4879.g81fedcb3 2024-09-15T12:08:13.292 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T12:08:13.297 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T12:08:13.297 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T12:08:13.325 INFO:teuthology.task.internal:Saving configuration 2024-09-15T12:08:13.341 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T12:08:13.407 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T12:08:13.430 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905495', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 12:00:24.502698', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK4XCTVXXytf+PNXlukMuLpKCXwjoBa3y9cc2wnmGpM++RNPiZaWtt6KAWUHps5GFGXDqEIAtkgt098weo6If2I='} 2024-09-15T12:08:13.450 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905495', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 12:00:24.500648', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNwoxx05g/M6jPDsdqx6/pdHYLiDlvezET7gzo3kAI17zyPb1J1XiFEh4XSybUVwbPTkVG5VubwsOfhh+PTwZtg='} 2024-09-15T12:08:13.450 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T12:08:13.454 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-15T12:08:13.454 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-15T12:08:13.454 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T12:08:13.534 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd37b0dbbe0>, signals=[15]) 2024-09-15T12:08:13.534 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T12:08:13.539 INFO:teuthology.task.internal:Opening connections... 2024-09-15T12:08:13.539 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2024-09-15T12:08:13.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:08:13.617 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-09-15T12:08:13.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:08:13.689 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T12:08:13.695 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-09-15T12:08:13.713 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-09-15T12:08:13.714 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-09-15T12:08:13.772 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-09-15T12:08:13.772 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2024-09-15T12:08:13.772 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-09-15T12:08:13.772 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-09-15T12:08:13.772 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2024-09-15T12:08:13.772 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2024-09-15T12:08:13.772 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T12:08:13.772 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-09-15T12:08:13.772 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2024-09-15T12:08:13.772 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T12:08:13.772 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-09-15T12:08:13.773 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T12:08:13.773 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T12:08:13.773 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T12:08:13.773 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-09-15T12:08:13.790 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-09-15T12:08:13.808 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-09-15T12:08:13.808 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-09-15T12:08:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-09-15T12:08:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-09-15T12:08:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-09-15T12:08:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-09-15T12:08:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-09-15T12:08:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-09-15T12:08:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T12:08:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-09-15T12:08:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-09-15T12:08:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T12:08:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-09-15T12:08:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T12:08:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T12:08:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T12:08:13.866 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-09-15T12:08:13.881 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T12:08:13.889 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T12:08:13.917 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T12:08:13.918 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2024-09-15T12:08:13.920 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-09-15T12:08:13.936 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T12:08:13.942 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T12:08:13.942 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2024-09-15T12:08:13.977 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-09-15T12:08:14.069 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T12:08:14.122 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T12:08:14.135 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-15T12:08:14.135 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-15T12:08:14.136 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T12:08:14.136 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T12:08:14.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:08:14.153 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-09-15T12:08:14.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:08:14.154 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-09-15T12:08:14.210 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-503.el9.x86_64 2024-09-15T12:08:14.210 INFO:teuthology.task.kernel:Running kernel on smithi142: 5.14.0-503.el9.x86_64 2024-09-15T12:08:14.211 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum install -y kernel 2024-09-15T12:08:14.212 INFO:teuthology.orchestra.run.smithi122.stdout:5.14.0-503.el9.x86_64 2024-09-15T12:08:14.212 INFO:teuthology.task.kernel:Running kernel on smithi122: 5.14.0-503.el9.x86_64 2024-09-15T12:08:14.212 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum install -y kernel 2024-09-15T12:08:16.598 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-15T12:08:17.400 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 5.7 MB/s | 8.2 MB 00:01 2024-09-15T12:08:18.558 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-15T12:08:20.384 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-15T12:08:22.934 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-15T12:08:24.401 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-15T12:08:24.702 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-15T12:08:25.330 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-15T12:08:26.162 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-15T12:08:27.366 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-15T12:08:30.827 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-15T12:08:32.805 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-09-15T12:08:32.867 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T12:08:32.867 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T12:08:32.959 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:08:32.972 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:08:32.972 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-15T12:08:32.972 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:08:32.972 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:08:32.972 INFO:teuthology.orchestra.run.smithi142.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T12:08:32.972 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-15T12:08:32.972 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T12:08:32.972 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T12:08:32.972 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T12:08:32.973 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:08:32.973 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:08:32.973 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:08:32.973 INFO:teuthology.orchestra.run.smithi142.stdout:Install 4 Packages 2024-09-15T12:08:32.973 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:08:32.973 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 79 M 2024-09-15T12:08:32.974 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 126 M 2024-09-15T12:08:32.974 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:08:33.129 INFO:teuthology.orchestra.run.smithi142.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 171 kB/s | 23 kB 00:00 2024-09-15T12:08:33.595 INFO:teuthology.orchestra.run.smithi142.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-15T12:08:34.062 INFO:teuthology.orchestra.run.smithi142.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 32 MB/s | 35 MB 00:01 2024-09-15T12:08:34.312 INFO:teuthology.orchestra.run.smithi142.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 24 MB/s | 29 MB 00:01 2024-09-15T12:08:34.313 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:08:34.313 INFO:teuthology.orchestra.run.smithi142.stdout:Total 59 MB/s | 79 MB 00:01 2024-09-15T12:08:34.820 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T12:08:34.820 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T12:08:34.912 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:08:34.923 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:08:34.923 INFO:teuthology.orchestra.run.smithi122.stdout: Package Architecture Version Repository Size 2024-09-15T12:08:34.923 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:08:34.923 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:08:34.923 INFO:teuthology.orchestra.run.smithi122.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T12:08:34.923 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-15T12:08:34.923 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T12:08:34.924 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T12:08:34.924 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T12:08:34.924 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:08:34.924 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:08:34.924 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:08:34.924 INFO:teuthology.orchestra.run.smithi122.stdout:Install 4 Packages 2024-09-15T12:08:34.924 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:08:34.925 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 79 M 2024-09-15T12:08:34.925 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 126 M 2024-09-15T12:08:34.925 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:08:34.997 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:08:35.057 INFO:teuthology.orchestra.run.smithi122.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 276 kB/s | 23 kB 00:00 2024-09-15T12:08:35.335 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:08:35.335 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:08:36.312 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:08:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:08:36.616 INFO:teuthology.orchestra.run.smithi122.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 18 MB/s | 29 MB 00:01 2024-09-15T12:08:37.740 INFO:teuthology.orchestra.run.smithi122.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.7 MB/s | 16 MB 00:02 2024-09-15T12:08:38.391 INFO:teuthology.orchestra.run.smithi122.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 10 MB/s | 35 MB 00:03 2024-09-15T12:08:38.391 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:08:38.391 INFO:teuthology.orchestra.run.smithi122.stdout:Total 23 MB/s | 79 MB 00:03 2024-09-15T12:08:38.771 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:08:39.073 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:08:39.402 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:08:39.402 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:08:39.456 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T12:08:39.536 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:08:40.387 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:08:40.387 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:08:42.330 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:08:42.454 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:08:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:08:43.511 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T12:08:43.594 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:08:46.387 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:08:46.521 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:08:47.306 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:08:47.419 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:08:51.363 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:08:51.405 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:08:52.264 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:08:56.224 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:09:30.604 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:09:30.649 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:09:31.019 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:09:31.019 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T12:09:31.019 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:09:31.019 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:09:31.870 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:09:31.871 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:09:31.871 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:09:31.871 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T12:09:31.871 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T12:09:31.871 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T12:09:31.871 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T12:09:31.871 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:09:31.871 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:09:32.215 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T12:09:32.314 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T12:09:32.314 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T12:09:32.314 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T12:09:32.314 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T12:09:32.314 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T12:09:32.314 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-15T12:09:32.315 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T12:09:32.315 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T12:09:32.372 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T12:09:32.372 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T12:09:32.373 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-09-15T12:09:32.406 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-09-15T12:09:32.407 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-09-15T12:09:32.407 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2024-09-15T12:09:32.407 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 82.el9 2024-09-15T12:09:32.407 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-09-15T12:09:32.407 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T12:09:32.407 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2024-09-15T12:09:32.407 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8274670 2024-09-15T12:09:32.407 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-09-15T12:09:32.407 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T12:09:32.407 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T12:09:32.407 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T12:09:32.407 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T12:09:32.408 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2024-09-15T12:09:32.408 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-09-15T12:09:32.408 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T12:09:32.408 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-09-15T12:09:32.408 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-09-15T12:09:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:09:32.408 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T12:09:32.408 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T12:09:32.408 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T12:09:32.408 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-09-15T12:09:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:09:32.408 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T12:09:32.409 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T12:09:32.409 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 5.14.0-505.el9.x86_64 2024-09-15T12:09:32.410 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T12:09:33.050 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-09-15T12:09:34.425 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T12:09:34.450 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-09-15T12:09:34.453 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-09-15T12:09:34.469 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.jdjdUCgd6A 2024-09-15T12:09:34.469 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jdjdUCgd6A 2024-09-15T12:09:34.543 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.jdjdUCgd6A 2024-09-15T12:09:34.580 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:09:34.620 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:09:34.681 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.jdjdUCgd6A is 6KB 2024-09-15T12:09:34.729 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.jdjdUCgd6A 2024-09-15T12:09:34.744 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T12:09:34.806 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T12:09:34.807 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T12:09:34.807 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T12:09:34.807 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T12:09:34.808 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T12:09:34.944 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-09-15T12:09:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:09:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T12:09:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:09:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:09:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:09:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:09:35.794 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:09:35.794 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T12:09:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T12:09:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T12:09:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T12:09:35.795 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:09:35.795 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:09:36.133 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T12:09:36.212 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T12:09:36.212 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T12:09:36.212 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T12:09:36.212 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T12:09:36.212 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T12:09:36.213 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-15T12:09:36.213 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi122.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T12:09:36.213 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T12:09:36.271 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T12:09:36.271 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T12:09:36.271 DEBUG:teuthology.orchestra.run.smithi122:> sudo rpm -qi grub2-tools 2024-09-15T12:09:36.308 INFO:teuthology.orchestra.run.smithi122.stdout:Name : grub2-tools 2024-09-15T12:09:36.308 INFO:teuthology.orchestra.run.smithi122.stdout:Epoch : 1 2024-09-15T12:09:36.308 INFO:teuthology.orchestra.run.smithi122.stdout:Version : 2.06 2024-09-15T12:09:36.308 INFO:teuthology.orchestra.run.smithi122.stdout:Release : 82.el9 2024-09-15T12:09:36.308 INFO:teuthology.orchestra.run.smithi122.stdout:Architecture: x86_64 2024-09-15T12:09:36.308 INFO:teuthology.orchestra.run.smithi122.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T12:09:36.308 INFO:teuthology.orchestra.run.smithi122.stdout:Group : Unspecified 2024-09-15T12:09:36.308 INFO:teuthology.orchestra.run.smithi122.stdout:Size : 8274670 2024-09-15T12:09:36.308 INFO:teuthology.orchestra.run.smithi122.stdout:License : GPLv3+ 2024-09-15T12:09:36.308 INFO:teuthology.orchestra.run.smithi122.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T12:09:36.308 INFO:teuthology.orchestra.run.smithi122.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T12:09:36.309 INFO:teuthology.orchestra.run.smithi122.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T12:09:36.309 INFO:teuthology.orchestra.run.smithi122.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T12:09:36.309 INFO:teuthology.orchestra.run.smithi122.stdout:Packager : builder@centos.org 2024-09-15T12:09:36.309 INFO:teuthology.orchestra.run.smithi122.stdout:Vendor : CentOS 2024-09-15T12:09:36.309 INFO:teuthology.orchestra.run.smithi122.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T12:09:36.309 INFO:teuthology.orchestra.run.smithi122.stdout:Summary : Support tools for GRUB. 2024-09-15T12:09:36.309 INFO:teuthology.orchestra.run.smithi122.stdout:Description : 2024-09-15T12:09:36.309 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:09:36.309 INFO:teuthology.orchestra.run.smithi122.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T12:09:36.309 INFO:teuthology.orchestra.run.smithi122.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T12:09:36.309 INFO:teuthology.orchestra.run.smithi122.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T12:09:36.309 INFO:teuthology.orchestra.run.smithi122.stdout:hardware devices. 2024-09-15T12:09:36.310 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:09:36.310 INFO:teuthology.orchestra.run.smithi122.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T12:09:36.310 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T12:09:36.311 INFO:teuthology.task.kernel:Updating grub on smithi122 to boot 5.14.0-505.el9.x86_64 2024-09-15T12:09:36.311 DEBUG:teuthology.orchestra.run.smithi122:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T12:09:36.991 INFO:teuthology.orchestra.run.smithi122.stderr:Generating grub configuration file ... 2024-09-15T12:09:38.329 INFO:teuthology.orchestra.run.smithi122.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T12:09:38.351 INFO:teuthology.orchestra.run.smithi122.stderr:done 2024-09-15T12:09:38.353 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-09-15T12:09:38.369 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.dmEa6t0k0Y 2024-09-15T12:09:38.369 DEBUG:teuthology.orchestra.run.smithi122:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dmEa6t0k0Y 2024-09-15T12:09:38.436 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.dmEa6t0k0Y 2024-09-15T12:09:38.573 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.dmEa6t0k0Y is 6KB 2024-09-15T12:09:38.621 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.dmEa6t0k0Y 2024-09-15T12:09:38.637 DEBUG:teuthology.orchestra.run.smithi122:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T12:09:38.699 INFO:teuthology.orchestra.run.smithi122.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T12:09:38.699 INFO:teuthology.orchestra.run.smithi122.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T12:09:38.700 INFO:teuthology.orchestra.run.smithi122.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T12:09:38.700 INFO:teuthology.orchestra.run.smithi122.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T12:09:38.701 DEBUG:teuthology.orchestra.run.smithi122:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T12:09:38.856 DEBUG:teuthology.orchestra.run.smithi122:> sudo shutdown -r now 2024-09-15T12:10:04.973 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-15T12:10:04.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-15T12:10:04.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:10:08.861 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-15T12:10:08.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-15T12:10:08.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:10:23.421 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-09-15T12:10:32.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-15T12:10:32.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:10:35.485 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-09-15T12:10:47.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-15T12:10:47.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:11:05.917 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-09-15T12:11:08.866 DEBUG:teuthology.orchestra.remote:timed out 2024-09-15T12:11:17.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-15T12:11:17.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:11:18.338 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-09-15T12:11:18.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-15T12:11:18.809 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-15T12:11:18.809 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-09-15T12:11:18.824 INFO:teuthology.orchestra.run.smithi122.stdout:5.14.0-505.el9.x86_64 2024-09-15T12:11:18.824 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T12:11:18.824 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T12:11:18.824 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T12:11:19.826 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-15T12:11:19.826 DEBUG:teuthology.orchestra.run.smithi122:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T12:11:19.931 INFO:teuthology.orchestra.run.smithi122.stdout:ttyS1 2024-09-15T12:11:19.960 DEBUG:teuthology.parallel:result is None 2024-09-15T12:11:20.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-15T12:11:20.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:11:21.306 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-09-15T12:11:21.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-15T12:11:21.737 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-15T12:11:21.737 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-09-15T12:11:21.752 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-505.el9.x86_64 2024-09-15T12:11:21.752 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T12:11:21.752 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T12:11:21.752 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T12:11:22.753 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-15T12:11:22.753 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T12:11:22.895 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2024-09-15T12:11:22.915 DEBUG:teuthology.parallel:result is None 2024-09-15T12:11:22.916 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T12:11:22.922 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T12:11:22.923 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T12:11:22.925 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T12:11:22.968 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T12:11:22.975 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T12:11:23.001 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T12:11:23.002 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T12:11:23.004 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T12:11:23.072 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T12:11:23.079 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T12:11:23.079 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T12:11:23.082 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T12:11:23.110 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T12:11:23.120 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T12:11:23.150 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T12:11:23.171 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T12:11:23.174 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T12:11:23.181 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T12:11:23.181 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T12:11:23.183 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T12:11:23.248 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T12:11:23.257 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T12:11:23.257 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T12:11:23.260 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T12:11:23.317 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T12:11:23.361 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T12:11:23.403 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T12:11:23.485 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T12:11:23.526 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:11:23.526 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T12:11:23.590 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T12:11:23.631 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T12:11:23.854 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T12:11:23.900 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T12:11:23.940 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-15T12:11:23.941 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T12:11:24.007 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2024-09-15T12:11:24.010 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-09-15T12:11:24.063 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T12:11:24.118 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T12:11:24.460 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T12:11:24.468 INFO:teuthology.task.internal:Starting timer... 2024-09-15T12:11:24.468 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T12:11:24.518 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T12:11:24.605 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-15T12:11:24.605 DEBUG:teuthology.orchestra.run.smithi122:> sudo service auditd rotate 2024-09-15T12:11:24.766 INFO:teuthology.orchestra.run.smithi122.stdout:Rotating logs: 2024-09-15T12:11:24.766 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-09-15T12:11:24.806 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-09-15T12:11:24.808 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T12:11:24.808 DEBUG:teuthology.orchestra.run.smithi122:> /usr/sbin/getenforce 2024-09-15T12:11:24.840 INFO:teuthology.orchestra.run.smithi122.stdout:Permissive 2024-09-15T12:11:24.840 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-09-15T12:11:24.889 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-09-15T12:11:24.889 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi122.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2024-09-15T12:11:24.890 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T12:11:24.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:11:24.922 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T12:11:24.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:11:24.956 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T12:11:24.956 DEBUG:teuthology.orchestra.run.smithi122:> sudo /usr/sbin/setenforce permissive 2024-09-15T12:11:25.265 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-09-15T12:11:25.297 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T12:11:25.306 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T12:11:25.323 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T12:11:25.324 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi122.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T12:15:40.057 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi122.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2024-09-15T12:15:40.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-15T12:15:40.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:15:40.140 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-09-15T12:15:40.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-15T12:15:40.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-15T12:15:40.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:15:40.337 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-09-15T12:15:40.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-15T12:15:40.412 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T12:15:40.424 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T12:15:40.424 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T12:15:40.425 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T12:15:40.427 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T12:15:40.427 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T12:15:40.454 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T12:15:40.469 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T12:15:40.482 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T12:15:40.493 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: ntpd: command not found 2024-09-15T12:15:40.496 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T12:15:40.504 INFO:teuthology.orchestra.run.smithi122.stdout:506 Cannot talk to daemon 2024-09-15T12:15:40.518 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T12:15:40.520 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-09-15T12:15:40.532 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T12:15:40.532 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-09-15T12:15:40.546 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T12:15:40.560 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T12:15:40.589 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-09-15T12:15:40.593 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T12:15:40.593 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-09-15T12:15:40.593 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:15:40.593 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:15:40.593 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:15:40.593 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:15:40.619 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-09-15T12:15:40.623 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T12:15:40.623 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-09-15T12:15:40.623 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:15:40.623 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:15:40.624 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:15:40.624 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:15:40.624 INFO:teuthology.run_tasks:Running task install... 2024-09-15T12:15:40.632 DEBUG:teuthology.task.install:project ceph 2024-09-15T12:15:40.633 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}} 2024-09-15T12:15:40.633 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'} 2024-09-15T12:15:40.633 INFO:teuthology.task.install:Using flavor: crimson 2024-09-15T12:15:40.638 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T12:15:40.639 INFO:teuthology.task.install:extra packages: [] 2024-09-15T12:15:40.639 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-15T12:15:40.640 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-15T12:15:40.642 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-15T12:15:40.642 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-15T12:15:40.784 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-15T12:15:40.784 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-15T12:15:40.793 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-15T12:15:40.793 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-15T12:15:41.119 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T12:15:41.119 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:15:41.119 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T12:15:41.124 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T12:15:41.124 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-15T12:15:41.124 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T12:15:41.146 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-15T12:15:41.147 DEBUG:teuthology.orchestra.run.smithi122:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T12:15:41.151 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-15T12:15:41.151 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T12:15:41.213 DEBUG:teuthology.orchestra.run.smithi122:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T12:15:41.218 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T12:15:41.293 DEBUG:teuthology.orchestra.run.smithi122:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T12:15:41.294 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T12:15:41.357 INFO:teuthology.orchestra.run.smithi122.stdout:check_obsoletes = 1 2024-09-15T12:15:41.358 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum clean all 2024-09-15T12:15:41.359 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-09-15T12:15:41.360 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-09-15T12:15:41.584 INFO:teuthology.orchestra.run.smithi122.stdout:45 files removed 2024-09-15T12:15:41.591 INFO:teuthology.orchestra.run.smithi142.stdout:45 files removed 2024-09-15T12:15:41.612 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-radosgw 2024-09-15T12:15:41.618 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw 2024-09-15T12:15:42.713 INFO:teuthology.orchestra.run.smithi122.stdout:ceph packages for x86_64 108 kB/s | 88 kB 00:00 2024-09-15T12:15:42.713 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 109 kB/s | 88 kB 00:00 2024-09-15T12:15:43.422 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 36 kB/s | 24 kB 00:00 2024-09-15T12:15:43.431 INFO:teuthology.orchestra.run.smithi122.stdout:ceph noarch packages 36 kB/s | 24 kB 00:00 2024-09-15T12:15:44.014 INFO:teuthology.orchestra.run.smithi122.stdout:ceph source packages 3.8 kB/s | 2.1 kB 00:00 2024-09-15T12:15:44.714 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-15T12:15:46.198 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 770 B/s | 2.1 kB 00:02 2024-09-15T12:15:47.169 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-15T12:15:50.138 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 2.1 MB/s | 8.2 MB 00:03 2024-09-15T12:15:51.957 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 6.5 MB 00:01 2024-09-15T12:15:53.391 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 19 kB 00:00 2024-09-15T12:15:54.620 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-15T12:15:55.139 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 5.2 MB/s | 20 MB 00:03 2024-09-15T12:16:00.093 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-15T12:16:00.473 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-15T12:16:02.407 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 19 kB 00:00 2024-09-15T12:16:02.452 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:16:02.484 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:16:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-15T12:16:02.485 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:16:02.485 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:16:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-15T12:16:02.485 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrading: 2024-09-15T12:16:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-15T12:16:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-15T12:16:02.485 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-15T12:16:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T12:16:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-15T12:16:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-15T12:16:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-15T12:16:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T12:16:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T12:16:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T12:16:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-15T12:16:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-15T12:16:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T12:16:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T12:16:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T12:16:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-15T12:16:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T12:16:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-15T12:16:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T12:16:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T12:16:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T12:16:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-15T12:16:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-15T12:16:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-15T12:16:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T12:16:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-15T12:16:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-15T12:16:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-15T12:16:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T12:16:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T12:16:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T12:16:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T12:16:02.488 INFO:teuthology.orchestra.run.smithi122.stdout:Installing weak dependencies: 2024-09-15T12:16:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T12:16:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:16:02.488 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:16:02.488 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:16:02.488 INFO:teuthology.orchestra.run.smithi122.stdout:Install 31 Packages 2024-09-15T12:16:02.488 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrade 2 Packages 2024-09-15T12:16:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:16:02.489 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 60 M 2024-09-15T12:16:02.489 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:16:03.297 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-15T12:16:06.920 INFO:teuthology.orchestra.run.smithi122.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 1.5 MB/s | 6.1 MB 00:03 2024-09-15T12:16:07.019 INFO:teuthology.orchestra.run.smithi122.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 251 kB/s | 25 kB 00:00 2024-09-15T12:16:07.562 INFO:teuthology.orchestra.run.smithi122.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 1.5 MB/s | 809 kB 00:00 2024-09-15T12:16:07.903 INFO:teuthology.orchestra.run.smithi122.stdout:(4/33): libradosstriper1-19.3.0-4879.g81fedcb3. 1.6 MB/s | 558 kB 00:00 2024-09-15T12:16:08.617 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-15T12:16:10.895 INFO:teuthology.orchestra.run.smithi122.stdout:(5/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_6 1.8 MB/s | 5.4 MB 00:02 2024-09-15T12:16:10.976 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:16:10.979 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:16:10.979 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-15T12:16:10.979 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:16:10.979 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:16:10.979 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-15T12:16:10.979 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-09-15T12:16:10.980 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-15T12:16:10.980 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-15T12:16:10.980 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-15T12:16:10.980 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T12:16:10.980 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-15T12:16:10.980 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-15T12:16:10.980 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-15T12:16:10.980 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T12:16:10.980 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T12:16:10.980 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T12:16:10.980 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-15T12:16:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-15T12:16:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T12:16:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T12:16:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T12:16:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-15T12:16:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T12:16:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-15T12:16:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T12:16:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T12:16:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T12:16:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-15T12:16:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-15T12:16:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-15T12:16:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T12:16:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-15T12:16:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-15T12:16:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-15T12:16:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T12:16:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T12:16:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T12:16:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T12:16:10.982 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-09-15T12:16:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T12:16:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:16:10.982 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:16:10.983 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:16:10.983 INFO:teuthology.orchestra.run.smithi142.stdout:Install 31 Packages 2024-09-15T12:16:10.983 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 2 Packages 2024-09-15T12:16:10.983 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:16:10.983 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 60 M 2024-09-15T12:16:10.983 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:16:10.995 INFO:teuthology.orchestra.run.smithi122.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 452 kB/s | 45 kB 00:00 2024-09-15T12:16:11.104 INFO:teuthology.orchestra.run.smithi122.stdout:(7/33): python3-ceph-common-19.3.0-4879.g81fedc 1.3 MB/s | 143 kB 00:00 2024-09-15T12:16:11.287 INFO:teuthology.orchestra.run.smithi122.stdout:(8/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 871 kB/s | 160 kB 00:00 2024-09-15T12:16:11.413 INFO:teuthology.orchestra.run.smithi122.stdout:(9/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 1.2 MB/s | 10 MB 00:08 2024-09-15T12:16:11.580 INFO:teuthology.orchestra.run.smithi122.stdout:(10/33): python3-rados-19.3.0-4879.g81fedcb3.el 1.1 MB/s | 315 kB 00:00 2024-09-15T12:16:11.688 INFO:teuthology.orchestra.run.smithi122.stdout:(11/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 920 kB/s | 99 kB 00:00 2024-09-15T12:16:11.763 INFO:teuthology.orchestra.run.smithi122.stdout:(12/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 861 kB/s | 302 kB 00:00 2024-09-15T12:16:11.805 INFO:teuthology.orchestra.run.smithi122.stdout:(13/33): boost-program-options-1.75.0-8.el9.x86 917 kB/s | 107 kB 00:00 2024-09-15T12:16:11.864 INFO:teuthology.orchestra.run.smithi122.stdout:(14/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-15T12:16:11.889 INFO:teuthology.orchestra.run.smithi122.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.3 MB/s | 171 kB 00:00 2024-09-15T12:16:11.923 INFO:teuthology.orchestra.run.smithi122.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 772 kB/s | 45 kB 00:00 2024-09-15T12:16:11.981 INFO:teuthology.orchestra.run.smithi122.stdout:(17/33): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-15T12:16:12.007 INFO:teuthology.orchestra.run.smithi122.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-15T12:16:12.032 INFO:teuthology.orchestra.run.smithi122.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 843 kB/s | 42 kB 00:00 2024-09-15T12:16:12.057 INFO:teuthology.orchestra.run.smithi122.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-15T12:16:12.083 INFO:teuthology.orchestra.run.smithi122.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 714 kB/s | 36 kB 00:00 2024-09-15T12:16:12.108 INFO:teuthology.orchestra.run.smithi122.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-15T12:16:12.158 INFO:teuthology.orchestra.run.smithi122.stdout:(23/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.0 MB/s | 308 kB 00:00 2024-09-15T12:16:12.183 INFO:teuthology.orchestra.run.smithi122.stdout:(24/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-15T12:16:12.209 INFO:teuthology.orchestra.run.smithi122.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-15T12:16:12.225 INFO:teuthology.orchestra.run.smithi122.stdout:(26/33): libunwind-1.6.2-1.el9.x86_64.rpm 4.0 MB/s | 67 kB 00:00 2024-09-15T12:16:12.276 INFO:teuthology.orchestra.run.smithi122.stdout:(27/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-15T12:16:12.310 INFO:teuthology.orchestra.run.smithi122.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-15T12:16:12.385 INFO:teuthology.orchestra.run.smithi122.stdout:(29/33): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-15T12:16:12.435 INFO:teuthology.orchestra.run.smithi122.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-15T12:16:12.835 INFO:teuthology.orchestra.run.smithi142.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 3.7 MB/s | 6.1 MB 00:01 2024-09-15T12:16:12.935 INFO:teuthology.orchestra.run.smithi142.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 251 kB/s | 25 kB 00:00 2024-09-15T12:16:13.111 INFO:teuthology.orchestra.run.smithi142.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 4.5 MB/s | 809 kB 00:00 2024-09-15T12:16:13.211 INFO:teuthology.orchestra.run.smithi142.stdout:(4/33): libradosstriper1-19.3.0-4879.g81fedcb3. 5.5 MB/s | 558 kB 00:00 2024-09-15T12:16:14.061 INFO:teuthology.orchestra.run.smithi142.stdout:(5/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_6 6.3 MB/s | 5.4 MB 00:00 2024-09-15T12:16:14.161 INFO:teuthology.orchestra.run.smithi142.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 451 kB/s | 45 kB 00:00 2024-09-15T12:16:14.253 INFO:teuthology.orchestra.run.smithi142.stdout:(7/33): python3-ceph-common-19.3.0-4879.g81fedc 1.5 MB/s | 143 kB 00:00 2024-09-15T12:16:14.353 INFO:teuthology.orchestra.run.smithi142.stdout:(8/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 1.6 MB/s | 160 kB 00:00 2024-09-15T12:16:14.470 INFO:teuthology.orchestra.run.smithi142.stdout:(9/33): python3-rados-19.3.0-4879.g81fedcb3.el9 2.6 MB/s | 315 kB 00:00 2024-09-15T12:16:14.587 INFO:teuthology.orchestra.run.smithi142.stdout:(10/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 2.5 MB/s | 302 kB 00:00 2024-09-15T12:16:14.687 INFO:teuthology.orchestra.run.smithi142.stdout:(11/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 995 kB/s | 99 kB 00:00 2024-09-15T12:16:15.154 INFO:teuthology.orchestra.run.smithi142.stdout:(12/33): boost-program-options-1.75.0-8.el9.x86 229 kB/s | 107 kB 00:00 2024-09-15T12:16:15.355 INFO:teuthology.orchestra.run.smithi142.stdout:(13/33): libnbd-1.20.2-2.el9.x86_64.rpm 853 kB/s | 171 kB 00:00 2024-09-15T12:16:15.488 INFO:teuthology.orchestra.run.smithi142.stdout:(14/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-15T12:16:15.638 INFO:teuthology.orchestra.run.smithi142.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 301 kB/s | 45 kB 00:00 2024-09-15T12:16:15.855 INFO:teuthology.orchestra.run.smithi142.stdout:(16/33): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-15T12:16:15.989 INFO:teuthology.orchestra.run.smithi142.stdout:(17/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-15T12:16:16.097 INFO:teuthology.orchestra.run.smithi142.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 390 kB/s | 42 kB 00:00 2024-09-15T12:16:16.365 INFO:teuthology.orchestra.run.smithi142.stdout:(19/33): ceph-common-19.3.0-4879.g81fedcb3.el9. 3.8 MB/s | 20 MB 00:05 2024-09-15T12:16:16.393 INFO:teuthology.orchestra.run.smithi142.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 747 kB/s | 221 kB 00:00 2024-09-15T12:16:16.498 INFO:teuthology.orchestra.run.smithi142.stdout:(21/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 452 kB/s | 47 kB 00:00 2024-09-15T12:16:16.549 INFO:teuthology.orchestra.run.smithi142.stdout:(22/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 6.0 MB/s | 308 kB 00:00 2024-09-15T12:16:16.641 INFO:teuthology.orchestra.run.smithi142.stdout:(23/33): qatlib-service-24.02.0-1.el9.x86_64.rp 130 kB/s | 36 kB 00:00 2024-09-15T12:16:16.682 INFO:teuthology.orchestra.run.smithi142.stdout:(24/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 626 kB/s | 26 kB 00:00 2024-09-15T12:16:16.741 INFO:teuthology.orchestra.run.smithi142.stdout:(25/33): libarrow-9.0.0-11.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-15T12:16:16.758 INFO:teuthology.orchestra.run.smithi142.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 647 kB/s | 49 kB 00:00 2024-09-15T12:16:16.783 INFO:teuthology.orchestra.run.smithi142.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-15T12:16:16.809 INFO:teuthology.orchestra.run.smithi142.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-15T12:16:16.851 INFO:teuthology.orchestra.run.smithi142.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-15T12:16:16.884 INFO:teuthology.orchestra.run.smithi142.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-15T12:16:17.852 INFO:teuthology.orchestra.run.smithi122.stdout:(31/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 649 kB/s | 3.5 MB 00:05 2024-09-15T12:16:18.602 INFO:teuthology.orchestra.run.smithi122.stdout:(32/33): ceph-common-19.3.0-4879.g81fedcb3.el9. 1.3 MB/s | 20 MB 00:15 2024-09-15T12:16:18.901 INFO:teuthology.orchestra.run.smithi142.stdout:(31/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 1.7 MB/s | 3.5 MB 00:02 2024-09-15T12:16:19.110 INFO:teuthology.orchestra.run.smithi122.stdout:(33/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 582 kB/s | 3.8 MB 00:06 2024-09-15T12:16:19.115 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:19.116 INFO:teuthology.orchestra.run.smithi122.stdout:Total 3.6 MB/s | 60 MB 00:16 2024-09-15T12:16:19.227 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:16:19.263 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:16:19.263 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:16:19.501 INFO:teuthology.orchestra.run.smithi142.stdout:(32/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 1.4 MB/s | 3.8 MB 00:02 2024-09-15T12:16:19.933 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:16:19.933 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:16:21.421 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:16:21.938 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-15T12:16:21.996 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:16:22.088 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:16:22.177 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-15T12:16:22.197 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:16:22.260 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:16:22.306 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-15T12:16:22.352 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-15T12:16:22.378 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-15T12:16:22.400 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-15T12:16:22.436 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-15T12:16:22.586 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-15T12:16:22.616 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-15T12:16:22.652 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-15T12:16:22.696 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-15T12:16:22.725 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-15T12:16:22.814 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-15T12:16:22.838 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-15T12:16:22.926 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-15T12:16:22.962 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-15T12:16:23.074 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-15T12:16:23.109 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-15T12:16:23.157 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-15T12:16:23.187 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-15T12:16:23.216 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-15T12:16:23.252 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-15T12:16:23.629 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-15T12:16:23.678 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-15T12:16:23.752 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-15T12:16:23.783 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-15T12:16:23.828 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-15T12:16:24.413 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-15T12:16:24.447 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-15T12:16:24.519 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-15T12:16:24.596 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-15T12:16:24.625 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-15T12:16:27.274 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:16:27.305 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:16:27.990 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:16:28.025 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-15T12:16:28.116 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-15T12:16:28.116 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T12:16:28.116 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T12:16:28.116 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:16:28.151 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:16:28.909 INFO:teuthology.orchestra.run.smithi142.stdout:(33/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9 600 kB/s | 10 MB 00:17 2024-09-15T12:16:28.915 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:28.915 INFO:teuthology.orchestra.run.smithi142.stdout:Total 3.4 MB/s | 60 MB 00:17 2024-09-15T12:16:29.024 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:16:29.062 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:16:29.062 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:16:29.727 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:16:29.728 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:16:31.242 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:16:31.753 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-15T12:16:31.945 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:16:32.044 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:16:32.142 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-15T12:16:32.179 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:16:32.242 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:16:32.295 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-15T12:16:32.325 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-15T12:16:32.350 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-15T12:16:32.373 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-15T12:16:32.393 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-15T12:16:32.549 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-15T12:16:32.581 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-15T12:16:32.616 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-15T12:16:32.659 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-15T12:16:32.688 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-15T12:16:32.767 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-15T12:16:32.794 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-15T12:16:32.882 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-15T12:16:32.918 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-15T12:16:33.027 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-15T12:16:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-15T12:16:33.111 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-15T12:16:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-15T12:16:33.171 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-15T12:16:33.211 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-15T12:16:33.574 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-15T12:16:33.645 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-15T12:16:33.719 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-15T12:16:33.750 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-15T12:16:33.785 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-15T12:16:34.368 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-15T12:16:34.405 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-15T12:16:34.477 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-15T12:16:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-15T12:16:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-15T12:16:37.062 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:16:37.104 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:16:37.817 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:16:37.866 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-15T12:16:37.977 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-15T12:16:37.977 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T12:16:37.977 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T12:16:37.977 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:16:38.017 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:16:38.258 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:16:38.258 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /sys 2024-09-15T12:16:38.258 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /proc 2024-09-15T12:16:38.258 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /mnt 2024-09-15T12:16:38.258 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /var/tmp 2024-09-15T12:16:38.258 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /home 2024-09-15T12:16:38.259 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /root 2024-09-15T12:16:38.259 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /tmp 2024-09-15T12:16:38.259 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:16:39.387 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-15T12:16:39.411 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-15T12:16:39.411 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:16:39.411 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T12:16:39.411 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T12:16:39.411 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T12:16:39.412 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:16:39.413 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-15T12:16:39.497 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-15T12:16:39.498 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:16:40.763 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:16:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-15T12:16:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:16:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-15T12:16:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:16:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-15T12:16:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-15T12:16:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-15T12:16:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-15T12:16:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-15T12:16:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-15T12:16:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-15T12:16:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-15T12:16:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-15T12:16:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-15T12:16:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-15T12:16:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-15T12:16:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-15T12:16:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-15T12:16:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-15T12:16:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-15T12:16:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-15T12:16:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-15T12:16:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-15T12:16:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-15T12:16:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-15T12:16:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-15T12:16:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-15T12:16:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-15T12:16:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-15T12:16:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-15T12:16:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-15T12:16:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:16:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-15T12:16:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-15T12:16:41.704 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:16:41.704 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:16:41.704 INFO:teuthology.orchestra.run.smithi122.stdout:Upgraded: 2024-09-15T12:16:41.704 INFO:teuthology.orchestra.run.smithi122.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:41.704 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:41.704 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:16:41.704 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T12:16:41.705 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:41.705 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:41.705 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:41.705 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:41.705 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T12:16:41.705 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T12:16:41.705 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T12:16:41.705 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:41.705 INFO:teuthology.orchestra.run.smithi122.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-15T12:16:41.705 INFO:teuthology.orchestra.run.smithi122.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T12:16:41.705 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T12:16:41.705 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T12:16:41.705 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:41.706 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T12:16:41.706 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:41.706 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T12:16:41.706 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T12:16:41.706 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T12:16:41.706 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:41.706 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:41.706 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:41.706 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T12:16:41.706 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:41.706 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:41.706 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:41.707 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T12:16:41.707 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T12:16:41.707 INFO:teuthology.orchestra.run.smithi122.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T12:16:41.707 INFO:teuthology.orchestra.run.smithi122.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T12:16:41.707 INFO:teuthology.orchestra.run.smithi122.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T12:16:41.707 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:16:41.707 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:16:42.109 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-test 2024-09-15T12:16:42.674 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:00:42 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:16:42.816 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:16:42.817 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:16:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-15T12:16:42.817 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:16:42.817 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:16:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-15T12:16:42.817 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-15T12:16:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-15T12:16:42.817 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-15T12:16:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-15T12:16:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-15T12:16:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T12:16:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T12:16:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T12:16:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-15T12:16:42.818 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:16:42.819 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:16:42.819 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:16:42.819 INFO:teuthology.orchestra.run.smithi122.stdout:Install 9 Packages 2024-09-15T12:16:42.819 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:16:42.820 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 87 M 2024-09-15T12:16:42.820 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 797 M 2024-09-15T12:16:42.820 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:16:43.795 INFO:teuthology.orchestra.run.smithi122.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 138 kB/s | 94 kB 00:00 2024-09-15T12:16:43.978 INFO:teuthology.orchestra.run.smithi122.stdout:(2/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 202 kB/s | 175 kB 00:00 2024-09-15T12:16:44.004 INFO:teuthology.orchestra.run.smithi122.stdout:(3/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 2.4 MB/s | 513 kB 00:00 2024-09-15T12:16:44.112 INFO:teuthology.orchestra.run.smithi122.stdout:(4/9): libubsan-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 183 kB 00:00 2024-09-15T12:16:44.187 INFO:teuthology.orchestra.run.smithi122.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 4.0 MB/s | 304 kB 00:00 2024-09-15T12:16:44.229 INFO:teuthology.orchestra.run.smithi122.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-15T12:16:44.263 INFO:teuthology.orchestra.run.smithi122.stdout:(7/9): protobuf-3.14.0-13.el9.x86_64.rpm 3.9 MB/s | 1.0 MB 00:00 2024-09-15T12:16:44.305 INFO:teuthology.orchestra.run.smithi122.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.6 MB/s | 122 kB 00:00 2024-09-15T12:16:47.979 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:16:47.979 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-09-15T12:16:47.979 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-09-15T12:16:47.979 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-09-15T12:16:47.979 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-09-15T12:16:47.979 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-09-15T12:16:47.979 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-09-15T12:16:47.979 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-09-15T12:16:47.980 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:16:49.101 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-15T12:16:49.125 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-15T12:16:49.126 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:16:49.126 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T12:16:49.126 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T12:16:49.126 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T12:16:49.126 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:16:49.127 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-15T12:16:49.220 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-15T12:16:49.220 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:16:50.594 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:16:50.594 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-15T12:16:50.594 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:16:50.594 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-15T12:16:50.595 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:16:50.595 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-15T12:16:50.595 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-15T12:16:50.595 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-15T12:16:50.595 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-15T12:16:50.595 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-15T12:16:50.595 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-15T12:16:50.595 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-15T12:16:50.595 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-15T12:16:50.595 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-15T12:16:50.595 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-15T12:16:50.595 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-15T12:16:50.595 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-15T12:16:50.595 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-15T12:16:50.596 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-15T12:16:50.596 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-15T12:16:50.596 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-15T12:16:50.596 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-15T12:16:50.596 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-15T12:16:50.596 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-15T12:16:50.596 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-15T12:16:50.596 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-15T12:16:50.596 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-15T12:16:50.596 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-15T12:16:50.596 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-15T12:16:50.596 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-15T12:16:50.596 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-15T12:16:50.597 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-15T12:16:50.597 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:16:50.597 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-15T12:16:50.597 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-15T12:16:51.720 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:16:51.720 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:16:51.720 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-09-15T12:16:51.720 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:51.720 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:51.720 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:16:51.721 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T12:16:51.721 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:51.721 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:51.721 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:51.721 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:51.721 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T12:16:51.721 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T12:16:51.721 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T12:16:51.721 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:51.721 INFO:teuthology.orchestra.run.smithi142.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-15T12:16:51.721 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T12:16:51.721 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T12:16:51.721 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T12:16:51.722 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:51.722 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T12:16:51.722 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:51.722 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T12:16:51.722 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T12:16:51.722 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T12:16:51.722 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:51.722 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:51.722 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:51.722 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T12:16:51.722 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:51.722 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:51.722 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:51.723 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T12:16:51.723 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T12:16:51.723 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T12:16:51.723 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T12:16:51.723 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T12:16:51.723 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:16:51.723 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:16:52.068 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-test 2024-09-15T12:16:52.644 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:44 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:16:52.777 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:16:52.778 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:16:52.778 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-15T12:16:52.778 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:16:52.778 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:16:52.778 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-15T12:16:52.778 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-15T12:16:52.778 INFO:teuthology.orchestra.run.smithi142.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-15T12:16:52.778 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-15T12:16:52.778 INFO:teuthology.orchestra.run.smithi142.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-15T12:16:52.778 INFO:teuthology.orchestra.run.smithi142.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-15T12:16:52.778 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T12:16:52.779 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T12:16:52.779 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T12:16:52.779 INFO:teuthology.orchestra.run.smithi142.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-15T12:16:52.779 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:16:52.779 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:16:52.779 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:16:52.779 INFO:teuthology.orchestra.run.smithi142.stdout:Install 9 Packages 2024-09-15T12:16:52.779 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:16:52.780 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 87 M 2024-09-15T12:16:52.780 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 797 M 2024-09-15T12:16:52.780 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:16:53.533 INFO:teuthology.orchestra.run.smithi142.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 540 kB/s | 94 kB 00:00 2024-09-15T12:16:53.808 INFO:teuthology.orchestra.run.smithi142.stdout:(2/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 1.8 MB/s | 513 kB 00:00 2024-09-15T12:16:53.875 INFO:teuthology.orchestra.run.smithi142.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 183 kB 00:00 2024-09-15T12:16:54.001 INFO:teuthology.orchestra.run.smithi142.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-15T12:16:54.059 INFO:teuthology.orchestra.run.smithi142.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-15T12:16:54.110 INFO:teuthology.orchestra.run.smithi142.stdout:(6/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 233 kB/s | 175 kB 00:00 2024-09-15T12:16:54.135 INFO:teuthology.orchestra.run.smithi142.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 847 kB/s | 64 kB 00:00 2024-09-15T12:16:54.185 INFO:teuthology.orchestra.run.smithi142.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.6 MB/s | 122 kB 00:00 2024-09-15T12:18:06.498 INFO:teuthology.orchestra.run.smithi122.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 1.0 MB/s | 85 MB 01:23 2024-09-15T12:18:06.500 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:18:06.500 INFO:teuthology.orchestra.run.smithi122.stdout:Total 1.0 MB/s | 87 MB 01:23 2024-09-15T12:18:06.569 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:18:06.590 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:18:06.591 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:18:07.218 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:18:07.219 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:18:08.100 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:18:08.188 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-15T12:18:08.242 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-15T12:18:08.285 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-15T12:18:08.337 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-15T12:18:08.368 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-15T12:18:08.392 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-15T12:18:08.469 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-15T12:18:08.509 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-15T12:18:08.536 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-15T12:18:19.652 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-15T12:18:19.726 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-15T12:18:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-15T12:18:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-15T12:18:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-15T12:18:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-15T12:18:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-15T12:18:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-15T12:18:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-15T12:18:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-15T12:18:26.029 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-15T12:18:26.440 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-15T12:18:26.440 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:18:26.440 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:18:26.440 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:18:26.440 INFO:teuthology.orchestra.run.smithi122.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-15T12:18:26.440 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:18:26.440 INFO:teuthology.orchestra.run.smithi122.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-15T12:18:26.441 INFO:teuthology.orchestra.run.smithi122.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-15T12:18:26.441 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T12:18:26.441 INFO:teuthology.orchestra.run.smithi122.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T12:18:26.441 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T12:18:26.441 INFO:teuthology.orchestra.run.smithi122.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-15T12:18:26.441 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:18:26.441 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:18:26.812 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph 2024-09-15T12:18:27.372 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:02:27 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:18:27.515 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:18:27.518 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:18:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-15T12:18:27.518 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:18:27.518 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:18:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-15T12:18:27.518 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-15T12:18:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-15T12:18:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-15T12:18:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-15T12:18:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-15T12:18:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-15T12:18:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T12:18:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T12:18:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T12:18:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T12:18:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T12:18:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T12:18:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T12:18:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T12:18:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T12:18:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T12:18:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections 2024-09-15T12:18:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-15T12:18:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T12:18:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T12:18:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T12:18:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T12:18:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T12:18:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T12:18:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T12:18:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T12:18:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T12:18:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T12:18:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T12:18:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T12:18:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T12:18:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T12:18:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T12:18:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T12:18:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T12:18:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T12:18:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T12:18:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T12:18:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:18:27.521 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:18:27.522 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:18:27.522 INFO:teuthology.orchestra.run.smithi122.stdout:Install 37 Packages 2024-09-15T12:18:27.522 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:18:27.522 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 84 M 2024-09-15T12:18:27.522 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 897 M 2024-09-15T12:18:27.522 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:18:28.232 INFO:teuthology.orchestra.run.smithi122.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 21 kB/s | 6.5 kB 00:00 2024-09-15T12:18:29.731 INFO:teuthology.orchestra.run.smithi122.stdout:(2/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 897 kB/s | 1.6 MB 00:01 2024-09-15T12:18:29.957 INFO:teuthology.orchestra.run.smithi122.stdout:(3/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 1.1 MB/s | 2.2 MB 00:02 2024-09-15T12:18:30.149 INFO:teuthology.orchestra.run.smithi122.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 1.5 MB/s | 291 kB 00:00 2024-09-15T12:18:30.274 INFO:teuthology.orchestra.run.smithi122.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-15T12:18:30.391 INFO:teuthology.orchestra.run.smithi122.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 11 MB/s | 1.2 MB 00:00 2024-09-15T12:18:30.458 INFO:teuthology.orchestra.run.smithi122.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-15T12:18:30.533 INFO:teuthology.orchestra.run.smithi122.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.8 MB/s | 135 kB 00:00 2024-09-15T12:18:30.608 INFO:teuthology.orchestra.run.smithi122.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.6 MB/s | 125 kB 00:00 2024-09-15T12:18:30.708 INFO:teuthology.orchestra.run.smithi122.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.1 MB/s | 215 kB 00:00 2024-09-15T12:18:30.901 INFO:teuthology.orchestra.run.smithi122.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 984 kB/s | 188 kB 00:00 2024-09-15T12:18:30.984 INFO:teuthology.orchestra.run.smithi122.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-15T12:18:31.034 INFO:teuthology.orchestra.run.smithi122.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 694 kB/s | 35 kB 00:00 2024-09-15T12:18:31.085 INFO:teuthology.orchestra.run.smithi122.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-15T12:18:31.135 INFO:teuthology.orchestra.run.smithi122.stdout:(15/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-15T12:18:31.185 INFO:teuthology.orchestra.run.smithi122.stdout:(16/37): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-09-15T12:18:31.477 INFO:teuthology.orchestra.run.smithi122.stdout:(17/37): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-09-15T12:18:31.519 INFO:teuthology.orchestra.run.smithi122.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-15T12:18:31.594 INFO:teuthology.orchestra.run.smithi122.stdout:(19/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86 1.5 MB/s | 5.1 MB 00:03 2024-09-15T12:18:31.619 INFO:teuthology.orchestra.run.smithi122.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 434 kB/s | 43 kB 00:00 2024-09-15T12:18:31.653 INFO:teuthology.orchestra.run.smithi122.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 14 MB/s | 358 kB 00:00 2024-09-15T12:18:31.678 INFO:teuthology.orchestra.run.smithi122.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 460 kB/s | 11 kB 00:00 2024-09-15T12:18:31.703 INFO:teuthology.orchestra.run.smithi122.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 713 kB/s | 18 kB 00:00 2024-09-15T12:18:31.737 INFO:teuthology.orchestra.run.smithi122.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 691 kB/s | 23 kB 00:00 2024-09-15T12:18:31.763 INFO:teuthology.orchestra.run.smithi122.stdout:(25/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-15T12:18:31.788 INFO:teuthology.orchestra.run.smithi122.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-15T12:18:31.813 INFO:teuthology.orchestra.run.smithi122.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-15T12:18:31.838 INFO:teuthology.orchestra.run.smithi122.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-09-15T12:18:31.864 INFO:teuthology.orchestra.run.smithi122.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-15T12:18:31.889 INFO:teuthology.orchestra.run.smithi122.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 660 kB/s | 16 kB 00:00 2024-09-15T12:18:31.914 INFO:teuthology.orchestra.run.smithi122.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-15T12:18:31.940 INFO:teuthology.orchestra.run.smithi122.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-15T12:18:31.957 INFO:teuthology.orchestra.run.smithi122.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 855 kB/s | 36 kB 00:00 2024-09-15T12:18:31.990 INFO:teuthology.orchestra.run.smithi122.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-15T12:18:32.007 INFO:teuthology.orchestra.run.smithi122.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-15T12:18:32.041 INFO:teuthology.orchestra.run.smithi122.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-15T12:19:30.311 INFO:teuthology.orchestra.run.smithi122.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 1.2 MB/s | 70 MB 01:00 2024-09-15T12:19:30.315 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:19:30.315 INFO:teuthology.orchestra.run.smithi122.stdout:Total 1.3 MB/s | 84 MB 01:02 2024-09-15T12:19:30.467 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:19:30.508 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:19:30.508 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:19:31.304 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:19:31.304 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:19:32.998 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:19:33.063 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-15T12:19:33.096 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-15T12:19:33.123 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-15T12:19:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-15T12:19:33.231 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-15T12:19:33.265 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-15T12:19:33.357 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-15T12:19:33.443 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-15T12:19:33.493 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-15T12:19:33.528 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-15T12:19:33.557 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-15T12:19:33.592 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-15T12:19:33.625 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-15T12:19:33.674 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-15T12:19:33.709 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-15T12:19:33.744 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-15T12:19:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-15T12:19:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-15T12:19:33.905 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-15T12:19:34.043 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-15T12:19:34.124 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-15T12:19:34.177 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-15T12:19:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-15T12:19:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-15T12:19:34.328 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-15T12:19:34.520 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-15T12:19:34.569 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-15T12:19:34.639 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-15T12:19:34.727 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-15T12:19:34.778 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-15T12:19:34.905 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-15T12:19:35.097 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-15T12:19:35.129 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-15T12:19:35.155 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-15T12:19:35.155 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:19:35.155 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T12:19:35.155 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T12:19:35.156 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T12:19:35.156 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:19:42.186 INFO:teuthology.orchestra.run.smithi142.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 513 kB/s | 85 MB 02:48 2024-09-15T12:19:42.189 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:19:42.189 INFO:teuthology.orchestra.run.smithi142.stdout:Total 526 kB/s | 87 MB 02:49 2024-09-15T12:19:42.258 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:19:42.281 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:19:42.281 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:19:42.899 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:19:42.899 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:19:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:19:43.890 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-15T12:19:43.947 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-15T12:19:43.999 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-15T12:19:44.025 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-15T12:19:44.057 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-15T12:19:44.089 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-15T12:19:44.149 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-15T12:19:44.199 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-15T12:19:44.233 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-15T12:19:45.679 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-15T12:19:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-15T12:19:45.707 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:19:45.707 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T12:19:45.707 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T12:19:45.707 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T12:19:45.707 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:19:46.257 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-15T12:19:46.281 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-15T12:19:46.281 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:19:46.281 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T12:19:46.282 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T12:19:46.282 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T12:19:46.282 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:19:46.516 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-15T12:19:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-15T12:19:46.540 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:19:46.540 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T12:19:46.540 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T12:19:46.540 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T12:19:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:19:46.608 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-15T12:19:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-15T12:19:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-15T12:19:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-15T12:19:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-15T12:19:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-15T12:19:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-15T12:19:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-15T12:19:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-15T12:19:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-15T12:19:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-15T12:19:53.428 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-15T12:19:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-15T12:19:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-15T12:19:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-15T12:19:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-15T12:19:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-15T12:19:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-15T12:19:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-15T12:19:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-15T12:19:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-15T12:19:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-15T12:19:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-15T12:19:53.429 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-15T12:19:53.430 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-15T12:19:53.430 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-15T12:19:53.430 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-15T12:19:53.430 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-15T12:19:53.430 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-15T12:19:53.431 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-15T12:19:53.431 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-15T12:19:53.431 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-15T12:19:53.431 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-15T12:19:53.431 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-15T12:19:53.431 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-15T12:19:53.431 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-15T12:19:53.431 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-15T12:19:53.431 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-15T12:19:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-15T12:19:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:19:54.370 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:19:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:19:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:19:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:19:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:19:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:19:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:19:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T12:19:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T12:19:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T12:19:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T12:19:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T12:19:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T12:19:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T12:19:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T12:19:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T12:19:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T12:19:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T12:19:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T12:19:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T12:19:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T12:19:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T12:19:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T12:19:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T12:19:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T12:19:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T12:19:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T12:19:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T12:19:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T12:19:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T12:19:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T12:19:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T12:19:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T12:19:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T12:19:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T12:19:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T12:19:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T12:19:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T12:19:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:19:54.373 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:19:54.644 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-base 2024-09-15T12:19:55.203 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:03:55 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:19:55.293 INFO:teuthology.orchestra.run.smithi122.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:19:55.335 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:19:55.335 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-15T12:19:55.336 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:19:55.422 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install cephadm 2024-09-15T12:19:55.717 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-15T12:19:55.793 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-15T12:19:55.986 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:03:55 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:19:56.121 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:19:56.121 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:19:56.121 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-15T12:19:56.122 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:19:56.122 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:19:56.122 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-15T12:19:56.122 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:19:56.122 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:19:56.122 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:19:56.122 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-15T12:19:56.122 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:19:56.122 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 785 k 2024-09-15T12:19:56.122 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 791 k 2024-09-15T12:19:56.122 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:19:56.548 INFO:teuthology.orchestra.run.smithi122.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 1.8 MB/s | 785 kB 00:00 2024-09-15T12:19:56.549 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:19:56.549 INFO:teuthology.orchestra.run.smithi122.stdout:Total 1.8 MB/s | 785 kB 00:00 2024-09-15T12:19:56.549 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:19:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:19:56.555 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:19:56.561 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:19:56.561 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:19:56.636 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:19:57.078 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:19:57.169 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:19:57.520 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:19:57.790 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:19:57.790 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:19:57.790 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:19:57.790 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:19:57.790 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:19:57.790 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:19:58.004 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-immutable-object-cache 2024-09-15T12:19:58.588 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:03:58 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:19:58.718 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:19:58.718 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:19:58.718 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repo Size 2024-09-15T12:19:58.718 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:19:58.718 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:19:58.718 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-15T12:19:58.719 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:19:58.719 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:19:58.719 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:19:58.719 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-15T12:19:58.719 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:19:58.719 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 158 k 2024-09-15T12:19:58.720 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 644 k 2024-09-15T12:19:58.720 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:19:58.937 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 726 kB/s | 158 kB 00:00 2024-09-15T12:19:58.938 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:19:58.938 INFO:teuthology.orchestra.run.smithi122.stdout:Total 721 kB/s | 158 kB 00:00 2024-09-15T12:19:58.938 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:19:58.947 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:19:58.947 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:19:59.004 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:19:59.005 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:19:59.155 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:19:59.221 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:19:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:19:59.246 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:19:59.246 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T12:19:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:00.137 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:20:00.137 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:00.137 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:20:00.137 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:20:00.137 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:00.137 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:00.348 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr 2024-09-15T12:20:00.919 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:00 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:01.009 INFO:teuthology.orchestra.run.smithi122.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:20:01.052 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:01.052 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-15T12:20:01.053 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:01.123 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr-dashboard 2024-09-15T12:20:01.681 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:01 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:01.815 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:01.816 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:01.816 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-15T12:20:01.816 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:01.816 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:20:01.816 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-15T12:20:01.816 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-15T12:20:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T12:20:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-15T12:20:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-15T12:20:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T12:20:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T12:20:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T12:20:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T12:20:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T12:20:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T12:20:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T12:20:01.817 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:01.817 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:20:01.817 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:01.817 INFO:teuthology.orchestra.run.smithi122.stdout:Install 11 Packages 2024-09-15T12:20:01.818 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:01.818 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 18 M 2024-09-15T12:20:01.818 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 155 M 2024-09-15T12:20:01.818 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:20:01.905 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-15T12:20:01.905 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-15T12:20:01.905 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-15T12:20:01.905 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-15T12:20:01.905 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-15T12:20:01.905 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-15T12:20:01.906 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-15T12:20:01.906 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-15T12:20:01.906 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-15T12:20:02.314 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-15T12:20:02.314 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:02.315 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:20:02.315 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:20:02.315 INFO:teuthology.orchestra.run.smithi142.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-15T12:20:02.315 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:20:02.315 INFO:teuthology.orchestra.run.smithi142.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-15T12:20:02.315 INFO:teuthology.orchestra.run.smithi142.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-15T12:20:02.315 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T12:20:02.315 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T12:20:02.315 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T12:20:02.315 INFO:teuthology.orchestra.run.smithi142.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-15T12:20:02.315 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:02.315 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:20:02.357 INFO:teuthology.orchestra.run.smithi122.stdout:(1/11): ceph-prometheus-alerts-19.3.0-4879.g81f 101 kB/s | 16 kB 00:00 2024-09-15T12:20:02.383 INFO:teuthology.orchestra.run.smithi122.stdout:(2/11): ceph-grafana-dashboards-19.3.0-4879.g81 182 kB/s | 34 kB 00:00 2024-09-15T12:20:02.550 INFO:teuthology.orchestra.run.smithi122.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.4 MB/s | 269 kB 00:00 2024-09-15T12:20:02.600 INFO:teuthology.orchestra.run.smithi122.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-15T12:20:02.625 INFO:teuthology.orchestra.run.smithi122.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 776 kB/s | 19 kB 00:00 2024-09-15T12:20:02.645 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph 2024-09-15T12:20:02.692 INFO:teuthology.orchestra.run.smithi122.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-15T12:20:02.718 INFO:teuthology.orchestra.run.smithi122.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.6 MB/s | 144 kB 00:00 2024-09-15T12:20:02.743 INFO:teuthology.orchestra.run.smithi122.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-15T12:20:02.768 INFO:teuthology.orchestra.run.smithi122.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 7.5 MB/s | 188 kB 00:00 2024-09-15T12:20:03.127 INFO:teuthology.orchestra.run.smithi122.stdout:(10/11): protobuf-compiler-3.14.0-13.el9.x86_64 1.1 MB/s | 863 kB 00:00 2024-09-15T12:20:03.210 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:03:55 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:20:03.346 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:20:03.348 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:20:03.348 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-15T12:20:03.348 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:20:03.348 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:20:03.348 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-15T12:20:03.348 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-15T12:20:03.348 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-15T12:20:03.349 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-15T12:20:03.349 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-15T12:20:03.349 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-15T12:20:03.349 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-15T12:20:03.349 INFO:teuthology.orchestra.run.smithi142.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T12:20:03.349 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T12:20:03.349 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T12:20:03.349 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T12:20:03.349 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T12:20:03.349 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T12:20:03.349 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T12:20:03.349 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T12:20:03.349 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T12:20:03.350 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T12:20:03.350 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections 2024-09-15T12:20:03.350 INFO:teuthology.orchestra.run.smithi142.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-15T12:20:03.350 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T12:20:03.350 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T12:20:03.350 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T12:20:03.350 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T12:20:03.350 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T12:20:03.350 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T12:20:03.350 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T12:20:03.350 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T12:20:03.351 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T12:20:03.351 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T12:20:03.351 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T12:20:03.351 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T12:20:03.351 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T12:20:03.351 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T12:20:03.351 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T12:20:03.351 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T12:20:03.351 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T12:20:03.351 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T12:20:03.351 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T12:20:03.351 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T12:20:03.351 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:03.352 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:20:03.352 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:20:03.352 INFO:teuthology.orchestra.run.smithi142.stdout:Install 37 Packages 2024-09-15T12:20:03.352 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:03.352 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 84 M 2024-09-15T12:20:03.352 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 897 M 2024-09-15T12:20:03.352 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:20:03.525 INFO:teuthology.orchestra.run.smithi122.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 11 MB/s | 14 MB 00:01 2024-09-15T12:20:03.528 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:20:03.528 INFO:teuthology.orchestra.run.smithi122.stdout:Total 11 MB/s | 18 MB 00:01 2024-09-15T12:20:03.559 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:20:03.579 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:20:03.579 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:20:03.849 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:20:03.850 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:20:03.936 INFO:teuthology.orchestra.run.smithi142.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 55 kB/s | 6.5 kB 00:00 2024-09-15T12:20:04.211 INFO:teuthology.orchestra.run.smithi142.stdout:(2/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 5.6 MB/s | 2.2 MB 00:00 2024-09-15T12:20:04.253 INFO:teuthology.orchestra.run.smithi142.stdout:(3/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 3.6 MB/s | 1.6 MB 00:00 2024-09-15T12:20:04.320 INFO:teuthology.orchestra.run.smithi142.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 4.3 MB/s | 291 kB 00:00 2024-09-15T12:20:04.395 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:20:04.475 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-15T12:20:04.487 INFO:teuthology.orchestra.run.smithi142.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-15T12:20:04.513 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-15T12:20:04.613 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-15T12:20:04.629 INFO:teuthology.orchestra.run.smithi142.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 8.7 MB/s | 1.2 MB 00:00 2024-09-15T12:20:04.713 INFO:teuthology.orchestra.run.smithi142.stdout:(7/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86_ 6.6 MB/s | 5.1 MB 00:00 2024-09-15T12:20:04.738 INFO:teuthology.orchestra.run.smithi142.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 982 kB/s | 106 kB 00:00 2024-09-15T12:20:04.741 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-15T12:20:04.800 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-15T12:20:04.822 INFO:teuthology.orchestra.run.smithi142.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.5 MB/s | 125 kB 00:00 2024-09-15T12:20:04.880 INFO:teuthology.orchestra.run.smithi142.stdout:(10/37): python3-pycparser-2.20-6.el9.noarch.rp 807 kB/s | 135 kB 00:00 2024-09-15T12:20:04.885 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-15T12:20:04.906 INFO:teuthology.orchestra.run.smithi142.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-15T12:20:04.936 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-15T12:20:04.964 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-15T12:20:04.996 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-15T12:20:05.081 INFO:teuthology.orchestra.run.smithi142.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 941 kB/s | 188 kB 00:00 2024-09-15T12:20:05.106 INFO:teuthology.orchestra.run.smithi142.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 860 kB/s | 172 kB 00:00 2024-09-15T12:20:05.140 INFO:teuthology.orchestra.run.smithi142.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 594 kB/s | 35 kB 00:00 2024-09-15T12:20:05.165 INFO:teuthology.orchestra.run.smithi142.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.3 MB/s | 77 kB 00:00 2024-09-15T12:20:05.199 INFO:teuthology.orchestra.run.smithi142.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-09-15T12:20:05.224 INFO:teuthology.orchestra.run.smithi142.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 710 kB/s | 42 kB 00:00 2024-09-15T12:20:05.291 INFO:teuthology.orchestra.run.smithi142.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-15T12:20:05.316 INFO:teuthology.orchestra.run.smithi142.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-15T12:20:05.341 INFO:teuthology.orchestra.run.smithi142.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 867 kB/s | 43 kB 00:00 2024-09-15T12:20:05.375 INFO:teuthology.orchestra.run.smithi142.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 13 MB/s | 358 kB 00:00 2024-09-15T12:20:05.400 INFO:teuthology.orchestra.run.smithi142.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 460 kB/s | 11 kB 00:00 2024-09-15T12:20:05.426 INFO:teuthology.orchestra.run.smithi142.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 708 kB/s | 18 kB 00:00 2024-09-15T12:20:05.451 INFO:teuthology.orchestra.run.smithi142.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 927 kB/s | 23 kB 00:00 2024-09-15T12:20:05.484 INFO:teuthology.orchestra.run.smithi142.stdout:(25/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-15T12:20:05.510 INFO:teuthology.orchestra.run.smithi142.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 332 kB/s | 19 kB 00:00 2024-09-15T12:20:05.535 INFO:teuthology.orchestra.run.smithi142.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-15T12:20:05.560 INFO:teuthology.orchestra.run.smithi142.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-09-15T12:20:05.586 INFO:teuthology.orchestra.run.smithi142.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-15T12:20:05.611 INFO:teuthology.orchestra.run.smithi142.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 663 kB/s | 16 kB 00:00 2024-09-15T12:20:05.636 INFO:teuthology.orchestra.run.smithi142.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-09-15T12:20:05.670 INFO:teuthology.orchestra.run.smithi142.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-15T12:20:05.687 INFO:teuthology.orchestra.run.smithi142.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 714 kB/s | 36 kB 00:00 2024-09-15T12:20:05.712 INFO:teuthology.orchestra.run.smithi142.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 5.4 MB/s | 230 kB 00:00 2024-09-15T12:20:05.729 INFO:teuthology.orchestra.run.smithi142.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-15T12:20:05.754 INFO:teuthology.orchestra.run.smithi142.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 6.2 MB/s | 427 kB 00:00 2024-09-15T12:20:07.096 INFO:teuthology.orchestra.run.smithi142.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 24 MB/s | 70 MB 00:02 2024-09-15T12:20:07.100 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:20:07.101 INFO:teuthology.orchestra.run.smithi142.stdout:Total 22 MB/s | 84 MB 00:03 2024-09-15T12:20:07.255 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:20:07.296 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:20:07.296 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:20:08.089 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:20:08.089 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:20:08.210 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-15T12:20:08.268 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-15T12:20:09.768 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:20:09.857 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-15T12:20:09.890 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-15T12:20:09.918 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-15T12:20:09.989 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-15T12:20:10.075 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-15T12:20:10.108 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-15T12:20:10.188 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-15T12:20:10.189 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-15T12:20:10.189 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-15T12:20:10.189 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-15T12:20:10.189 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-15T12:20:10.189 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-15T12:20:10.189 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-15T12:20:10.189 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-15T12:20:10.189 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-15T12:20:10.189 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-15T12:20:10.189 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-15T12:20:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-15T12:20:10.278 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-15T12:20:10.327 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-15T12:20:10.370 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-15T12:20:10.400 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-15T12:20:10.435 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-15T12:20:10.468 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-15T12:20:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-15T12:20:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:10.503 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:20:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T12:20:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:20:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:20:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:20:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T12:20:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T12:20:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T12:20:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T12:20:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T12:20:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T12:20:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T12:20:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:10.504 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:10.508 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-15T12:20:10.543 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-15T12:20:10.578 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-15T12:20:10.626 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-15T12:20:10.667 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-15T12:20:10.739 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-15T12:20:10.780 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-15T12:20:10.879 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-15T12:20:10.966 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-15T12:20:11.019 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-15T12:20:11.057 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-15T12:20:11.115 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-15T12:20:11.179 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-15T12:20:11.335 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:11 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:11.364 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-15T12:20:11.420 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-15T12:20:11.469 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:11.470 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-09-15T12:20:11.470 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-15T12:20:11.470 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-09-15T12:20:11.470 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:20:11.470 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-15T12:20:11.470 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-15T12:20:11.471 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T12:20:11.471 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T12:20:11.471 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T12:20:11.471 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T12:20:11.471 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T12:20:11.471 INFO:teuthology.orchestra.run.smithi122.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T12:20:11.471 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T12:20:11.471 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T12:20:11.471 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T12:20:11.471 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T12:20:11.471 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T12:20:11.471 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:11.471 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:20:11.471 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-09-15T12:20:11.471 INFO:teuthology.orchestra.run.smithi122.stdout:Install 12 Packages 2024-09-15T12:20:11.472 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:11.472 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 38 M 2024-09-15T12:20:11.472 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 212 M 2024-09-15T12:20:11.472 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:20:11.489 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-15T12:20:11.587 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-15T12:20:11.636 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-15T12:20:11.751 INFO:teuthology.orchestra.run.smithi122.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-15T12:20:11.764 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-15T12:20:11.793 INFO:teuthology.orchestra.run.smithi122.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.6 MB/s | 801 kB 00:00 2024-09-15T12:20:11.955 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-15T12:20:11.980 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-15T12:20:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-15T12:20:12.007 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:20:12.007 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T12:20:12.007 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T12:20:12.007 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T12:20:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:12.343 INFO:teuthology.orchestra.run.smithi122.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 55 kB/s | 33 kB 00:00 2024-09-15T12:20:12.501 INFO:teuthology.orchestra.run.smithi122.stdout:(4/12): ceph-mgr-diskprediction-local-19.3.0-48 8.4 MB/s | 7.4 MB 00:00 2024-09-15T12:20:12.910 INFO:teuthology.orchestra.run.smithi122.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.7 MB/s | 3.0 MB 00:01 2024-09-15T12:20:12.935 INFO:teuthology.orchestra.run.smithi122.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 31 kB/s | 18 kB 00:00 2024-09-15T12:20:13.136 INFO:teuthology.orchestra.run.smithi122.stdout:(7/12): openblas-0.3.26-2.el9.x86_64.rpm 61 kB/s | 38 kB 00:00 2024-09-15T12:20:13.694 INFO:teuthology.orchestra.run.smithi122.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 323 kB/s | 245 kB 00:00 2024-09-15T12:20:14.028 INFO:teuthology.orchestra.run.smithi122.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 4.4 MB/s | 4.9 MB 00:01 2024-09-15T12:20:14.403 INFO:teuthology.orchestra.run.smithi122.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.0 MB/s | 5.1 MB 00:01 2024-09-15T12:20:14.553 INFO:teuthology.orchestra.run.smithi122.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 292 kB/s | 250 kB 00:00 2024-09-15T12:20:15.545 INFO:teuthology.orchestra.run.smithi122.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-15T12:20:15.547 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:20:15.547 INFO:teuthology.orchestra.run.smithi122.stdout:Total 9.4 MB/s | 38 MB 00:04 2024-09-15T12:20:15.903 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:20:15.930 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:20:15.930 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:20:16.354 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:20:16.355 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:20:17.131 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:20:17.194 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-15T12:20:17.234 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-15T12:20:17.334 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-15T12:20:17.378 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-15T12:20:17.561 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-15T12:20:17.593 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-15T12:20:17.671 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-15T12:20:18.355 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-15T12:20:18.464 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-15T12:20:19.690 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-15T12:20:20.720 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-15T12:20:20.751 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-15T12:20:22.538 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-15T12:20:22.566 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-15T12:20:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:20:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T12:20:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T12:20:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T12:20:22.566 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:23.114 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-15T12:20:23.137 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-15T12:20:23.137 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:20:23.137 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T12:20:23.138 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T12:20:23.138 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T12:20:23.138 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:23.381 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-15T12:20:23.405 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-15T12:20:23.405 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:20:23.405 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T12:20:23.405 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T12:20:23.405 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T12:20:23.405 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:23.455 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-15T12:20:23.455 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-15T12:20:23.455 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-15T12:20:23.455 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-15T12:20:23.456 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-15T12:20:23.456 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-15T12:20:23.456 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-15T12:20:23.456 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-15T12:20:23.456 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-15T12:20:23.456 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-15T12:20:23.456 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-15T12:20:23.456 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-15T12:20:23.469 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-15T12:20:23.829 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-15T12:20:23.829 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:23.829 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:20:23.829 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:20:23.829 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T12:20:23.829 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T12:20:23.829 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T12:20:23.829 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T12:20:23.829 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T12:20:23.830 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T12:20:23.830 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T12:20:23.830 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T12:20:23.830 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T12:20:23.830 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T12:20:23.830 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T12:20:23.830 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:23.830 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:24.246 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr-rook 2024-09-15T12:20:24.821 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:24 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:24.953 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:24.954 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:24.954 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-15T12:20:24.954 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:24.955 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:20:24.955 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-15T12:20:24.955 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-15T12:20:24.955 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T12:20:24.955 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T12:20:24.955 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T12:20:24.955 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T12:20:24.955 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T12:20:24.955 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T12:20:24.955 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T12:20:24.955 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T12:20:24.955 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T12:20:24.955 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T12:20:24.956 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T12:20:24.956 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T12:20:24.956 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:24.956 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:20:24.956 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:24.956 INFO:teuthology.orchestra.run.smithi122.stdout:Install 13 Packages 2024-09-15T12:20:24.956 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:24.957 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 2.2 M 2024-09-15T12:20:24.957 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 26 M 2024-09-15T12:20:24.957 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:20:25.510 INFO:teuthology.orchestra.run.smithi122.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 149 kB/s | 19 kB 00:00 2024-09-15T12:20:25.526 INFO:teuthology.orchestra.run.smithi122.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 176 kB/s | 26 kB 00:00 2024-09-15T12:20:25.552 INFO:teuthology.orchestra.run.smithi122.stdout:(3/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 289 kB/s | 49 kB 00:00 2024-09-15T12:20:25.652 INFO:teuthology.orchestra.run.smithi122.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-09-15T12:20:25.694 INFO:teuthology.orchestra.run.smithi122.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 948 kB/s | 159 kB 00:00 2024-09-15T12:20:25.719 INFO:teuthology.orchestra.run.smithi122.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 804 kB/s | 54 kB 00:00 2024-09-15T12:20:25.761 INFO:teuthology.orchestra.run.smithi122.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 482 kB/s | 32 kB 00:00 2024-09-15T12:20:25.786 INFO:teuthology.orchestra.run.smithi122.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-15T12:20:25.812 INFO:teuthology.orchestra.run.smithi122.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 153 kB/s | 14 kB 00:00 2024-09-15T12:20:25.845 INFO:teuthology.orchestra.run.smithi122.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2024-09-15T12:20:25.871 INFO:teuthology.orchestra.run.smithi122.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-15T12:20:25.896 INFO:teuthology.orchestra.run.smithi122.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-15T12:20:25.938 INFO:teuthology.orchestra.run.smithi122.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-15T12:20:25.940 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:20:25.940 INFO:teuthology.orchestra.run.smithi122.stdout:Total 2.2 MB/s | 2.2 MB 00:00 2024-09-15T12:20:26.003 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:20:26.018 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:20:26.018 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:20:26.105 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:20:26.106 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:20:26.656 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:20:26.831 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-15T12:20:26.890 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-15T12:20:26.945 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-15T12:20:26.982 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-15T12:20:27.024 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-15T12:20:27.126 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-15T12:20:27.227 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-15T12:20:27.275 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-15T12:20:28.004 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-15T12:20:28.047 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-15T12:20:28.081 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-15T12:20:28.129 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-15T12:20:28.151 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-15T12:20:28.887 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-15T12:20:28.887 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-15T12:20:28.887 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-15T12:20:28.887 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-15T12:20:28.887 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-15T12:20:28.888 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-15T12:20:28.888 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-15T12:20:28.888 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-15T12:20:28.888 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-15T12:20:28.888 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-15T12:20:28.888 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-15T12:20:28.888 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-15T12:20:28.888 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-15T12:20:29.267 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-15T12:20:29.267 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:29.267 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:20:29.267 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:20:29.268 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T12:20:29.268 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T12:20:29.268 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T12:20:29.268 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T12:20:29.268 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T12:20:29.268 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T12:20:29.268 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T12:20:29.268 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T12:20:29.268 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T12:20:29.268 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T12:20:29.268 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T12:20:29.268 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T12:20:29.268 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:29.269 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:29.550 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr-cephadm 2024-09-15T12:20:30.113 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:30 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:30.246 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:30.247 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:30.247 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-15T12:20:30.247 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:30.247 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:20:30.248 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-15T12:20:30.248 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-15T12:20:30.248 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T12:20:30.248 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T12:20:30.248 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T12:20:30.248 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T12:20:30.248 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T12:20:30.248 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:30.248 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:20:30.248 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:30.248 INFO:teuthology.orchestra.run.smithi122.stdout:Install 6 Packages 2024-09-15T12:20:30.248 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:30.249 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 7.0 M 2024-09-15T12:20:30.249 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 33 M 2024-09-15T12:20:30.249 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:20:30.252 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-15T12:20:30.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-15T12:20:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-15T12:20:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-15T12:20:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-15T12:20:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-15T12:20:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-15T12:20:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-15T12:20:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-15T12:20:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-15T12:20:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-15T12:20:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-15T12:20:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-15T12:20:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-15T12:20:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-15T12:20:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-15T12:20:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-15T12:20:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-15T12:20:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-15T12:20:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-15T12:20:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-15T12:20:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-15T12:20:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-15T12:20:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-15T12:20:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-15T12:20:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-15T12:20:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-15T12:20:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-15T12:20:30.255 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-15T12:20:30.255 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-15T12:20:30.255 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-15T12:20:30.255 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-15T12:20:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-15T12:20:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-15T12:20:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-15T12:20:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-15T12:20:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-15T12:20:30.565 INFO:teuthology.orchestra.run.smithi122.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-09-15T12:20:30.590 INFO:teuthology.orchestra.run.smithi122.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 592 kB/s | 154 kB 00:00 2024-09-15T12:20:30.640 INFO:teuthology.orchestra.run.smithi122.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-15T12:20:30.658 INFO:teuthology.orchestra.run.smithi122.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 860 kB/s | 58 kB 00:00 2024-09-15T12:20:30.682 INFO:teuthology.orchestra.run.smithi122.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.7 MB/s | 74 kB 00:00 2024-09-15T12:20:31.339 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-15T12:20:31.339 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:31.339 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:20:31.339 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:20:31.339 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:20:31.339 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:20:31.339 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:20:31.339 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:20:31.339 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:20:31.340 INFO:teuthology.orchestra.run.smithi142.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T12:20:31.340 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T12:20:31.340 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T12:20:31.340 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T12:20:31.340 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T12:20:31.340 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T12:20:31.340 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T12:20:31.340 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T12:20:31.340 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T12:20:31.340 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T12:20:31.340 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T12:20:31.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T12:20:31.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T12:20:31.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T12:20:31.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T12:20:31.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T12:20:31.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T12:20:31.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T12:20:31.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T12:20:31.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T12:20:31.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T12:20:31.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T12:20:31.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T12:20:31.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T12:20:31.342 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T12:20:31.342 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T12:20:31.342 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T12:20:31.342 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T12:20:31.342 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T12:20:31.342 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T12:20:31.342 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T12:20:31.342 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:31.342 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:20:31.629 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-base 2024-09-15T12:20:32.132 INFO:teuthology.orchestra.run.smithi122.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.3 MB/s | 6.0 MB 00:01 2024-09-15T12:20:32.135 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:20:32.135 INFO:teuthology.orchestra.run.smithi122.stdout:Total 3.7 MB/s | 7.0 MB 00:01 2024-09-15T12:20:32.206 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:20:32.217 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:20:32.217 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:20:32.224 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:24 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:20:32.316 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:20:32.318 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:20:32.318 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:20:32.358 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:20:32.359 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-15T12:20:32.359 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:20:32.444 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install cephadm 2024-09-15T12:20:32.634 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:20:32.796 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-15T12:20:32.851 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-15T12:20:33.017 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:25 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:20:33.148 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:20:33.148 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:20:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-15T12:20:33.149 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:20:33.149 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:20:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-15T12:20:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:33.149 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:20:33.149 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:20:33.149 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-15T12:20:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:33.149 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 785 k 2024-09-15T12:20:33.149 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 791 k 2024-09-15T12:20:33.149 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:20:33.364 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-15T12:20:33.461 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-15T12:20:33.514 INFO:teuthology.orchestra.run.smithi142.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 2.1 MB/s | 785 kB 00:00 2024-09-15T12:20:33.515 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:20:33.515 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.1 MB/s | 785 kB 00:00 2024-09-15T12:20:33.515 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:20:33.521 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:20:33.521 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:20:33.527 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:20:33.527 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:20:33.529 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-15T12:20:33.555 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-15T12:20:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:20:34.094 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:20:34.167 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:20:34.378 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-15T12:20:34.378 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-15T12:20:34.379 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-15T12:20:34.379 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-15T12:20:34.379 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-15T12:20:34.379 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-15T12:20:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:20:34.641 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-15T12:20:34.642 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:34.642 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:20:34.642 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:20:34.642 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T12:20:34.642 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T12:20:34.642 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T12:20:34.642 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T12:20:34.642 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T12:20:34.642 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:34.642 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:34.814 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:20:34.814 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:34.814 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:20:34.814 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:20:34.814 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:34.814 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:20:34.913 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-fuse 2024-09-15T12:20:35.060 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-immutable-object-cache 2024-09-15T12:20:35.476 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:35 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:35.611 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:35.611 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:35.611 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-15T12:20:35.611 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:35.611 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:20:35.611 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-15T12:20:35.611 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-15T12:20:35.611 INFO:teuthology.orchestra.run.smithi122.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T12:20:35.612 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:35.612 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:20:35.612 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:35.612 INFO:teuthology.orchestra.run.smithi122.stdout:Install 2 Packages 2024-09-15T12:20:35.612 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:35.612 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 964 k 2024-09-15T12:20:35.612 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 4.1 M 2024-09-15T12:20:35.612 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:20:35.631 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:27 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:20:35.765 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:20:35.765 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:20:35.766 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-09-15T12:20:35.766 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:20:35.766 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:20:35.766 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-15T12:20:35.766 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:35.766 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:20:35.766 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:20:35.766 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-15T12:20:35.766 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:35.767 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 158 k 2024-09-15T12:20:35.767 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 644 k 2024-09-15T12:20:35.767 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:20:35.971 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 778 kB/s | 158 kB 00:00 2024-09-15T12:20:35.971 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:20:35.972 INFO:teuthology.orchestra.run.smithi142.stdout:Total 770 kB/s | 158 kB 00:00 2024-09-15T12:20:35.972 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:20:35.981 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:20:35.981 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:20:36.018 INFO:teuthology.orchestra.run.smithi122.stdout:(1/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 3.1 MB/s | 884 kB 00:00 2024-09-15T12:20:36.038 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:20:36.038 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:20:36.191 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:20:36.288 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:20:36.313 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:20:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:20:36.313 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T12:20:36.313 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:36.385 INFO:teuthology.orchestra.run.smithi122.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 123 kB/s | 80 kB 00:00 2024-09-15T12:20:36.385 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:20:36.386 INFO:teuthology.orchestra.run.smithi122.stdout:Total 1.2 MB/s | 964 kB 00:00 2024-09-15T12:20:36.397 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:20:36.421 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:20:36.421 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:20:36.503 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:20:36.503 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:20:36.693 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:20:36.854 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-15T12:20:36.917 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-15T12:20:37.257 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:20:37.257 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:37.257 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:20:37.257 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:20:37.257 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:37.257 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:20:37.498 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr 2024-09-15T12:20:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-15T12:20:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-15T12:20:37.883 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-15T12:20:37.883 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:37.883 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:20:37.883 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-15T12:20:37.883 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:37.883 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:38.066 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:30 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:20:38.157 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:20:38.167 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-volume 2024-09-15T12:20:38.201 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:20:38.202 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-15T12:20:38.202 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:20:38.280 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-dashboard 2024-09-15T12:20:38.745 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:38 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:38.836 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:30 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:20:38.879 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:38.880 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:38.880 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-15T12:20:38.880 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:38.880 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:20:38.881 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-15T12:20:38.881 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:38.881 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:20:38.881 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:38.881 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-15T12:20:38.881 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:38.881 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 285 k 2024-09-15T12:20:38.881 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 1.3 M 2024-09-15T12:20:38.881 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:20:38.969 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:20:38.970 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:20:38.970 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-15T12:20:38.970 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:20:38.970 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:20:38.970 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-15T12:20:38.971 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-15T12:20:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T12:20:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-15T12:20:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-15T12:20:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T12:20:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T12:20:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T12:20:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T12:20:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T12:20:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T12:20:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T12:20:38.971 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:38.971 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:20:38.972 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:20:38.972 INFO:teuthology.orchestra.run.smithi142.stdout:Install 11 Packages 2024-09-15T12:20:38.972 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:38.972 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 18 M 2024-09-15T12:20:38.972 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 155 M 2024-09-15T12:20:38.972 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:20:39.115 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-15T12:20:39.115 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:20:39.116 INFO:teuthology.orchestra.run.smithi122.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-15T12:20:39.116 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:20:39.124 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:20:39.124 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:20:39.154 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:20:39.154 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:20:39.387 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:20:39.459 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:20:39.474 INFO:teuthology.orchestra.run.smithi142.stdout:(1/11): ceph-prometheus-alerts-19.3.0-4879.g81f 113 kB/s | 16 kB 00:00 2024-09-15T12:20:39.475 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:20:39.475 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:20:39.475 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T12:20:39.475 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:39.516 INFO:teuthology.orchestra.run.smithi142.stdout:(2/11): ceph-grafana-dashboards-19.3.0-4879.g81 182 kB/s | 34 kB 00:00 2024-09-15T12:20:39.733 INFO:teuthology.orchestra.run.smithi142.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.0 MB/s | 269 kB 00:00 2024-09-15T12:20:39.784 INFO:teuthology.orchestra.run.smithi142.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-15T12:20:39.809 INFO:teuthology.orchestra.run.smithi142.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 785 kB/s | 19 kB 00:00 2024-09-15T12:20:39.851 INFO:teuthology.orchestra.run.smithi142.stdout:(6/11): protobuf-compiler-3.14.0-13.el9.x86_64. 2.5 MB/s | 863 kB 00:00 2024-09-15T12:20:39.901 INFO:teuthology.orchestra.run.smithi142.stdout:(7/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 22 MB/s | 2.0 MB 00:00 2024-09-15T12:20:39.926 INFO:teuthology.orchestra.run.smithi142.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.3 MB/s | 31 kB 00:00 2024-09-15T12:20:39.954 INFO:teuthology.orchestra.run.smithi142.stdout:(9/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.4 MB/s | 144 kB 00:00 2024-09-15T12:20:39.979 INFO:teuthology.orchestra.run.smithi142.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 3.5 MB/s | 188 kB 00:00 2024-09-15T12:20:40.262 INFO:teuthology.orchestra.run.smithi142.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 15 MB/s | 14 MB 00:00 2024-09-15T12:20:40.266 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:20:40.266 INFO:teuthology.orchestra.run.smithi142.stdout:Total 14 MB/s | 18 MB 00:01 2024-09-15T12:20:40.296 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:20:40.315 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:20:40.315 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:20:40.535 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:20:40.535 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:40.535 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:20:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:20:40.536 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:40.536 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:40.582 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:20:40.582 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:20:40.871 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install librados-devel 2024-09-15T12:20:41.132 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:20:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-15T12:20:41.257 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-15T12:20:41.344 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-15T12:20:41.443 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:41 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:41.466 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-15T12:20:41.527 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-15T12:20:41.580 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:41.580 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:41.581 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repo Size 2024-09-15T12:20:41.581 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:41.581 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:20:41.581 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-15T12:20:41.581 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:41.581 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:20:41.581 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:41.581 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-15T12:20:41.581 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:41.581 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 125 k 2024-09-15T12:20:41.581 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 445 k 2024-09-15T12:20:41.581 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:20:41.611 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-15T12:20:41.654 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-15T12:20:41.682 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-15T12:20:41.715 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-15T12:20:41.770 INFO:teuthology.orchestra.run.smithi122.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 662 kB/s | 125 kB 00:00 2024-09-15T12:20:41.771 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:20:41.771 INFO:teuthology.orchestra.run.smithi122.stdout:Total 656 kB/s | 125 kB 00:00 2024-09-15T12:20:41.771 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:20:41.776 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:20:41.776 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:20:41.839 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:20:41.840 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:20:41.996 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:20:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:20:42.535 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:20:42.799 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:20:42.799 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:42.799 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:20:42.800 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:20:42.800 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:42.800 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:43.038 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install libcephfs2 2024-09-15T12:20:43.619 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:43 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:43.716 INFO:teuthology.orchestra.run.smithi122.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:20:43.761 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:43.762 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-15T12:20:43.762 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:43.840 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install libcephfs-devel 2024-09-15T12:20:44.408 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:44 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:44.542 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:44.543 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:44.543 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repo Size 2024-09-15T12:20:44.543 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:44.543 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:20:44.543 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-15T12:20:44.543 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:44.543 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:20:44.543 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:44.543 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-15T12:20:44.543 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:44.543 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 32 k 2024-09-15T12:20:44.544 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 142 k 2024-09-15T12:20:44.544 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:20:44.690 INFO:teuthology.orchestra.run.smithi122.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 216 kB/s | 32 kB 00:00 2024-09-15T12:20:44.691 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:20:44.691 INFO:teuthology.orchestra.run.smithi122.stdout:Total 214 kB/s | 32 kB 00:00 2024-09-15T12:20:44.691 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:20:44.695 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:20:44.695 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:20:44.718 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:20:44.718 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:20:44.806 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:20:44.904 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:20:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-15T12:20:44.986 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-15T12:20:45.292 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:20:45.547 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:20:45.548 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:45.548 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:20:45.548 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:20:45.548 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:45.548 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:45.736 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install librados2 2024-09-15T12:20:46.297 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:46 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:46.387 INFO:teuthology.orchestra.run.smithi122.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:20:46.430 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:46.431 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-15T12:20:46.431 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:46.511 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install librbd1 2024-09-15T12:20:46.835 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-15T12:20:46.836 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-15T12:20:46.836 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-15T12:20:46.836 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-15T12:20:46.836 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-15T12:20:46.836 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-15T12:20:46.836 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-15T12:20:46.836 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-15T12:20:46.836 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-15T12:20:46.836 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-15T12:20:46.836 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-15T12:20:47.072 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:47 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:47.162 INFO:teuthology.orchestra.run.smithi122.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:20:47.172 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-15T12:20:47.172 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:47.172 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:20:47.172 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T12:20:47.172 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:20:47.172 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:20:47.172 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:20:47.173 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T12:20:47.173 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T12:20:47.173 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T12:20:47.173 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T12:20:47.173 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T12:20:47.173 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T12:20:47.173 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T12:20:47.173 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:47.173 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:20:47.205 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:47.206 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-15T12:20:47.206 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:47.278 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install python3-rados 2024-09-15T12:20:47.455 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-15T12:20:47.836 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:47 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:47.924 INFO:teuthology.orchestra.run.smithi122.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:20:47.968 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:47.969 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-15T12:20:47.969 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:48.019 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:40 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:20:48.043 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install python3-rgw 2024-09-15T12:20:48.153 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:20:48.154 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-15T12:20:48.154 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-15T12:20:48.154 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-15T12:20:48.154 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:20:48.154 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-15T12:20:48.154 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-15T12:20:48.154 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T12:20:48.154 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T12:20:48.154 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T12:20:48.154 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T12:20:48.154 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T12:20:48.154 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T12:20:48.155 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T12:20:48.155 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T12:20:48.155 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T12:20:48.155 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T12:20:48.155 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T12:20:48.155 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:48.155 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:20:48.155 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-15T12:20:48.155 INFO:teuthology.orchestra.run.smithi142.stdout:Install 12 Packages 2024-09-15T12:20:48.155 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:20:48.156 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 38 M 2024-09-15T12:20:48.156 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 212 M 2024-09-15T12:20:48.156 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:20:48.509 INFO:teuthology.orchestra.run.smithi142.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 924 kB/s | 191 kB 00:00 2024-09-15T12:20:48.568 INFO:teuthology.orchestra.run.smithi142.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-15T12:20:48.608 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:48 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:48.698 INFO:teuthology.orchestra.run.smithi122.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:20:48.742 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:48.743 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-15T12:20:48.743 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:48.776 INFO:teuthology.orchestra.run.smithi142.stdout:(3/12): ceph-mgr-diskprediction-local-19.3.0-48 16 MB/s | 7.4 MB 00:00 2024-09-15T12:20:48.802 INFO:teuthology.orchestra.run.smithi142.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 112 kB/s | 33 kB 00:00 2024-09-15T12:20:48.820 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install python3-cephfs 2024-09-15T12:20:49.035 INFO:teuthology.orchestra.run.smithi142.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 165 kB/s | 38 kB 00:00 2024-09-15T12:20:49.094 INFO:teuthology.orchestra.run.smithi142.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 57 kB/s | 18 kB 00:00 2024-09-15T12:20:49.382 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:49 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:49.471 INFO:teuthology.orchestra.run.smithi122.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:20:49.514 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:49.515 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-15T12:20:49.515 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:49.586 INFO:teuthology.orchestra.run.smithi142.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 498 kB/s | 245 kB 00:00 2024-09-15T12:20:49.591 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install python3-rbd 2024-09-15T12:20:49.670 INFO:teuthology.orchestra.run.smithi142.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.7 MB/s | 3.0 MB 00:01 2024-09-15T12:20:49.820 INFO:teuthology.orchestra.run.smithi142.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.6 MB/s | 250 kB 00:00 2024-09-15T12:20:50.151 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:50 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:50.195 INFO:teuthology.orchestra.run.smithi142.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.3 MB/s | 4.9 MB 00:01 2024-09-15T12:20:50.242 INFO:teuthology.orchestra.run.smithi122.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:20:50.285 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:50.286 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-15T12:20:50.286 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:50.365 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install rbd-fuse 2024-09-15T12:20:50.487 INFO:teuthology.orchestra.run.smithi142.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.7 MB/s | 5.1 MB 00:00 2024-09-15T12:20:50.930 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:50 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:51.065 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:51.066 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:51.066 INFO:teuthology.orchestra.run.smithi122.stdout: Package Architecture Version Repository Size 2024-09-15T12:20:51.066 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:51.066 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:20:51.066 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-15T12:20:51.067 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:51.067 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:20:51.067 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:51.067 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-15T12:20:51.067 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:51.067 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 91 k 2024-09-15T12:20:51.067 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 321 k 2024-09-15T12:20:51.067 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:20:51.260 INFO:teuthology.orchestra.run.smithi122.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 471 kB/s | 91 kB 00:00 2024-09-15T12:20:51.261 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:20:51.261 INFO:teuthology.orchestra.run.smithi122.stdout:Total 468 kB/s | 91 kB 00:00 2024-09-15T12:20:51.261 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:20:51.269 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:20:51.270 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:20:51.332 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:20:51.333 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:20:51.478 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:20:51.583 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:20:51.959 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:20:52.231 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:20:52.231 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:52.231 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:20:52.231 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:20:52.231 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:52.231 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:52.513 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install rbd-mirror 2024-09-15T12:20:53.083 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:53 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:53.179 INFO:teuthology.orchestra.run.smithi142.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.8 MB/s | 16 MB 00:03 2024-09-15T12:20:53.180 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:20:53.180 INFO:teuthology.orchestra.run.smithi142.stdout:Total 7.6 MB/s | 38 MB 00:05 2024-09-15T12:20:53.218 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:53.218 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repo Size 2024-09-15T12:20:53.219 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:53.219 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:20:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-15T12:20:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:53.219 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:20:53.219 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:53.219 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-15T12:20:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:53.220 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 3.5 M 2024-09-15T12:20:53.220 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 30 M 2024-09-15T12:20:53.220 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:20:53.540 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:20:53.547 INFO:teuthology.orchestra.run.smithi122.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 11 MB/s | 3.5 MB 00:00 2024-09-15T12:20:53.548 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:20:53.548 INFO:teuthology.orchestra.run.smithi122.stdout:Total 11 MB/s | 3.5 MB 00:00 2024-09-15T12:20:53.549 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:20:53.560 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:20:53.560 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:20:53.566 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:20:53.566 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:20:53.643 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:20:53.644 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:20:54.013 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:20:54.013 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:20:54.244 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:20:54.298 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:20:54.322 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:20:54.322 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:20:54.322 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T12:20:54.322 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T12:20:54.323 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T12:20:54.323 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:54.768 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:20:54.823 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-15T12:20:54.851 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-15T12:20:54.941 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-15T12:20:54.978 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-15T12:20:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-15T12:20:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-15T12:20:55.272 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-15T12:20:55.664 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:20:55.664 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:55.664 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:20:55.664 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:20:55.664 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:55.664 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:55.932 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install rbd-nbd 2024-09-15T12:20:55.935 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-15T12:20:56.055 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-15T12:20:56.503 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:04:56 ago on Sun 15 Sep 2024 12:16:00 PM UTC. 2024-09-15T12:20:56.636 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-15T12:20:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:56.637 INFO:teuthology.orchestra.run.smithi122.stdout: Package Architecture Version Repository Size 2024-09-15T12:20:56.637 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-15T12:20:56.638 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-15T12:20:56.638 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-15T12:20:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-15T12:20:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-15T12:20:56.638 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 177 k 2024-09-15T12:20:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 685 k 2024-09-15T12:20:56.638 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-15T12:20:56.843 INFO:teuthology.orchestra.run.smithi122.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 865 kB/s | 177 kB 00:00 2024-09-15T12:20:56.843 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:20:56.843 INFO:teuthology.orchestra.run.smithi122.stdout:Total 858 kB/s | 177 kB 00:00 2024-09-15T12:20:56.843 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-15T12:20:56.853 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-15T12:20:56.853 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-15T12:20:56.921 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-15T12:20:56.921 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-15T12:20:57.088 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-15T12:20:57.190 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:20:57.265 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-15T12:20:57.641 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:20:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:20:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:57.905 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-15T12:20:57.906 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:20:57.906 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:20:57.906 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-15T12:20:58.172 DEBUG:teuthology.parallel:result is None 2024-09-15T12:20:58.299 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-15T12:20:58.325 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-15T12:21:00.816 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-15T12:21:00.816 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-15T12:21:00.817 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-15T12:21:00.817 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-15T12:21:00.817 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-15T12:21:00.817 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-15T12:21:00.817 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-15T12:21:00.817 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-15T12:21:00.817 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-15T12:21:00.817 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-15T12:21:00.817 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-15T12:21:00.817 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-15T12:21:01.287 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-15T12:21:01.287 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:01.287 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:21:01.287 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:21:01.288 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T12:21:01.288 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T12:21:01.288 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T12:21:01.288 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T12:21:01.288 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T12:21:01.288 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T12:21:01.288 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T12:21:01.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T12:21:01.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T12:21:01.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T12:21:01.288 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T12:21:01.288 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:01.288 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:01.686 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-rook 2024-09-15T12:21:02.279 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:54 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:21:02.423 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:21:02.424 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:02.424 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-15T12:21:02.424 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:02.424 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:21:02.424 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-15T12:21:02.424 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-15T12:21:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T12:21:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T12:21:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T12:21:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T12:21:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T12:21:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T12:21:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T12:21:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T12:21:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T12:21:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T12:21:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T12:21:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T12:21:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:02.426 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:21:02.426 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:02.426 INFO:teuthology.orchestra.run.smithi142.stdout:Install 13 Packages 2024-09-15T12:21:02.426 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:02.426 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 2.2 M 2024-09-15T12:21:02.426 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 26 M 2024-09-15T12:21:02.426 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:21:02.892 INFO:teuthology.orchestra.run.smithi142.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 191 kB/s | 19 kB 00:00 2024-09-15T12:21:02.917 INFO:teuthology.orchestra.run.smithi142.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 204 kB/s | 26 kB 00:00 2024-09-15T12:21:02.976 INFO:teuthology.orchestra.run.smithi142.stdout:(3/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 267 kB/s | 49 kB 00:00 2024-09-15T12:21:03.026 INFO:teuthology.orchestra.run.smithi142.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-09-15T12:21:03.060 INFO:teuthology.orchestra.run.smithi142.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-15T12:21:03.085 INFO:teuthology.orchestra.run.smithi142.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 910 kB/s | 54 kB 00:00 2024-09-15T12:21:03.128 INFO:teuthology.orchestra.run.smithi142.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-15T12:21:03.153 INFO:teuthology.orchestra.run.smithi142.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-15T12:21:03.178 INFO:teuthology.orchestra.run.smithi142.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 153 kB/s | 14 kB 00:00 2024-09-15T12:21:03.220 INFO:teuthology.orchestra.run.smithi142.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-15T12:21:03.245 INFO:teuthology.orchestra.run.smithi142.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-15T12:21:03.262 INFO:teuthology.orchestra.run.smithi142.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 2.2 MB/s | 90 kB 00:00 2024-09-15T12:21:03.304 INFO:teuthology.orchestra.run.smithi142.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-15T12:21:03.307 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:21:03.307 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.5 MB/s | 2.2 MB 00:00 2024-09-15T12:21:03.371 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:21:03.386 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:21:03.386 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:21:03.474 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:21:03.476 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:21:04.008 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:21:04.179 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-15T12:21:04.230 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-15T12:21:04.285 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-15T12:21:04.322 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-15T12:21:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-15T12:21:04.458 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-15T12:21:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-15T12:21:04.616 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-15T12:21:05.331 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-15T12:21:05.388 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-15T12:21:05.421 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-15T12:21:05.470 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-15T12:21:05.491 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-15T12:21:06.280 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-15T12:21:06.280 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-15T12:21:06.280 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-15T12:21:06.280 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-15T12:21:06.280 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-15T12:21:06.280 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-15T12:21:06.281 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-15T12:21:06.281 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-15T12:21:06.281 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-15T12:21:06.281 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-15T12:21:06.281 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-15T12:21:06.281 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-15T12:21:06.281 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-15T12:21:06.627 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-15T12:21:06.627 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:06.628 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:21:06.628 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:21:06.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T12:21:06.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T12:21:06.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T12:21:06.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T12:21:06.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T12:21:06.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T12:21:06.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T12:21:06.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T12:21:06.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T12:21:06.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T12:21:06.628 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T12:21:06.629 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T12:21:06.629 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:06.629 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:06.917 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-cephadm 2024-09-15T12:21:07.484 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:59 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:21:07.620 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:21:07.620 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:07.620 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-15T12:21:07.620 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:07.621 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:21:07.621 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-15T12:21:07.621 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-15T12:21:07.621 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T12:21:07.621 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T12:21:07.621 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T12:21:07.621 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T12:21:07.621 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T12:21:07.621 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:07.621 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:21:07.621 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:07.621 INFO:teuthology.orchestra.run.smithi142.stdout:Install 6 Packages 2024-09-15T12:21:07.621 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:07.622 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 7.0 M 2024-09-15T12:21:07.622 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 33 M 2024-09-15T12:21:07.622 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:21:07.906 INFO:teuthology.orchestra.run.smithi142.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-15T12:21:07.956 INFO:teuthology.orchestra.run.smithi142.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-15T12:21:07.981 INFO:teuthology.orchestra.run.smithi142.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-15T12:21:08.006 INFO:teuthology.orchestra.run.smithi142.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-15T12:21:09.073 INFO:teuthology.orchestra.run.smithi142.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.5 MB/s | 6.0 MB 00:01 2024-09-15T12:21:10.023 INFO:teuthology.orchestra.run.smithi142.stdout:(6/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 67 kB/s | 154 kB 00:02 2024-09-15T12:21:10.025 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:21:10.025 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.9 MB/s | 7.0 MB 00:02 2024-09-15T12:21:10.098 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:21:10.109 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:21:10.109 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:21:10.212 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:21:10.213 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:21:10.519 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:21:10.696 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-15T12:21:10.741 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-15T12:21:11.262 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-15T12:21:11.354 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-15T12:21:11.428 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-15T12:21:11.454 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-15T12:21:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-15T12:21:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-15T12:21:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-15T12:21:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-15T12:21:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-15T12:21:12.241 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-15T12:21:12.517 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-15T12:21:12.517 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:12.517 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:21:12.517 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:21:12.517 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T12:21:12.517 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T12:21:12.518 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T12:21:12.518 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T12:21:12.518 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T12:21:12.518 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:12.518 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:12.781 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-fuse 2024-09-15T12:21:13.359 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:05:05 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:21:13.493 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:21:13.494 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:13.494 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-15T12:21:13.494 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:13.494 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:21:13.494 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-15T12:21:13.494 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-15T12:21:13.494 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T12:21:13.494 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:13.494 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:21:13.494 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:13.494 INFO:teuthology.orchestra.run.smithi142.stdout:Install 2 Packages 2024-09-15T12:21:13.494 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:13.495 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 964 k 2024-09-15T12:21:13.495 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 4.1 M 2024-09-15T12:21:13.495 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:21:14.058 INFO:teuthology.orchestra.run.smithi142.stdout:(1/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 3.0 MB/s | 884 kB 00:00 2024-09-15T12:21:14.442 INFO:teuthology.orchestra.run.smithi142.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 119 kB/s | 80 kB 00:00 2024-09-15T12:21:14.442 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:21:14.443 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.0 MB/s | 964 kB 00:00 2024-09-15T12:21:14.454 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:21:14.479 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:21:14.479 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:21:14.560 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:21:14.560 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:21:14.760 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:21:14.912 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-15T12:21:14.982 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-15T12:21:15.711 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-15T12:21:15.711 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-15T12:21:15.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-15T12:21:15.985 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:15.985 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:21:15.985 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-15T12:21:15.985 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:15.986 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:16.288 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-volume 2024-09-15T12:21:16.863 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:05:08 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:21:17.005 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:21:17.006 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-15T12:21:17.006 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:17.006 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:21:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-15T12:21:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:17.006 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:21:17.006 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:17.006 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-15T12:21:17.007 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:17.007 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 285 k 2024-09-15T12:21:17.007 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 1.3 M 2024-09-15T12:21:17.007 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:21:17.213 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 1.4 MB/s | 285 kB 00:00 2024-09-15T12:21:17.213 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:21:17.214 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-15T12:21:17.214 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:21:17.222 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:21:17.222 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:21:17.253 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:21:17.254 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:21:17.484 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:21:17.557 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:21:17.573 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:21:17.573 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:21:17.573 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T12:21:17.573 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:18.549 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:21:18.549 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:18.549 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:21:18.550 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:21:18.550 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:18.550 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:18.876 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados-devel 2024-09-15T12:21:19.460 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:05:11 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:21:19.596 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:21:19.596 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:19.597 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-09-15T12:21:19.597 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:19.597 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:21:19.597 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-15T12:21:19.597 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:19.597 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:21:19.597 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:19.597 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-15T12:21:19.597 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:19.598 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 125 k 2024-09-15T12:21:19.598 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 445 k 2024-09-15T12:21:19.598 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:21:19.785 INFO:teuthology.orchestra.run.smithi142.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 668 kB/s | 125 kB 00:00 2024-09-15T12:21:19.786 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:21:19.786 INFO:teuthology.orchestra.run.smithi142.stdout:Total 662 kB/s | 125 kB 00:00 2024-09-15T12:21:19.786 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:21:19.791 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:21:19.791 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:21:19.854 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:21:19.855 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:21:20.017 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:21:20.108 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:21:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:21:20.900 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:21:20.900 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:20.900 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:21:20.900 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:21:20.901 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:20.901 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:21.160 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs2 2024-09-15T12:21:21.732 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:05:13 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:21:21.823 INFO:teuthology.orchestra.run.smithi142.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:21:21.868 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:21:21.869 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-15T12:21:21.869 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:21.950 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs-devel 2024-09-15T12:21:22.517 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:05:14 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:21:22.648 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:21:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:22.649 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-09-15T12:21:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:22.649 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:21:22.649 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-15T12:21:22.649 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:21:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-15T12:21:22.650 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 32 k 2024-09-15T12:21:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 142 k 2024-09-15T12:21:22.650 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:21:22.805 INFO:teuthology.orchestra.run.smithi142.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 205 kB/s | 32 kB 00:00 2024-09-15T12:21:22.805 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:21:22.805 INFO:teuthology.orchestra.run.smithi142.stdout:Total 203 kB/s | 32 kB 00:00 2024-09-15T12:21:22.806 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:21:22.809 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:21:22.810 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:21:22.830 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:21:22.831 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:21:22.928 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:21:23.048 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:21:23.509 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:21:23.748 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:21:23.748 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:23.748 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:21:23.748 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:21:23.749 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:23.749 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:23.950 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados2 2024-09-15T12:21:24.518 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:05:16 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:21:24.610 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:21:24.653 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:21:24.654 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-15T12:21:24.654 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:24.732 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librbd1 2024-09-15T12:21:25.295 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:05:17 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:21:25.385 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:21:25.428 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:21:25.429 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-15T12:21:25.429 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:25.505 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rados 2024-09-15T12:21:26.069 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:05:18 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:21:26.159 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:21:26.202 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:21:26.203 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-15T12:21:26.203 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:26.291 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rgw 2024-09-15T12:21:26.853 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:05:18 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:21:26.941 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:21:26.984 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:21:26.985 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-15T12:21:26.985 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:27.073 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-cephfs 2024-09-15T12:21:27.643 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:05:19 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:21:27.733 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:21:27.776 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:21:27.777 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-15T12:21:27.778 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:27.857 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rbd 2024-09-15T12:21:28.418 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:05:20 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:21:28.506 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:21:28.549 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:21:28.550 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-15T12:21:28.550 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:28.629 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-fuse 2024-09-15T12:21:29.198 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:05:21 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:21:29.331 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:21:29.332 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:29.332 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-15T12:21:29.332 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:29.332 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:21:29.332 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-15T12:21:29.332 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:29.332 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:21:29.332 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:29.332 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-15T12:21:29.332 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:29.332 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 91 k 2024-09-15T12:21:29.333 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 321 k 2024-09-15T12:21:29.333 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:21:29.524 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 475 kB/s | 91 kB 00:00 2024-09-15T12:21:29.525 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:21:29.525 INFO:teuthology.orchestra.run.smithi142.stdout:Total 472 kB/s | 91 kB 00:00 2024-09-15T12:21:29.525 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:21:29.534 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:21:29.534 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:21:29.597 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:21:29.598 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:21:29.745 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:21:29.847 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:21:30.230 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:21:30.499 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:21:30.499 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:30.499 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:21:30.499 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:21:30.499 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:30.499 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:30.802 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-mirror 2024-09-15T12:21:31.396 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:05:23 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:21:31.540 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:21:31.541 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:31.541 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-09-15T12:21:31.541 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:31.541 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:21:31.541 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-15T12:21:31.541 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:31.542 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:21:31.542 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:31.542 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-15T12:21:31.542 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:31.542 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 3.5 M 2024-09-15T12:21:31.542 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 30 M 2024-09-15T12:21:31.542 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:21:31.954 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 8.5 MB/s | 3.5 MB 00:00 2024-09-15T12:21:31.954 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:21:31.955 INFO:teuthology.orchestra.run.smithi142.stdout:Total 8.5 MB/s | 3.5 MB 00:00 2024-09-15T12:21:31.955 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:21:31.966 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:21:31.966 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:21:32.053 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:21:32.053 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:21:32.665 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:21:32.738 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:21:32.765 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:21:32.765 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:21:32.765 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T12:21:32.765 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T12:21:32.765 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T12:21:32.765 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:21:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:34.001 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:21:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:21:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:34.001 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:34.277 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-nbd 2024-09-15T12:21:34.852 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:05:26 ago on Sun 15 Sep 2024 12:16:08 PM UTC. 2024-09-15T12:21:34.988 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-15T12:21:34.988 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:34.989 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-15T12:21:34.989 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:34.989 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-15T12:21:34.989 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-15T12:21:34.989 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:34.989 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-15T12:21:34.989 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-15T12:21:34.989 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-15T12:21:34.989 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:34.990 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 177 k 2024-09-15T12:21:34.990 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 685 k 2024-09-15T12:21:34.990 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-15T12:21:35.191 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 879 kB/s | 177 kB 00:00 2024-09-15T12:21:35.191 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:21:35.192 INFO:teuthology.orchestra.run.smithi142.stdout:Total 873 kB/s | 177 kB 00:00 2024-09-15T12:21:35.192 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-15T12:21:35.201 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-15T12:21:35.201 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-15T12:21:35.271 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-15T12:21:35.272 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-15T12:21:35.435 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-15T12:21:35.531 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:21:36.007 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:21:36.289 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:21:36.290 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:36.290 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-15T12:21:36.290 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:21:36.290 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:36.290 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-15T12:21:36.563 DEBUG:teuthology.parallel:result is None 2024-09-15T12:21:36.564 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-15T12:21:36.700 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T12:21:36.729 INFO:teuthology.orchestra.run.smithi122.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-15T12:21:36.730 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-15T12:21:36.730 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-15T12:21:36.732 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-15T12:21:36.863 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T12:21:36.884 INFO:teuthology.orchestra.run.smithi142.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-15T12:21:36.884 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-15T12:21:36.884 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-15T12:21:36.886 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T12:21:36.886 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:21:36.886 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T12:21:36.916 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-15T12:21:36.916 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T12:21:36.949 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T12:21:36.949 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:21:36.949 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T12:21:36.984 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T12:21:37.051 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-15T12:21:37.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T12:21:37.076 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T12:21:37.141 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T12:21:37.141 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:21:37.141 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T12:21:37.168 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T12:21:37.234 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-15T12:21:37.234 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T12:21:37.264 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T12:21:37.329 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T12:21:37.329 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:21:37.330 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T12:21:37.354 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T12:21:37.419 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-15T12:21:37.419 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T12:21:37.443 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T12:21:37.507 INFO:teuthology.run_tasks:Running task ceph... 2024-09-15T12:21:37.587 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-15T12:21:37.587 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /var/log/ceph 2024-09-15T12:21:37.589 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-09-15T12:21:37.613 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-15T12:21:37.613 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T12:21:37.654 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T12:21:37.678 INFO:tasks.ceph:Creating extra log directories... 2024-09-15T12:21:37.678 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T12:21:37.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T12:21:37.752 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-15T12:21:37.752 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-15T12:21:37.752 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905495', 'branch': 'wip-matanb-crimson-testing-59543', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7905495', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1236, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi122.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK4XCTVXXytf+PNXlukMuLpKCXwjoBa3y9cc2wnmGpM++RNPiZaWtt6KAWUHps5GFGXDqEIAtkgt098weo6If2I=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNwoxx05g/M6jPDsdqx6/pdHYLiDlvezET7gzo3kAI17zyPb1J1XiFEh4XSybUVwbPTkVG5VubwsOfhh+PTwZtg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh --crimson', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_11:59:21', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-15T12:21:37.753 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T12:21:37.785 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T12:21:37.800 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T12:21:37.839 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T12:21:37.864 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:21:37.865 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T12:21:37.918 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T12:21:37.919 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2024-09-15T12:21:37.974 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T12:21:37.974 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:21:37.974 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-15T12:21:37.974 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:21:37.974 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:21:37.974 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-15 12:20:54.594898212 +0000 2024-09-15T12:21:37.974 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-15 12:15:18.891262100 +0000 2024-09-15T12:21:37.974 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-15 12:15:18.891262100 +0000 2024-09-15T12:21:37.974 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-15 12:15:18.891262100 +0000 2024-09-15T12:21:37.975 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T12:21:38.037 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-15T12:21:38.037 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-15T12:21:38.037 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000201904 s, 2.5 MB/s 2024-09-15T12:21:38.038 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T12:21:38.094 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2024-09-15T12:21:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T12:21:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:21:38.149 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-15T12:21:38.149 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:21:38.149 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:21:38.150 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-15 12:20:54.594898212 +0000 2024-09-15T12:21:38.150 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-15 12:15:19.237254447 +0000 2024-09-15T12:21:38.150 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-15 12:15:19.237254447 +0000 2024-09-15T12:21:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-15 12:15:19.237254447 +0000 2024-09-15T12:21:38.150 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T12:21:38.212 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-15T12:21:38.212 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-15T12:21:38.212 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000171517 s, 3.0 MB/s 2024-09-15T12:21:38.213 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T12:21:38.269 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2024-09-15T12:21:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T12:21:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:21:38.324 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-15T12:21:38.324 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:21:38.325 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:21:38.325 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-15 12:20:54.595898190 +0000 2024-09-15T12:21:38.325 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-15 12:15:19.562247258 +0000 2024-09-15T12:21:38.325 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-15 12:15:19.562247258 +0000 2024-09-15T12:21:38.325 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-15 12:15:19.562247258 +0000 2024-09-15T12:21:38.325 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T12:21:38.387 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-15T12:21:38.387 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-15T12:21:38.387 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000231541 s, 2.2 MB/s 2024-09-15T12:21:38.388 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T12:21:38.444 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2024-09-15T12:21:38.499 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T12:21:38.500 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:21:38.500 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-15T12:21:38.500 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:21:38.500 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:21:38.500 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-15 12:20:54.595898190 +0000 2024-09-15T12:21:38.500 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-15 12:15:19.884240135 +0000 2024-09-15T12:21:38.500 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-15 12:15:19.884240135 +0000 2024-09-15T12:21:38.500 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-15 12:15:19.884240135 +0000 2024-09-15T12:21:38.500 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T12:21:38.563 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-15T12:21:38.563 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-15T12:21:38.563 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000165167 s, 3.1 MB/s 2024-09-15T12:21:38.564 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T12:21:38.620 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-15T12:21:38.620 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-15T12:21:38.620 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T12:21:38.638 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T12:21:38.638 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-09-15T12:21:38.694 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T12:21:38.695 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:21:38.695 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-15T12:21:38.695 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:21:38.695 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:21:38.695 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-15 12:21:33.051651718 +0000 2024-09-15T12:21:38.695 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-15 12:15:18.925757636 +0000 2024-09-15T12:21:38.695 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-15 12:15:18.925757636 +0000 2024-09-15T12:21:38.695 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-15 12:15:18.925757636 +0000 2024-09-15T12:21:38.695 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T12:21:38.760 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-15T12:21:38.760 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-15T12:21:38.760 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000281409 s, 1.8 MB/s 2024-09-15T12:21:38.761 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T12:21:38.818 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-09-15T12:21:38.874 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T12:21:38.875 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:21:38.875 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-15T12:21:38.875 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:21:38.875 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:21:38.875 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-15 12:21:33.052651699 +0000 2024-09-15T12:21:38.875 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-15 12:15:19.235751781 +0000 2024-09-15T12:21:38.875 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-15 12:15:19.235751781 +0000 2024-09-15T12:21:38.875 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-15 12:15:19.235751781 +0000 2024-09-15T12:21:38.875 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T12:21:38.939 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-15T12:21:38.940 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-15T12:21:38.940 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000220523 s, 2.3 MB/s 2024-09-15T12:21:38.941 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T12:21:38.998 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-09-15T12:21:39.054 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T12:21:39.054 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:21:39.054 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-15T12:21:39.054 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:21:39.054 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:21:39.054 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-15 12:21:33.052651699 +0000 2024-09-15T12:21:39.054 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-15 12:15:19.558745680 +0000 2024-09-15T12:21:39.054 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-15 12:15:19.558745680 +0000 2024-09-15T12:21:39.055 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-15 12:15:19.558745680 +0000 2024-09-15T12:21:39.055 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T12:21:39.118 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-15T12:21:39.118 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-15T12:21:39.118 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000216391 s, 2.4 MB/s 2024-09-15T12:21:39.119 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T12:21:39.175 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-09-15T12:21:39.230 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T12:21:39.230 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:21:39.230 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-15T12:21:39.230 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:21:39.231 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:21:39.231 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-15 12:21:33.053651679 +0000 2024-09-15T12:21:39.231 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-15 12:15:19.882739561 +0000 2024-09-15T12:21:39.231 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-15 12:15:19.882739561 +0000 2024-09-15T12:21:39.231 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-15 12:15:19.882739561 +0000 2024-09-15T12:21:39.231 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T12:21:39.293 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-15T12:21:39.293 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-15T12:21:39.293 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000205641 s, 2.5 MB/s 2024-09-15T12:21:39.294 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T12:21:39.351 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-15T12:21:39.351 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-15T12:21:39.351 INFO:tasks.ceph:Generating config... 2024-09-15T12:21:39.352 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-15T12:21:39.352 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-15T12:21:39.352 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-15T12:21:39.352 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-15T12:21:39.352 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-15T12:21:39.352 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-15T12:21:39.352 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-15T12:21:39.352 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-15T12:21:39.353 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-15T12:21:39.353 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-15T12:21:39.353 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-15T12:21:39.353 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-15T12:21:39.353 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-15T12:21:39.353 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-15T12:21:39.353 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-15T12:21:39.353 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-15T12:21:39.353 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-15T12:21:39.353 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-15T12:21:39.353 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-15T12:21:39.353 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-15T12:21:39.353 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-15T12:21:39.353 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-15T12:21:39.354 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-15T12:21:39.354 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-15T12:21:39.354 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-15T12:21:39.356 INFO:tasks.ceph:[osd] log to file = False 2024-09-15T12:21:39.356 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-15T12:21:39.356 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-15T12:21:39.356 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-15T12:21:39.356 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-15T12:21:39.356 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-15T12:21:39.356 INFO:tasks.ceph:[osd] osd class default list = * 2024-09-15T12:21:39.356 INFO:tasks.ceph:[osd] osd class load list = * 2024-09-15T12:21:39.356 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-15T12:21:39.356 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-15T12:21:39.356 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-15T12:21:39.357 INFO:tasks.ceph:[client] debug ms = 1 2024-09-15T12:21:39.357 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-15T12:21:39.357 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-15T12:21:39.357 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-15T12:21:39.357 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-15T12:21:39.357 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-15T12:21:39.357 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-15T12:21:39.357 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-15T12:21:39.357 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-15T12:21:39.357 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-15T12:21:39.357 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-15T12:21:39.357 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-15T12:21:39.357 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-15T12:21:39.357 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-15T12:21:39.358 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-15T12:21:39.358 INFO:tasks.ceph:Setting up mon.a... 2024-09-15T12:21:39.358 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-15T12:21:39.425 INFO:teuthology.orchestra.run.smithi122.stdout:creating /etc/ceph/ceph.keyring 2024-09-15T12:21:39.428 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-15T12:21:39.480 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T12:21:39.504 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.122')] 2024-09-15T12:21:39.504 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.122', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-15T12:21:39.505 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:21:39.505 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T12:21:39.561 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.122 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:21:39.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:21:39.650+0000 7f5f35ae1f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:39.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:21:39.650+0000 7f5f35ae1f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:39.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:21:39.651+0000 7f5f35ae1f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:39.653 INFO:teuthology.orchestra.run.smithi122.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:21:39.653 INFO:teuthology.orchestra.run.smithi122.stdout:monmaptool: generated fsid a718c858-230d-4784-bf30-b6c766b34745 2024-09-15T12:21:39.653 INFO:teuthology.orchestra.run.smithi122.stdout:setting min_mon_release = quincy 2024-09-15T12:21:39.653 INFO:teuthology.orchestra.run.smithi122.stdout:epoch 0 2024-09-15T12:21:39.653 INFO:teuthology.orchestra.run.smithi122.stdout:fsid a718c858-230d-4784-bf30-b6c766b34745 2024-09-15T12:21:39.653 INFO:teuthology.orchestra.run.smithi122.stdout:last_changed 2024-09-15T12:21:39.652292+0000 2024-09-15T12:21:39.653 INFO:teuthology.orchestra.run.smithi122.stdout:created 2024-09-15T12:21:39.652292+0000 2024-09-15T12:21:39.653 INFO:teuthology.orchestra.run.smithi122.stdout:min_mon_release 17 (quincy) 2024-09-15T12:21:39.653 INFO:teuthology.orchestra.run.smithi122.stdout:election_strategy: 1 2024-09-15T12:21:39.653 INFO:teuthology.orchestra.run.smithi122.stdout:0: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.a 2024-09-15T12:21:39.654 INFO:teuthology.orchestra.run.smithi122.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-15T12:21:39.655 DEBUG:teuthology.orchestra.run.smithi122:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T12:21:39.669 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a718c858-230d-4784-bf30-b6c766b34745... 2024-09-15T12:21:39.670 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T12:21:39.712 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T12:21:39.751 INFO:teuthology.orchestra.run.smithi122.stdout:[global] 2024-09-15T12:21:39.751 INFO:teuthology.orchestra.run.smithi122.stdout: chdir = "" 2024-09-15T12:21:39.751 INFO:teuthology.orchestra.run.smithi122.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T12:21:39.751 INFO:teuthology.orchestra.run.smithi122.stdout: auth supported = cephx 2024-09-15T12:21:39.751 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.751 INFO:teuthology.orchestra.run.smithi122.stdout: filestore xattr use omap = true 2024-09-15T12:21:39.751 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.752 INFO:teuthology.orchestra.run.smithi122.stdout: mon clock drift allowed = 1.000 2024-09-15T12:21:39.752 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.752 INFO:teuthology.orchestra.run.smithi122.stdout: osd crush chooseleaf type = 0 2024-09-15T12:21:39.752 INFO:teuthology.orchestra.run.smithi122.stdout: auth debug = true 2024-09-15T12:21:39.752 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.752 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on old message = true 2024-09-15T12:21:39.752 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on bug = true 2024-09-15T12:21:39.752 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.752 INFO:teuthology.orchestra.run.smithi122.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T12:21:39.752 INFO:teuthology.orchestra.run.smithi122.stdout: mon pg warn max object skew = 0 2024-09-15T12:21:39.752 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.752 INFO:teuthology.orchestra.run.smithi122.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T12:21:39.752 INFO:teuthology.orchestra.run.smithi122.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T12:21:39.753 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.753 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default size = 2 2024-09-15T12:21:39.753 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.753 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow primary affinity = true 2024-09-15T12:21:39.753 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow pg remap = true 2024-09-15T12:21:39.753 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on legacy crush tunables = false 2024-09-15T12:21:39.753 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on crush straw calc version zero = false 2024-09-15T12:21:39.753 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on no sortbitwise = false 2024-09-15T12:21:39.753 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on osd down out interval zero = false 2024-09-15T12:21:39.753 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on too few osds = false 2024-09-15T12:21:39.753 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T12:21:39.753 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T12:21:39.753 INFO:teuthology.orchestra.run.smithi122.stdout: mon_allow_pool_size_one = true 2024-09-15T12:21:39.753 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.753 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T12:21:39.754 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.754 INFO:teuthology.orchestra.run.smithi122.stdout: osd default data pool replay window = 5 2024-09-15T12:21:39.754 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.754 INFO:teuthology.orchestra.run.smithi122.stdout: mon allow pool delete = true 2024-09-15T12:21:39.754 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.754 INFO:teuthology.orchestra.run.smithi122.stdout: mon cluster log file level = debug 2024-09-15T12:21:39.754 INFO:teuthology.orchestra.run.smithi122.stdout: debug asserts on shutdown = true 2024-09-15T12:21:39.754 INFO:teuthology.orchestra.run.smithi122.stdout: mon health detail to clog = false 2024-09-15T12:21:39.754 INFO:teuthology.orchestra.run.smithi122.stdout: mon host = 172.21.15.122 2024-09-15T12:21:39.754 INFO:teuthology.orchestra.run.smithi122.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-15T12:21:39.754 INFO:teuthology.orchestra.run.smithi122.stdout: ms client mode = crc 2024-09-15T12:21:39.754 INFO:teuthology.orchestra.run.smithi122.stdout: ms cluster mode = crc 2024-09-15T12:21:39.754 INFO:teuthology.orchestra.run.smithi122.stdout: ms mon client mode = crc 2024-09-15T12:21:39.755 INFO:teuthology.orchestra.run.smithi122.stdout: ms mon cluster mode = crc 2024-09-15T12:21:39.755 INFO:teuthology.orchestra.run.smithi122.stdout: ms mon service mode = crc 2024-09-15T12:21:39.755 INFO:teuthology.orchestra.run.smithi122.stdout: ms service mode = crc 2024-09-15T12:21:39.755 INFO:teuthology.orchestra.run.smithi122.stdout: fsid = a718c858-230d-4784-bf30-b6c766b34745 2024-09-15T12:21:39.755 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.755 INFO:teuthology.orchestra.run.smithi122.stdout:[osd] 2024-09-15T12:21:39.755 INFO:teuthology.orchestra.run.smithi122.stdout: osd journal size = 100 2024-09-15T12:21:39.755 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.755 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub load threshold = 5.0 2024-09-15T12:21:39.755 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub max interval = 600 2024-09-15T12:21:39.755 INFO:teuthology.orchestra.run.smithi122.stdout: osd mclock profile = high_recovery_ops 2024-09-15T12:21:39.755 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.755 INFO:teuthology.orchestra.run.smithi122.stdout: osd recover clone overlap = true 2024-09-15T12:21:39.755 INFO:teuthology.orchestra.run.smithi122.stdout: osd recovery max chunk = 1048576 2024-09-15T12:21:39.755 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.756 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug shutdown = true 2024-09-15T12:21:39.756 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug op order = true 2024-09-15T12:21:39.756 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug verify stray on activate = true 2024-09-15T12:21:39.756 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug trim objects = true 2024-09-15T12:21:39.756 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.756 INFO:teuthology.orchestra.run.smithi122.stdout: osd open classes on start = true 2024-09-15T12:21:39.756 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug pg log writeout = true 2024-09-15T12:21:39.756 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.756 INFO:teuthology.orchestra.run.smithi122.stdout: osd deep scrub update digest min age = 30 2024-09-15T12:21:39.756 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.756 INFO:teuthology.orchestra.run.smithi122.stdout: osd map max advance = 10 2024-09-15T12:21:39.756 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.756 INFO:teuthology.orchestra.run.smithi122.stdout: journal zero on create = true 2024-09-15T12:21:39.756 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.757 INFO:teuthology.orchestra.run.smithi122.stdout: filestore ondisk finisher threads = 3 2024-09-15T12:21:39.757 INFO:teuthology.orchestra.run.smithi122.stdout: filestore apply finisher threads = 3 2024-09-15T12:21:39.757 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.757 INFO:teuthology.orchestra.run.smithi122.stdout: bdev debug aio = true 2024-09-15T12:21:39.757 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug misdirected ops = true 2024-09-15T12:21:39.757 INFO:teuthology.orchestra.run.smithi122.stdout: debug monc = 20 2024-09-15T12:21:39.757 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore block size = 96636764160 2024-09-15T12:21:39.757 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore compression algorithm = snappy 2024-09-15T12:21:39.757 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore compression mode = aggressive 2024-09-15T12:21:39.757 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore fsck on mount = True 2024-09-15T12:21:39.757 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore rocksdb cf = False 2024-09-15T12:21:39.757 INFO:teuthology.orchestra.run.smithi122.stdout: crimson alien thread cpu cores = 6-7 2024-09-15T12:21:39.757 INFO:teuthology.orchestra.run.smithi122.stdout: crimson osd obc lru size = 10 2024-09-15T12:21:39.758 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluefs = 20 2024-09-15T12:21:39.758 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluestore = 20 2024-09-15T12:21:39.758 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-09-15T12:21:39.758 INFO:teuthology.orchestra.run.smithi122.stdout: debug osd = 20 2024-09-15T12:21:39.758 INFO:teuthology.orchestra.run.smithi122.stdout: debug rocksdb = 10 2024-09-15T12:21:39.758 INFO:teuthology.orchestra.run.smithi122.stdout: err to stderr = True 2024-09-15T12:21:39.758 INFO:teuthology.orchestra.run.smithi122.stdout: log flush on exit = True 2024-09-15T12:21:39.758 INFO:teuthology.orchestra.run.smithi122.stdout: log to file = False 2024-09-15T12:21:39.758 INFO:teuthology.orchestra.run.smithi122.stdout: log to stderr = True 2024-09-15T12:21:39.758 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T12:21:39.758 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd full ratio = 0.9 2024-09-15T12:21:39.758 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd nearfull ratio = 0.8 2024-09-15T12:21:39.758 INFO:teuthology.orchestra.run.smithi122.stdout: osd blocked scrub grace period = 3600 2024-09-15T12:21:39.758 INFO:teuthology.orchestra.run.smithi122.stdout: osd class default list = * 2024-09-15T12:21:39.759 INFO:teuthology.orchestra.run.smithi122.stdout: osd class load list = * 2024-09-15T12:21:39.759 INFO:teuthology.orchestra.run.smithi122.stdout: osd failsafe full ratio = 0.95 2024-09-15T12:21:39.759 INFO:teuthology.orchestra.run.smithi122.stdout: osd objectstore = bluestore 2024-09-15T12:21:39.759 INFO:teuthology.orchestra.run.smithi122.stdout: osd shutdown pgref assert = True 2024-09-15T12:21:39.759 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.759 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr] 2024-09-15T12:21:39.759 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-09-15T12:21:39.759 INFO:teuthology.orchestra.run.smithi122.stdout: debug mgr = 20 2024-09-15T12:21:39.759 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-09-15T12:21:39.759 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-09-15T12:21:39.759 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-09-15T12:21:39.759 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-09-15T12:21:39.759 INFO:teuthology.orchestra.run.smithi122.stdout: mgr/telemetry/nag = false 2024-09-15T12:21:39.759 INFO:teuthology.orchestra.run.smithi122.stdout: mgr stats period = 30 2024-09-15T12:21:39.759 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.759 INFO:teuthology.orchestra.run.smithi122.stdout:[mon] 2024-09-15T12:21:39.760 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-09-15T12:21:39.760 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-09-15T12:21:39.760 INFO:teuthology.orchestra.run.smithi122.stdout: debug paxos = 20 2024-09-15T12:21:39.760 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-09-15T12:21:39.760 INFO:teuthology.orchestra.run.smithi122.stdout: mon data avail warn = 5 2024-09-15T12:21:39.760 INFO:teuthology.orchestra.run.smithi122.stdout: mon mgr mkfs grace = 240 2024-09-15T12:21:39.760 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-09-15T12:21:39.760 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd reporter subtree level = osd 2024-09-15T12:21:39.760 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd prime pg temp = true 2024-09-15T12:21:39.760 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-09-15T12:21:39.760 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.760 INFO:teuthology.orchestra.run.smithi122.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T12:21:39.760 INFO:teuthology.orchestra.run.smithi122.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T12:21:39.760 INFO:teuthology.orchestra.run.smithi122.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T12:21:39.761 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.761 INFO:teuthology.orchestra.run.smithi122.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T12:21:39.761 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T12:21:39.761 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T12:21:39.761 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.761 INFO:teuthology.orchestra.run.smithi122.stdout: # 1m isn't quite enough 2024-09-15T12:21:39.761 INFO:teuthology.orchestra.run.smithi122.stdout: mon_down_mkfs_grace = 2m 2024-09-15T12:21:39.761 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.761 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_filestore_osds = false 2024-09-15T12:21:39.761 INFO:teuthology.orchestra.run.smithi122.stdout: mon min osdmap epochs = 50 2024-09-15T12:21:39.761 INFO:teuthology.orchestra.run.smithi122.stdout: mon osdmap full prune interval = 2 2024-09-15T12:21:39.761 INFO:teuthology.orchestra.run.smithi122.stdout: mon osdmap full prune min = 15 2024-09-15T12:21:39.761 INFO:teuthology.orchestra.run.smithi122.stdout: mon osdmap full prune txsize = 2 2024-09-15T12:21:39.761 INFO:teuthology.orchestra.run.smithi122.stdout: paxos service trim min = 10 2024-09-15T12:21:39.762 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on pool no app = False 2024-09-15T12:21:39.762 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default crimson = True 2024-09-15T12:21:39.762 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:21:39.762 INFO:teuthology.orchestra.run.smithi122.stdout:[client] 2024-09-15T12:21:39.762 INFO:teuthology.orchestra.run.smithi122.stdout: rgw cache enabled = true 2024-09-15T12:21:39.762 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable ops log = true 2024-09-15T12:21:39.762 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable usage log = true 2024-09-15T12:21:39.762 INFO:teuthology.orchestra.run.smithi122.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T12:21:39.762 INFO:teuthology.orchestra.run.smithi122.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T12:21:39.762 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-09-15T12:21:39.762 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.a] 2024-09-15T12:21:39.762 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.0] 2024-09-15T12:21:39.762 INFO:teuthology.orchestra.run.smithi122.stdout: crimson seastar cpu cores = 0-2 2024-09-15T12:21:39.763 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.1] 2024-09-15T12:21:39.763 INFO:teuthology.orchestra.run.smithi122.stdout: crimson seastar cpu cores = 3-5 2024-09-15T12:21:39.763 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.2] 2024-09-15T12:21:39.763 INFO:teuthology.orchestra.run.smithi122.stdout: crimson seastar cpu cores = 0-2 2024-09-15T12:21:39.763 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.3] 2024-09-15T12:21:39.763 INFO:teuthology.orchestra.run.smithi122.stdout: crimson seastar cpu cores = 3-5 2024-09-15T12:21:39.764 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-09-15T12:21:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2024-09-15T12:21:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T12:21:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2024-09-15T12:21:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2024-09-15T12:21:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2024-09-15T12:21:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2024-09-15T12:21:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2024-09-15T12:21:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2024-09-15T12:21:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2024-09-15T12:21:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T12:21:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2024-09-15T12:21:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T12:21:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T12:21:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2024-09-15T12:21:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2024-09-15T12:21:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2024-09-15T12:21:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2024-09-15T12:21:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2024-09-15T12:21:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2024-09-15T12:21:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2024-09-15T12:21:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2024-09-15T12:21:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T12:21:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T12:21:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2024-09-15T12:21:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T12:21:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2024-09-15T12:21:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2024-09-15T12:21:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2024-09-15T12:21:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2024-09-15T12:21:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2024-09-15T12:21:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = 172.21.15.122 2024-09-15T12:21:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-15T12:21:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: ms client mode = crc 2024-09-15T12:21:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: ms cluster mode = crc 2024-09-15T12:21:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: ms mon client mode = crc 2024-09-15T12:21:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: ms mon cluster mode = crc 2024-09-15T12:21:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: ms mon service mode = crc 2024-09-15T12:21:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: ms service mode = crc 2024-09-15T12:21:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = a718c858-230d-4784-bf30-b6c766b34745 2024-09-15T12:21:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.767 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2024-09-15T12:21:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2024-09-15T12:21:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2024-09-15T12:21:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2024-09-15T12:21:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2024-09-15T12:21:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2024-09-15T12:21:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2024-09-15T12:21:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2024-09-15T12:21:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2024-09-15T12:21:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2024-09-15T12:21:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug trim objects = true 2024-09-15T12:21:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2024-09-15T12:21:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2024-09-15T12:21:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2024-09-15T12:21:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2024-09-15T12:21:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2024-09-15T12:21:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2024-09-15T12:21:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2024-09-15T12:21:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2024-09-15T12:21:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2024-09-15T12:21:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: debug monc = 20 2024-09-15T12:21:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2024-09-15T12:21:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore compression algorithm = snappy 2024-09-15T12:21:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore compression mode = aggressive 2024-09-15T12:21:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2024-09-15T12:21:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore rocksdb cf = False 2024-09-15T12:21:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: crimson alien thread cpu cores = 6-7 2024-09-15T12:21:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: crimson osd obc lru size = 10 2024-09-15T12:21:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 20 2024-09-15T12:21:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 20 2024-09-15T12:21:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-15T12:21:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2024-09-15T12:21:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 10 2024-09-15T12:21:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: err to stderr = True 2024-09-15T12:21:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: log flush on exit = True 2024-09-15T12:21:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: log to file = False 2024-09-15T12:21:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: log to stderr = True 2024-09-15T12:21:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T12:21:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2024-09-15T12:21:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2024-09-15T12:21:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: osd blocked scrub grace period = 3600 2024-09-15T12:21:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: osd class default list = * 2024-09-15T12:21:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: osd class load list = * 2024-09-15T12:21:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2024-09-15T12:21:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2024-09-15T12:21:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: osd shutdown pgref assert = True 2024-09-15T12:21:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.772 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2024-09-15T12:21:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-15T12:21:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2024-09-15T12:21:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-09-15T12:21:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-09-15T12:21:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-09-15T12:21:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-09-15T12:21:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2024-09-15T12:21:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: mgr stats period = 30 2024-09-15T12:21:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.772 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2024-09-15T12:21:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-15T12:21:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-09-15T12:21:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2024-09-15T12:21:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-09-15T12:21:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2024-09-15T12:21:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2024-09-15T12:21:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-09-15T12:21:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2024-09-15T12:21:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2024-09-15T12:21:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-09-15T12:21:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T12:21:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T12:21:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T12:21:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T12:21:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T12:21:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T12:21:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2024-09-15T12:21:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2024-09-15T12:21:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2024-09-15T12:21:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: mon min osdmap epochs = 50 2024-09-15T12:21:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: mon osdmap full prune interval = 2 2024-09-15T12:21:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: mon osdmap full prune min = 15 2024-09-15T12:21:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: mon osdmap full prune txsize = 2 2024-09-15T12:21:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: paxos service trim min = 10 2024-09-15T12:21:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on pool no app = False 2024-09-15T12:21:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default crimson = True 2024-09-15T12:21:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-15T12:21:39.775 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2024-09-15T12:21:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2024-09-15T12:21:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2024-09-15T12:21:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2024-09-15T12:21:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T12:21:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T12:21:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-15T12:21:39.775 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2024-09-15T12:21:39.775 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2024-09-15T12:21:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: crimson seastar cpu cores = 0-2 2024-09-15T12:21:39.775 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2024-09-15T12:21:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: crimson seastar cpu cores = 3-5 2024-09-15T12:21:39.776 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2024-09-15T12:21:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: crimson seastar cpu cores = 0-2 2024-09-15T12:21:39.776 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2024-09-15T12:21:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: crimson seastar cpu cores = 3-5 2024-09-15T12:21:39.777 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-15T12:21:39.777 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-15T12:21:39.881 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-15T12:21:39.881 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:21:39.881 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-15T12:21:39.896 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:21:39.896 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-15T12:21:39.951 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi122.front.sepia.ceph.com 2024-09-15T12:21:39.951 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:21:39.951 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T12:21:39.951 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T12:21:40.026 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:21:40.026 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:21:40.081 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2024-09-15T12:21:40.081 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-15T12:21:40.082 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T12:21:40.082 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T12:21:40.117 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-15T12:21:40.117 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:21:40.173 INFO:tasks.ceph:Setting up mon nodes... 2024-09-15T12:21:40.173 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-15T12:21:40.173 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T12:21:40.303 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T12:21:40.306 INFO:tasks.ceph:Setting up mds nodes... 2024-09-15T12:21:40.307 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-15T12:21:40.307 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T12:21:40.356 INFO:teuthology.orchestra.run.smithi122.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-15T12:21:40.369 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-15T12:21:40.419 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-15T12:21:40.432 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-15T12:21:40.432 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-15T12:21:40.432 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-15T12:21:40.456 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-15T12:21:40.457 INFO:tasks.ceph:role: osd.0 2024-09-15T12:21:40.457 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-15T12:21:40.457 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T12:21:40.528 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T12:21:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T12:21:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T12:21:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T12:21:40.528 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T12:21:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-09-15T12:21:40.528 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T12:21:40.528 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T12:21:40.528 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T12:21:40.528 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T12:21:41.032 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-09-15T12:21:41.033 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-09-15T12:21:41.034 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-15T12:21:41.171 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-15T12:21:41.202 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-15T12:21:41.267 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-15T12:21:41.267 INFO:tasks.ceph:role: osd.1 2024-09-15T12:21:41.267 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-15T12:21:41.267 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T12:21:41.339 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T12:21:41.339 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T12:21:41.339 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T12:21:41.339 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T12:21:41.339 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T12:21:41.340 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-09-15T12:21:41.340 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T12:21:41.340 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T12:21:41.340 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T12:21:41.340 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T12:21:41.782 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-09-15T12:21:41.784 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-09-15T12:21:41.785 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-15T12:21:41.869 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-15T12:21:41.939 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:21:42.234 INFO:teuthology.orchestra.run.smithi122.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:21:42.235 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-15 12:21:42,235 seastar - Reactor backend: linux-aio 2024-09-15T12:21:42.246 INFO:teuthology.orchestra.run.smithi122.stderr:==28020==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:21:42.368 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-15 12:21:42,367 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-15T12:21:42.368 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-15 12:21:42,367 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-15T12:21:42.368 INFO:teuthology.orchestra.run.smithi122.stderr:DEBUG 2024-09-15 12:21:42,368 [shard 0:main] seastar - reactor::drain 2024-09-15T12:21:42.876 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-15T12:21:42.877 INFO:teuthology.orchestra.run.smithi122.stderr:Suppressions used: 2024-09-15T12:21:42.877 INFO:teuthology.orchestra.run.smithi122.stderr: count bytes template 2024-09-15T12:21:42.877 INFO:teuthology.orchestra.run.smithi122.stderr: 1 8 MallocExtension::Register 2024-09-15T12:21:42.877 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-15T12:21:42.877 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-15T12:21:42.938 INFO:teuthology.orchestra.run.smithi122.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:21:42.942 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-15 12:21:42,941 seastar - Reactor backend: linux-aio 2024-09-15T12:21:42.951 INFO:teuthology.orchestra.run.smithi122.stderr:==28018==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:21:47.619 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-15T12:21:47.619 INFO:teuthology.orchestra.run.smithi122.stderr:Suppressions used: 2024-09-15T12:21:47.619 INFO:teuthology.orchestra.run.smithi122.stderr: count bytes template 2024-09-15T12:21:47.619 INFO:teuthology.orchestra.run.smithi122.stderr: 1 8 MallocExtension::Register 2024-09-15T12:21:47.619 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-15T12:21:47.619 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-15T12:21:47.641 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-15T12:21:47.665 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:21:47.943 INFO:teuthology.orchestra.run.smithi122.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:21:47.944 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-15 12:21:47,943 seastar - Reactor backend: linux-aio 2024-09-15T12:21:47.949 INFO:teuthology.orchestra.run.smithi122.stderr:==28206==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:21:48.070 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-15 12:21:48,069 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-15T12:21:48.070 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-15 12:21:48,069 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-15T12:21:48.070 INFO:teuthology.orchestra.run.smithi122.stderr:DEBUG 2024-09-15 12:21:48,070 [shard 0:main] seastar - reactor::drain 2024-09-15T12:21:48.570 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-15T12:21:48.571 INFO:teuthology.orchestra.run.smithi122.stderr:Suppressions used: 2024-09-15T12:21:48.571 INFO:teuthology.orchestra.run.smithi122.stderr: count bytes template 2024-09-15T12:21:48.571 INFO:teuthology.orchestra.run.smithi122.stderr: 1 8 MallocExtension::Register 2024-09-15T12:21:48.571 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-15T12:21:48.571 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-15T12:21:48.629 INFO:teuthology.orchestra.run.smithi122.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:21:48.633 INFO:teuthology.orchestra.run.smithi122.stderr:INFO 2024-09-15 12:21:48,632 seastar - Reactor backend: linux-aio 2024-09-15T12:21:48.652 INFO:teuthology.orchestra.run.smithi122.stderr:==28204==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:21:53.578 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-15T12:21:53.578 INFO:teuthology.orchestra.run.smithi122.stderr:Suppressions used: 2024-09-15T12:21:53.579 INFO:teuthology.orchestra.run.smithi122.stderr: count bytes template 2024-09-15T12:21:53.579 INFO:teuthology.orchestra.run.smithi122.stderr: 1 8 MallocExtension::Register 2024-09-15T12:21:53.579 INFO:teuthology.orchestra.run.smithi122.stderr:----------------------------------------------------- 2024-09-15T12:21:53.579 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-15T12:21:53.600 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-15T12:21:53.625 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-15T12:21:53.655 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-15T12:21:53.655 INFO:tasks.ceph:role: osd.2 2024-09-15T12:21:53.655 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-15T12:21:53.655 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T12:21:53.730 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T12:21:53.730 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T12:21:53.730 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T12:21:53.730 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T12:21:53.731 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T12:21:53.731 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-09-15T12:21:53.731 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T12:21:53.731 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T12:21:53.731 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T12:21:53.731 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T12:21:54.235 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-09-15T12:21:54.237 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-09-15T12:21:54.238 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-15T12:21:54.380 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-15T12:21:54.414 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-15T12:21:54.481 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-15T12:21:54.481 INFO:tasks.ceph:role: osd.3 2024-09-15T12:21:54.481 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-15T12:21:54.481 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T12:21:54.554 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T12:21:54.555 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T12:21:54.555 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T12:21:54.555 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T12:21:54.555 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T12:21:54.555 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-09-15T12:21:54.555 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T12:21:54.555 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T12:21:54.555 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T12:21:54.555 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T12:21:55.004 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-09-15T12:21:55.006 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-09-15T12:21:55.006 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-15T12:21:55.091 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-15T12:21:55.120 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:21:55.455 INFO:teuthology.orchestra.run.smithi142.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:21:55.456 INFO:teuthology.orchestra.run.smithi142.stderr:INFO 2024-09-15 12:21:55,455 seastar - Reactor backend: linux-aio 2024-09-15T12:21:55.472 INFO:teuthology.orchestra.run.smithi142.stderr:==27661==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:21:55.579 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x381b44e 0x5fdd485 0x5fdd8fa 0x6038b24 0x5fb8d06 0x5fb923a 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:21:55.579 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-15T12:21:55.597 INFO:teuthology.orchestra.run.smithi142.stderr:INFO 2024-09-15 12:21:55,597 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-15T12:21:55.597 INFO:teuthology.orchestra.run.smithi142.stderr:INFO 2024-09-15 12:21:55,597 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-15T12:21:55.598 INFO:teuthology.orchestra.run.smithi142.stderr:DEBUG 2024-09-15 12:21:55,598 [shard 0:main] seastar - reactor::drain 2024-09-15T12:21:56.154 INFO:teuthology.orchestra.run.smithi142.stderr:----------------------------------------------------- 2024-09-15T12:21:56.154 INFO:teuthology.orchestra.run.smithi142.stderr:Suppressions used: 2024-09-15T12:21:56.154 INFO:teuthology.orchestra.run.smithi142.stderr: count bytes template 2024-09-15T12:21:56.154 INFO:teuthology.orchestra.run.smithi142.stderr: 1 8 MallocExtension::Register 2024-09-15T12:21:56.154 INFO:teuthology.orchestra.run.smithi142.stderr:----------------------------------------------------- 2024-09-15T12:21:56.154 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-09-15T12:21:56.211 INFO:teuthology.orchestra.run.smithi142.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:21:56.215 INFO:teuthology.orchestra.run.smithi142.stderr:INFO 2024-09-15 12:21:56,214 seastar - Reactor backend: linux-aio 2024-09-15T12:21:56.223 INFO:teuthology.orchestra.run.smithi142.stderr:==27657==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:21:56.289 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133c7b 0xdd332 0x4b14c 0x5fb0c01 0x5fb4972 0x5fb8f6a 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:21:56.289 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-15T12:22:00.910 INFO:teuthology.orchestra.run.smithi142.stderr:----------------------------------------------------- 2024-09-15T12:22:00.911 INFO:teuthology.orchestra.run.smithi142.stderr:Suppressions used: 2024-09-15T12:22:00.911 INFO:teuthology.orchestra.run.smithi142.stderr: count bytes template 2024-09-15T12:22:00.911 INFO:teuthology.orchestra.run.smithi142.stderr: 1 8 MallocExtension::Register 2024-09-15T12:22:00.911 INFO:teuthology.orchestra.run.smithi142.stderr:----------------------------------------------------- 2024-09-15T12:22:00.911 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-09-15T12:22:00.932 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-15T12:22:00.958 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:22:01.232 INFO:teuthology.orchestra.run.smithi142.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:22:01.233 INFO:teuthology.orchestra.run.smithi142.stderr:INFO 2024-09-15 12:22:01,233 seastar - Reactor backend: linux-aio 2024-09-15T12:22:01.238 INFO:teuthology.orchestra.run.smithi142.stderr:==27848==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:22:01.361 INFO:teuthology.orchestra.run.smithi142.stderr:INFO 2024-09-15 12:22:01,360 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-15T12:22:01.361 INFO:teuthology.orchestra.run.smithi142.stderr:INFO 2024-09-15 12:22:01,360 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-15T12:22:01.362 INFO:teuthology.orchestra.run.smithi142.stderr:DEBUG 2024-09-15 12:22:01,361 [shard 0:main] seastar - reactor::drain 2024-09-15T12:22:01.874 INFO:teuthology.orchestra.run.smithi142.stderr:----------------------------------------------------- 2024-09-15T12:22:01.874 INFO:teuthology.orchestra.run.smithi142.stderr:Suppressions used: 2024-09-15T12:22:01.875 INFO:teuthology.orchestra.run.smithi142.stderr: count bytes template 2024-09-15T12:22:01.875 INFO:teuthology.orchestra.run.smithi142.stderr: 1 8 MallocExtension::Register 2024-09-15T12:22:01.875 INFO:teuthology.orchestra.run.smithi142.stderr:----------------------------------------------------- 2024-09-15T12:22:01.875 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-09-15T12:22:01.930 INFO:teuthology.orchestra.run.smithi142.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:22:01.934 INFO:teuthology.orchestra.run.smithi142.stderr:INFO 2024-09-15 12:22:01,933 seastar - Reactor backend: linux-aio 2024-09-15T12:22:01.949 INFO:teuthology.orchestra.run.smithi142.stderr:==27846==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:22:06.641 INFO:teuthology.orchestra.run.smithi142.stderr:----------------------------------------------------- 2024-09-15T12:22:06.641 INFO:teuthology.orchestra.run.smithi142.stderr:Suppressions used: 2024-09-15T12:22:06.641 INFO:teuthology.orchestra.run.smithi142.stderr: count bytes template 2024-09-15T12:22:06.641 INFO:teuthology.orchestra.run.smithi142.stderr: 1 8 MallocExtension::Register 2024-09-15T12:22:06.642 INFO:teuthology.orchestra.run.smithi142.stderr:----------------------------------------------------- 2024-09-15T12:22:06.642 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-09-15T12:22:06.663 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-15T12:22:06.688 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-15T12:22:06.688 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:22:06.688 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-15T12:22:06.721 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:22:06.721 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-15T12:22:06.790 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-15T12:22:06.790 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-15T12:22:06.815 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-15T12:22:06.815 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-15T12:22:06.879 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-15T12:22:06.880 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-15T12:22:06.944 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:22:06.944 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-15T12:22:06.963 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-15T12:22:06.963 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-15T12:22:06.999 INFO:tasks.ceph:Adding keys to all mons... 2024-09-15T12:22:06.999 DEBUG:teuthology.orchestra.run.smithi122:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T12:22:07.031 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.0] 2024-09-15T12:22:07.031 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQBX0eZm1TTeBRAAYfZn300TWi4lj7IJlmGmPw== 2024-09-15T12:22:07.031 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.1] 2024-09-15T12:22:07.031 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQBc0eZmwpqMLxAAQAtqXuTRrADa88fhxdJpnA== 2024-09-15T12:22:07.032 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr.x] 2024-09-15T12:22:07.032 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQBU0eZmRAoTEhAApsQY8jq4toztHYevyLXtnA== 2024-09-15T12:22:07.032 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.2] 2024-09-15T12:22:07.032 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQBk0eZmKDxNFhAAQHHqRKe9XUFlkd96nYN/Dg== 2024-09-15T12:22:07.032 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.3] 2024-09-15T12:22:07.032 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQBq0eZmgpqfBRAAM9HAxd9iyyOPcdx4Gv3BJw== 2024-09-15T12:22:07.032 INFO:teuthology.orchestra.run.smithi122.stdout:[client.0] 2024-09-15T12:22:07.032 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQBU0eZmB887FRAAHGO+R9lAkH8ow3y3eF485g== 2024-09-15T12:22:07.032 INFO:teuthology.orchestra.run.smithi122.stdout:[client.1] 2024-09-15T12:22:07.032 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQBU0eZmGFH1GBAA7nsmMfSD/9GkqEkEM6CNhg== 2024-09-15T12:22:07.033 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T12:22:07.146 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T12:22:07.212 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T12:22:07.272 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T12:22:07.334 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T12:22:07.394 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T12:22:07.459 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T12:22:07.523 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-15T12:22:07.523 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-15T12:22:07.547 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T12:22:07.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.686+0000 7fafaf4d0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:07.688 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.686+0000 7fafaf4d0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:07.701 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-15T12:22:07.726 DEBUG:teuthology.orchestra.run.smithi122:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:22:07.781 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-15T12:22:07.781 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-15T12:22:07.781 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-15T12:22:07.823 INFO:tasks.ceph.mon.a:Started 2024-09-15T12:22:07.824 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-15T12:22:07.824 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-15T12:22:07.824 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-15T12:22:07.826 INFO:tasks.ceph.mgr.x:Started 2024-09-15T12:22:07.827 DEBUG:tasks.ceph:set 0 configs 2024-09-15T12:22:07.827 INFO:tasks.ceph:Setting crush tunables to default 2024-09-15T12:22:07.827 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd crush tunables default 2024-09-15T12:22:07.903 INFO:tasks.ceph.mon.a.smithi122.stderr:2024-09-15T12:22:07.901+0000 7f075d84bc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:07.903 INFO:tasks.ceph.mon.a.smithi122.stderr:2024-09-15T12:22:07.901+0000 7f075d84bc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:07.903 INFO:tasks.ceph.mon.a.smithi122.stderr:2024-09-15T12:22:07.901+0000 7f075d84bc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:07.925 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-09-15T12:22:07.923+0000 7fefd243c000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:07.936 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.928+0000 7f8f08951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:07.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.935+0000 7f8f08951640 1 Processor -- start 2024-09-15T12:22:07.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.935+0000 7f8f08951640 1 -- start start 2024-09-15T12:22:07.937 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-09-15T12:22:07.935+0000 7fefd243c000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:07.937 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-09-15T12:22:07.935+0000 7fefd243c000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:07.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.936+0000 7f8f08951640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8f04134430 0x7f8f04138d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:07.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.936+0000 7f8f08951640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f04070230 con 0x7f8f0409eed0 2024-09-15T12:22:07.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.936+0000 7f8f08951640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f8f04133a10 con 0x7f8f04134430 2024-09-15T12:22:07.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.936+0000 7f8f0259c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f8f0409eed0 0x7f8f04133d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:42560/0 (socket says 172.21.15.122:42560) 2024-09-15T12:22:07.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.936+0000 7f8f01d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8f04134430 0x7f8f04138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:07.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.936+0000 7f8f0259c640 1 -- 172.21.15.122:0/1925547582 learned_addr learned my addr 172.21.15.122:0/1925547582 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:22:07.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.937+0000 7f8f0159a640 1 -- 172.21.15.122:0/1925547582 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3673038731 0 0) 0x7f8f04070230 con 0x7f8f0409eed0 2024-09-15T12:22:07.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.937+0000 7f8f0159a640 1 -- 172.21.15.122:0/1925547582 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8eec003580 con 0x7f8f0409eed0 2024-09-15T12:22:07.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.937+0000 7f8f01d9b640 1 -- 172.21.15.122:0/1925547582 >> v1:172.21.15.122:6789/0 conn(0x7f8f0409eed0 legacy=0x7f8f04133d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:07.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.937+0000 7f8f01d9b640 1 -- 172.21.15.122:0/1925547582 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f04070cb0 con 0x7f8f04134430 2024-09-15T12:22:07.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.937+0000 7f8f01d9b640 1 --2- 172.21.15.122:0/1925547582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f04134430 0x7f8f04138d30 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e8603a146b2e84 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:07.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.937+0000 7f8f0159a640 1 -- 172.21.15.122:0/1925547582 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ef8009d90 con 0x7f8f04134430 2024-09-15T12:22:07.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.937+0000 7f8f0159a640 1 -- 172.21.15.122:0/1925547582 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8ef800e230 con 0x7f8f04134430 2024-09-15T12:22:07.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.937+0000 7f8f0159a640 1 -- 172.21.15.122:0/1925547582 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ef800e4d0 con 0x7f8f04134430 2024-09-15T12:22:07.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.938+0000 7f8f08951640 1 -- 172.21.15.122:0/1925547582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f04134430 msgr2=0x7f8f04138d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:07.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.938+0000 7f8f08951640 1 --2- 172.21.15.122:0/1925547582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f04134430 0x7f8f04138d30 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:07.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.938+0000 7f8f08951640 1 -- 172.21.15.122:0/1925547582 shutdown_connections 2024-09-15T12:22:07.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.938+0000 7f8f08951640 1 --2- 172.21.15.122:0/1925547582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f04134430 0x7f8f04138d30 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:07.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.938+0000 7f8f08951640 1 -- 172.21.15.122:0/1925547582 >> 172.21.15.122:0/1925547582 conn(0x7f8f040a3000 msgr2=0x7f8f040a3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:07.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.938+0000 7f8f08951640 1 -- 172.21.15.122:0/1925547582 shutdown_connections 2024-09-15T12:22:07.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.938+0000 7f8f08951640 1 -- 172.21.15.122:0/1925547582 wait complete. 2024-09-15T12:22:07.941 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.938+0000 7f8f08951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:07.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.940+0000 7f8f08951640 1 Processor -- start 2024-09-15T12:22:07.942 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.940+0000 7f8f08951640 1 -- start start 2024-09-15T12:22:07.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.941+0000 7f8f08951640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f0409eed0 0x7f8f0412aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:07.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.941+0000 7f8f08951640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8f041335c0 con 0x7f8f0409eed0 2024-09-15T12:22:07.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.941+0000 7f8f0259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f0409eed0 0x7f8f0412aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:07.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.941+0000 7f8f0259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f0409eed0 0x7f8f0412aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57356/0 (socket says 172.21.15.122:57356) 2024-09-15T12:22:07.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.941+0000 7f8f0259c640 1 -- 172.21.15.122:0/1738903212 learned_addr learned my addr 172.21.15.122:0/1738903212 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:07.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.941+0000 7f8f0259c640 1 -- 172.21.15.122:0/1738903212 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0412dfb0 con 0x7f8f0409eed0 2024-09-15T12:22:07.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.941+0000 7f8f0259c640 1 --2- 172.21.15.122:0/1738903212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f0409eed0 0x7f8f0412aca0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:07.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.942+0000 7f8ef2ffd640 1 -- 172.21.15.122:0/1738903212 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ef4005a60 con 0x7f8f0409eed0 2024-09-15T12:22:07.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.942+0000 7f8ef2ffd640 1 -- 172.21.15.122:0/1738903212 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8ef4005bc0 con 0x7f8f0409eed0 2024-09-15T12:22:07.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.942+0000 7f8f08951640 1 -- 172.21.15.122:0/1738903212 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0412a850 con 0x7f8f0409eed0 2024-09-15T12:22:07.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.942+0000 7f8ef2ffd640 1 -- 172.21.15.122:0/1738903212 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ef4005e60 con 0x7f8f0409eed0 2024-09-15T12:22:07.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.942+0000 7f8f08951640 1 -- 172.21.15.122:0/1738903212 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f0412a4f0 con 0x7f8f0409eed0 2024-09-15T12:22:07.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.942+0000 7f8ef2ffd640 1 -- 172.21.15.122:0/1738903212 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f8ef4007440 con 0x7f8f0409eed0 2024-09-15T12:22:07.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.942+0000 7f8ef2ffd640 1 -- 172.21.15.122:0/1738903212 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (crc 0 0 0) 0x7f8ef400f8e0 con 0x7f8f0409eed0 2024-09-15T12:22:07.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.943+0000 7f8f08951640 1 -- 172.21.15.122:0/1738903212 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f04133d20 con 0x7f8f0409eed0 2024-09-15T12:22:07.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:07.945+0000 7f8ef2ffd640 1 -- 172.21.15.122:0/1738903212 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f8ef400faf0 con 0x7f8f0409eed0 2024-09-15T12:22:08.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.006+0000 7f8f08951640 1 -- 172.21.15.122:0/1738903212 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8f041391b0 con 0x7f8f0409eed0 2024-09-15T12:22:08.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.007+0000 7f8ef2ffd640 1 -- 172.21.15.122:0/1738903212 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (crc 0 0 0) 0x7f8ef400fc90 con 0x7f8f0409eed0 2024-09-15T12:22:08.009 INFO:teuthology.orchestra.run.smithi122.stderr:adjusted tunables profile to default 2024-09-15T12:22:08.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.008+0000 7f8f08951640 1 -- 172.21.15.122:0/1738903212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f0409eed0 msgr2=0x7f8f0412aca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:08.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.008+0000 7f8f08951640 1 --2- 172.21.15.122:0/1738903212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f0409eed0 0x7f8f0412aca0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:08.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.008+0000 7f8f08951640 1 -- 172.21.15.122:0/1738903212 shutdown_connections 2024-09-15T12:22:08.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.008+0000 7f8f08951640 1 --2- 172.21.15.122:0/1738903212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f0409eed0 0x7f8f0412aca0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:08.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.008+0000 7f8f08951640 1 -- 172.21.15.122:0/1738903212 >> 172.21.15.122:0/1738903212 conn(0x7f8f040a3000 msgr2=0x7f8f040a08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:08.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.009+0000 7f8f08951640 1 -- 172.21.15.122:0/1738903212 shutdown_connections 2024-09-15T12:22:08.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.009+0000 7f8f08951640 1 -- 172.21.15.122:0/1738903212 wait complete. 2024-09-15T12:22:08.021 INFO:tasks.ceph:check_enable_crimson: True 2024-09-15T12:22:08.021 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-15T12:22:08.021 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-15T12:22:08.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.119+0000 7f3944e7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:08.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.125+0000 7f3944e7d640 1 Processor -- start 2024-09-15T12:22:08.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.125+0000 7f3944e7d640 1 -- start start 2024-09-15T12:22:08.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.126+0000 7f3944e7d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f394009e910 0x7f3940069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:08.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.126+0000 7f3944e7d640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394006d370 con 0x7f394009f040 2024-09-15T12:22:08.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.126+0000 7f3944e7d640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f3940070cb0 con 0x7f394009e910 2024-09-15T12:22:08.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.127+0000 7f3935d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f394009e910 0x7f3940069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:08.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.127+0000 7f393e59c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f394009f040 0x7f3940068d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:42562/0 (socket says 172.21.15.122:42562) 2024-09-15T12:22:08.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.127+0000 7f393e59c640 1 -- 172.21.15.122:0/4187109252 learned_addr learned my addr 172.21.15.122:0/4187109252 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:22:08.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.127+0000 7f3935d9b640 1 -- 172.21.15.122:0/4187109252 >> v1:172.21.15.122:6789/0 conn(0x7f394009f040 legacy=0x7f3940068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:08.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.127+0000 7f3935d9b640 1 -- 172.21.15.122:0/4187109252 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394009c1c0 con 0x7f394009e910 2024-09-15T12:22:08.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.127+0000 7f3935d9b640 1 --2- 172.21.15.122:0/4187109252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f394009e910 0x7f3940069450 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95eaff0f1674cca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:08.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.127+0000 7f393dd9b640 1 -- 172.21.15.122:0/4187109252 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3928009d90 con 0x7f394009e910 2024-09-15T12:22:08.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.127+0000 7f393dd9b640 1 -- 172.21.15.122:0/4187109252 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f392800e230 con 0x7f394009e910 2024-09-15T12:22:08.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.127+0000 7f393dd9b640 1 -- 172.21.15.122:0/4187109252 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f392800e4d0 con 0x7f394009e910 2024-09-15T12:22:08.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.128+0000 7f3944e7d640 1 -- 172.21.15.122:0/4187109252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f394009e910 msgr2=0x7f3940069450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:08.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.128+0000 7f3944e7d640 1 --2- 172.21.15.122:0/4187109252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f394009e910 0x7f3940069450 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:08.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.128+0000 7f3944e7d640 1 -- 172.21.15.122:0/4187109252 shutdown_connections 2024-09-15T12:22:08.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.128+0000 7f3944e7d640 1 --2- 172.21.15.122:0/4187109252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f394009e910 0x7f3940069450 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:08.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.128+0000 7f3944e7d640 1 -- 172.21.15.122:0/4187109252 >> 172.21.15.122:0/4187109252 conn(0x7f39400a32a0 msgr2=0x7f39400a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:08.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.128+0000 7f3944e7d640 1 -- 172.21.15.122:0/4187109252 shutdown_connections 2024-09-15T12:22:08.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.128+0000 7f3944e7d640 1 -- 172.21.15.122:0/4187109252 wait complete. 2024-09-15T12:22:08.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.128+0000 7f3944e7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:08.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.130+0000 7f3944e7d640 1 Processor -- start 2024-09-15T12:22:08.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.130+0000 7f3944e7d640 1 -- start start 2024-09-15T12:22:08.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.131+0000 7f3944e7d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f394009e910 0x7f3940130420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:08.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.131+0000 7f3944e7d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3940131d20 con 0x7f394009e910 2024-09-15T12:22:08.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.131+0000 7f393e59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f394009e910 0x7f3940130420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:08.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.131+0000 7f393e59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f394009e910 0x7f3940130420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57366/0 (socket says 172.21.15.122:57366) 2024-09-15T12:22:08.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.131+0000 7f393e59c640 1 -- 172.21.15.122:0/2298955702 learned_addr learned my addr 172.21.15.122:0/2298955702 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:08.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.131+0000 7f393e59c640 1 -- 172.21.15.122:0/2298955702 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3940133ce0 con 0x7f394009e910 2024-09-15T12:22:08.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.131+0000 7f393e59c640 1 --2- 172.21.15.122:0/2298955702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f394009e910 0x7f3940130420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:08.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.131+0000 7f39377fe640 1 -- 172.21.15.122:0/2298955702 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3930005a60 con 0x7f394009e910 2024-09-15T12:22:08.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.131+0000 7f39377fe640 1 -- 172.21.15.122:0/2298955702 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3930005bc0 con 0x7f394009e910 2024-09-15T12:22:08.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.132+0000 7f3944e7d640 1 -- 172.21.15.122:0/2298955702 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3940132570 con 0x7f394009e910 2024-09-15T12:22:08.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.132+0000 7f39377fe640 1 -- 172.21.15.122:0/2298955702 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3930005e60 con 0x7f394009e910 2024-09-15T12:22:08.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.132+0000 7f3944e7d640 1 -- 172.21.15.122:0/2298955702 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3940133760 con 0x7f394009e910 2024-09-15T12:22:08.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.132+0000 7f39377fe640 1 -- 172.21.15.122:0/2298955702 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f393000cb80 con 0x7f394009e910 2024-09-15T12:22:08.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.132+0000 7f39377fe640 1 -- 172.21.15.122:0/2298955702 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (crc 0 0 0) 0x7f393000fa20 con 0x7f394009e910 2024-09-15T12:22:08.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.132+0000 7f3944e7d640 1 -- 172.21.15.122:0/2298955702 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3940134170 con 0x7f394009e910 2024-09-15T12:22:08.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.135+0000 7f39377fe640 1 -- 172.21.15.122:0/2298955702 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f393000f230 con 0x7f394009e910 2024-09-15T12:22:08.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:08.206+0000 7f3944e7d640 1 -- 172.21.15.122:0/2298955702 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) -- 0x7f3940068d40 con 0x7f394009e910 2024-09-15T12:22:08.208 INFO:tasks.ceph.mon.a.smithi122.stderr:2024-09-15T12:22:08.206+0000 7f07541f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-15T12:22:08.208 INFO:tasks.ceph.mon.a.smithi122.stderr:Please be aware that this feature is experimental, untested, 2024-09-15T12:22:08.208 INFO:tasks.ceph.mon.a.smithi122.stderr:unsupported, and may result in data corruption, data loss, 2024-09-15T12:22:08.208 INFO:tasks.ceph.mon.a.smithi122.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-15T12:22:08.208 INFO:tasks.ceph.mon.a.smithi122.stderr:feature with important data. 2024-09-15T12:22:08.208 INFO:tasks.ceph.mon.a.smithi122.stderr: 2024-09-15T12:22:09.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:09.008+0000 7f39377fe640 1 -- 172.21.15.122:0/2298955702 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) ==== 99+0+0 (crc 0 0 0) 0x7f393000fd50 con 0x7f394009e910 2024-09-15T12:22:09.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:09.009+0000 7f3944e7d640 1 -- 172.21.15.122:0/2298955702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f394009e910 msgr2=0x7f3940130420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:09.011 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:09.009+0000 7f3944e7d640 1 --2- 172.21.15.122:0/2298955702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f394009e910 0x7f3940130420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:09.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:09.010+0000 7f3944e7d640 1 -- 172.21.15.122:0/2298955702 shutdown_connections 2024-09-15T12:22:09.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:09.010+0000 7f3944e7d640 1 --2- 172.21.15.122:0/2298955702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f394009e910 0x7f3940130420 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:09.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:09.010+0000 7f3944e7d640 1 -- 172.21.15.122:0/2298955702 >> 172.21.15.122:0/2298955702 conn(0x7f39400a32a0 msgr2=0x7f394009fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:09.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:09.010+0000 7f3944e7d640 1 -- 172.21.15.122:0/2298955702 shutdown_connections 2024-09-15T12:22:09.012 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:09.010+0000 7f3944e7d640 1 -- 172.21.15.122:0/2298955702 wait complete. 2024-09-15T12:22:09.025 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-15T12:22:09.025 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:22:09.025 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-15T12:22:09.054 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:22:09.054 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-15T12:22:09.122 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-15T12:22:09.122 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-15T12:22:09.147 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-15T12:22:09.147 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-15T12:22:09.212 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 9dec0d05-2ec1-4006-9d4a-5af98be8e5e0 0 2024-09-15T12:22:09.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.352+0000 7f6247551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:09.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.359+0000 7f6247551640 1 Processor -- start 2024-09-15T12:22:09.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.359+0000 7f6247551640 1 -- start start 2024-09-15T12:22:09.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.359+0000 7f6247551640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f624011acb0 0x7f624011b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:09.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.360+0000 7f6247551640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62401158e0 con 0x7f6240114dc0 2024-09-15T12:22:09.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.360+0000 7f6247551640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f6240115a70 con 0x7f624011acb0 2024-09-15T12:22:09.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.360+0000 7f6244aec640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f6240114dc0 0x7f62401151d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.142:54192/0 (socket says 172.21.15.142:54192) 2024-09-15T12:22:09.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.360+0000 7f6244aec640 1 -- 172.21.15.142:0/2824428642 learned_addr learned my addr 172.21.15.142:0/2824428642 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-15T12:22:09.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.360+0000 7f62452ed640 1 --2- 172.21.15.142:0/2824428642 >> v2:172.21.15.122:3300/0 conn(0x7f624011acb0 0x7f624011b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:09.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.360+0000 7f6237fff640 1 -- 172.21.15.142:0/2824428642 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4094241599 0 0) 0x7f62401158e0 con 0x7f6240114dc0 2024-09-15T12:22:09.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.360+0000 7f6237fff640 1 -- 172.21.15.142:0/2824428642 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f622c003580 con 0x7f6240114dc0 2024-09-15T12:22:09.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.360+0000 7f62452ed640 1 -- 172.21.15.142:0/2824428642 >> v1:172.21.15.122:6789/0 conn(0x7f6240114dc0 legacy=0x7f62401151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:09.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.360+0000 7f62452ed640 1 -- 172.21.15.142:0/2824428642 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6240115be0 con 0x7f624011acb0 2024-09-15T12:22:09.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.361+0000 7f62452ed640 1 --2- 172.21.15.142:0/2824428642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f624011acb0 0x7f624011b0c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1537abd79f43cf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:09.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.361+0000 7f6237fff640 1 -- 172.21.15.142:0/2824428642 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f623c00e040 con 0x7f624011acb0 2024-09-15T12:22:09.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.361+0000 7f6237fff640 1 -- 172.21.15.142:0/2824428642 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f623c007670 con 0x7f624011acb0 2024-09-15T12:22:09.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.361+0000 7f6237fff640 1 -- 172.21.15.142:0/2824428642 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f623c007910 con 0x7f624011acb0 2024-09-15T12:22:09.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.362+0000 7f6247551640 1 -- 172.21.15.142:0/2824428642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f624011acb0 msgr2=0x7f624011b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:09.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.362+0000 7f6247551640 1 --2- 172.21.15.142:0/2824428642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f624011acb0 0x7f624011b0c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:09.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.362+0000 7f6247551640 1 -- 172.21.15.142:0/2824428642 shutdown_connections 2024-09-15T12:22:09.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.362+0000 7f6247551640 1 --2- 172.21.15.142:0/2824428642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f624011acb0 0x7f624011b0c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:09.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.362+0000 7f6247551640 1 -- 172.21.15.142:0/2824428642 >> 172.21.15.142:0/2824428642 conn(0x7f624006e9b0 msgr2=0x7f624006edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:09.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.362+0000 7f6247551640 1 -- 172.21.15.142:0/2824428642 shutdown_connections 2024-09-15T12:22:09.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.362+0000 7f6247551640 1 -- 172.21.15.142:0/2824428642 wait complete. 2024-09-15T12:22:09.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.362+0000 7f6247551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:09.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.363+0000 7f6247551640 1 Processor -- start 2024-09-15T12:22:09.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.363+0000 7f6247551640 1 -- start start 2024-09-15T12:22:09.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.363+0000 7f6247551640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6240114dc0 0x7f62401a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:09.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.363+0000 7f6247551640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f62401a9ed0 con 0x7f6240114dc0 2024-09-15T12:22:09.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.363+0000 7f62452ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6240114dc0 0x7f62401a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:09.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.363+0000 7f62452ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6240114dc0 0x7f62401a9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.142:50644/0 (socket says 172.21.15.142:50644) 2024-09-15T12:22:09.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.363+0000 7f62452ed640 1 -- 172.21.15.142:0/1693235437 learned_addr learned my addr 172.21.15.142:0/1693235437 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-15T12:22:09.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.364+0000 7f62452ed640 1 -- 172.21.15.142:0/1693235437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62401aa010 con 0x7f6240114dc0 2024-09-15T12:22:09.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.364+0000 7f62452ed640 1 --2- 172.21.15.142:0/1693235437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6240114dc0 0x7f62401a9900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:09.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.364+0000 7f6235ffb640 1 -- 172.21.15.142:0/1693235437 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f623c00e040 con 0x7f6240114dc0 2024-09-15T12:22:09.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.364+0000 7f6235ffb640 1 -- 172.21.15.142:0/1693235437 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f623c0139c0 con 0x7f6240114dc0 2024-09-15T12:22:09.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.364+0000 7f6247551640 1 -- 172.21.15.142:0/1693235437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62401aa260 con 0x7f6240114dc0 2024-09-15T12:22:09.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.364+0000 7f6235ffb640 1 -- 172.21.15.142:0/1693235437 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f623c013c60 con 0x7f6240114dc0 2024-09-15T12:22:09.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.364+0000 7f6235ffb640 1 -- 172.21.15.142:0/1693235437 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f623c011040 con 0x7f6240114dc0 2024-09-15T12:22:09.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.364+0000 7f6247551640 1 -- 172.21.15.142:0/1693235437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62401af1e0 con 0x7f6240114dc0 2024-09-15T12:22:09.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.365+0000 7f6235ffb640 1 -- 172.21.15.142:0/1693235437 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 747+0+0 (crc 0 0 0) 0x7f623c013e60 con 0x7f6240114dc0 2024-09-15T12:22:09.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.365+0000 7f6247551640 1 -- 172.21.15.142:0/1693235437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6240120cf0 con 0x7f6240114dc0 2024-09-15T12:22:09.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.368+0000 7f6235ffb640 1 -- 172.21.15.142:0/1693235437 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f623c015390 con 0x7f6240114dc0 2024-09-15T12:22:09.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.439+0000 7f6247551640 1 -- 172.21.15.142:0/1693235437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9dec0d05-2ec1-4006-9d4a-5af98be8e5e0", "id": 0} v 0) -- 0x7f624011acb0 con 0x7f6240114dc0 2024-09-15T12:22:09.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.441+0000 7f6235ffb640 1 -- 172.21.15.142:0/1693235437 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9dec0d05-2ec1-4006-9d4a-5af98be8e5e0", "id": 0}]=0 v4) ==== 112+0+2 (crc 0 0 0) 0x7f623c016a10 con 0x7f6240114dc0 2024-09-15T12:22:09.443 INFO:teuthology.orchestra.run.smithi142.stdout:0 2024-09-15T12:22:09.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.442+0000 7f6247551640 1 -- 172.21.15.142:0/1693235437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6240114dc0 msgr2=0x7f62401a9900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:09.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.442+0000 7f6247551640 1 --2- 172.21.15.142:0/1693235437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6240114dc0 0x7f62401a9900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:09.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.442+0000 7f6247551640 1 -- 172.21.15.142:0/1693235437 shutdown_connections 2024-09-15T12:22:09.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.442+0000 7f6247551640 1 --2- 172.21.15.142:0/1693235437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6240114dc0 0x7f62401a9900 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:09.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.442+0000 7f6247551640 1 -- 172.21.15.142:0/1693235437 >> 172.21.15.142:0/1693235437 conn(0x7f624006e9b0 msgr2=0x7f6240113db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:09.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.442+0000 7f6247551640 1 -- 172.21.15.142:0/1693235437 shutdown_connections 2024-09-15T12:22:09.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.442+0000 7f6247551640 1 -- 172.21.15.142:0/1693235437 wait complete. 2024-09-15T12:22:09.455 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new b0b12d81-07a4-4437-b931-939ed1a94383 1 2024-09-15T12:22:09.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.555+0000 7fcfb6e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:09.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.563+0000 7fcfb6e63640 1 Processor -- start 2024-09-15T12:22:09.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.563+0000 7fcfb6e63640 1 -- start start 2024-09-15T12:22:09.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.563+0000 7fcfb6e63640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcfb011acb0 0x7fcfb011b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:09.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.563+0000 7fcfb6e63640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfb01158e0 con 0x7fcfb0114dc0 2024-09-15T12:22:09.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.563+0000 7fcfb6e63640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fcfb0115a70 con 0x7fcfb011acb0 2024-09-15T12:22:09.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.563+0000 7fcfb4bff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcfb011acb0 0x7fcfb011b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:09.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.563+0000 7fcfaffff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fcfb0114dc0 0x7fcfb01151d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.142:54204/0 (socket says 172.21.15.142:54204) 2024-09-15T12:22:09.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.563+0000 7fcfaffff640 1 -- 172.21.15.142:0/1251195569 learned_addr learned my addr 172.21.15.142:0/1251195569 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-15T12:22:09.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.564+0000 7fcfb4bff640 1 -- 172.21.15.142:0/1251195569 >> v1:172.21.15.122:6789/0 conn(0x7fcfb0114dc0 legacy=0x7fcfb01151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:09.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.564+0000 7fcfb4bff640 1 -- 172.21.15.142:0/1251195569 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb0115be0 con 0x7fcfb011acb0 2024-09-15T12:22:09.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.564+0000 7fcfb4bff640 1 --2- 172.21.15.142:0/1251195569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb011acb0 0x7fcfb011b0c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12131242fc06349 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:09.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.564+0000 7fcfaf7fe640 1 -- 172.21.15.142:0/1251195569 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcfa4009d90 con 0x7fcfb011acb0 2024-09-15T12:22:09.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.564+0000 7fcfaf7fe640 1 -- 172.21.15.142:0/1251195569 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcfa400e230 con 0x7fcfb011acb0 2024-09-15T12:22:09.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.564+0000 7fcfaf7fe640 1 -- 172.21.15.142:0/1251195569 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcfa400e4d0 con 0x7fcfb011acb0 2024-09-15T12:22:09.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.565+0000 7fcfb6e63640 1 -- 172.21.15.142:0/1251195569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb011acb0 msgr2=0x7fcfb011b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:09.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.565+0000 7fcfb6e63640 1 --2- 172.21.15.142:0/1251195569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb011acb0 0x7fcfb011b0c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:09.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.565+0000 7fcfb6e63640 1 -- 172.21.15.142:0/1251195569 shutdown_connections 2024-09-15T12:22:09.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.565+0000 7fcfb6e63640 1 --2- 172.21.15.142:0/1251195569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb011acb0 0x7fcfb011b0c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:09.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.565+0000 7fcfb6e63640 1 -- 172.21.15.142:0/1251195569 >> 172.21.15.142:0/1251195569 conn(0x7fcfb006e9b0 msgr2=0x7fcfb006edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:09.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.565+0000 7fcfb6e63640 1 -- 172.21.15.142:0/1251195569 shutdown_connections 2024-09-15T12:22:09.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.565+0000 7fcfb6e63640 1 -- 172.21.15.142:0/1251195569 wait complete. 2024-09-15T12:22:09.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.565+0000 7fcfb6e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:09.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.566+0000 7fcfb6e63640 1 Processor -- start 2024-09-15T12:22:09.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.566+0000 7fcfb6e63640 1 -- start start 2024-09-15T12:22:09.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.567+0000 7fcfb6e63640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0114dc0 0x7fcfb01a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:09.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.567+0000 7fcfb6e63640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb01aa090 con 0x7fcfb0114dc0 2024-09-15T12:22:09.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.567+0000 7fcfb4bff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0114dc0 0x7fcfb01a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:09.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.567+0000 7fcfb4bff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0114dc0 0x7fcfb01a9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.142:50662/0 (socket says 172.21.15.142:50662) 2024-09-15T12:22:09.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.567+0000 7fcfb4bff640 1 -- 172.21.15.142:0/1667364212 learned_addr learned my addr 172.21.15.142:0/1667364212 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-15T12:22:09.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.567+0000 7fcfb4bff640 1 -- 172.21.15.142:0/1667364212 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb01aa1d0 con 0x7fcfb0114dc0 2024-09-15T12:22:09.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.568+0000 7fcfb4bff640 1 --2- 172.21.15.142:0/1667364212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0114dc0 0x7fcfb01a9ac0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:09.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.568+0000 7fcfad7fa640 1 -- 172.21.15.142:0/1667364212 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcfa4014620 con 0x7fcfb0114dc0 2024-09-15T12:22:09.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.568+0000 7fcfad7fa640 1 -- 172.21.15.142:0/1667364212 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcfa4014780 con 0x7fcfb0114dc0 2024-09-15T12:22:09.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.568+0000 7fcfad7fa640 1 -- 172.21.15.142:0/1667364212 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcfa4014a20 con 0x7fcfb0114dc0 2024-09-15T12:22:09.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.568+0000 7fcfb6e63640 1 -- 172.21.15.142:0/1667364212 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb01aa420 con 0x7fcfb0114dc0 2024-09-15T12:22:09.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.568+0000 7fcfb6e63640 1 -- 172.21.15.142:0/1667364212 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb01af3a0 con 0x7fcfb0114dc0 2024-09-15T12:22:09.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.568+0000 7fcfad7fa640 1 -- 172.21.15.142:0/1667364212 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fcfa4013400 con 0x7fcfb0114dc0 2024-09-15T12:22:09.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.568+0000 7fcfad7fa640 1 -- 172.21.15.142:0/1667364212 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 862+0+0 (crc 0 0 0) 0x7fcfa4019040 con 0x7fcfb0114dc0 2024-09-15T12:22:09.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.569+0000 7fcfb6e63640 1 -- 172.21.15.142:0/1667364212 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfb0120cf0 con 0x7fcfb0114dc0 2024-09-15T12:22:09.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.571+0000 7fcfad7fa640 1 -- 172.21.15.142:0/1667364212 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fcfa4013890 con 0x7fcfb0114dc0 2024-09-15T12:22:09.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.641+0000 7fcfb6e63640 1 -- 172.21.15.142:0/1667364212 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b0b12d81-07a4-4437-b931-939ed1a94383", "id": 1} v 0) -- 0x7fcfb0120ed0 con 0x7fcfb0114dc0 2024-09-15T12:22:09.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.643+0000 7fcfad7fa640 1 -- 172.21.15.142:0/1667364212 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b0b12d81-07a4-4437-b931-939ed1a94383", "id": 1}]=0 v5) ==== 112+0+2 (crc 0 0 0) 0x7fcfa4013b00 con 0x7fcfb0114dc0 2024-09-15T12:22:09.645 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-09-15T12:22:09.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.644+0000 7fcfb6e63640 1 -- 172.21.15.142:0/1667364212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0114dc0 msgr2=0x7fcfb01a9ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:09.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.644+0000 7fcfb6e63640 1 --2- 172.21.15.142:0/1667364212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0114dc0 0x7fcfb01a9ac0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:09.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.644+0000 7fcfb6e63640 1 -- 172.21.15.142:0/1667364212 shutdown_connections 2024-09-15T12:22:09.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.644+0000 7fcfb6e63640 1 --2- 172.21.15.142:0/1667364212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0114dc0 0x7fcfb01a9ac0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:09.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.644+0000 7fcfb6e63640 1 -- 172.21.15.142:0/1667364212 >> 172.21.15.142:0/1667364212 conn(0x7fcfb006e9b0 msgr2=0x7fcfb0113db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:09.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.644+0000 7fcfb6e63640 1 -- 172.21.15.142:0/1667364212 shutdown_connections 2024-09-15T12:22:09.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.644+0000 7fcfb6e63640 1 -- 172.21.15.142:0/1667364212 wait complete. 2024-09-15T12:22:09.657 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new f4153355-ac6b-4693-bea0-9e8c15a6bd88 2 2024-09-15T12:22:09.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.757+0000 7f98afb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:09.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.763+0000 7f98afb51640 1 Processor -- start 2024-09-15T12:22:09.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.763+0000 7f98afb51640 1 -- start start 2024-09-15T12:22:09.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.764+0000 7f98afb51640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f98a8118ad0 0x7f98a8118ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:09.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.764+0000 7f98afb51640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98a81138d0 con 0x7f98a8112db0 2024-09-15T12:22:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.764+0000 7f98afb51640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f98a8113a60 con 0x7f98a8118ad0 2024-09-15T12:22:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.764+0000 7f98ad0ec640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f98a8112db0 0x7f98a81131c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.142:54206/0 (socket says 172.21.15.142:54206) 2024-09-15T12:22:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.764+0000 7f98ad8ed640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f98a8118ad0 0x7f98a8118ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.764+0000 7f98ad0ec640 1 -- 172.21.15.142:0/1110277853 learned_addr learned my addr 172.21.15.142:0/1110277853 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-09-15T12:22:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.764+0000 7f98ac8eb640 1 -- 172.21.15.142:0/1110277853 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612947754 0 0) 0x7f98a81138d0 con 0x7f98a8112db0 2024-09-15T12:22:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.764+0000 7f98ac8eb640 1 -- 172.21.15.142:0/1110277853 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9894003580 con 0x7f98a8112db0 2024-09-15T12:22:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.765+0000 7f98ad8ed640 1 -- 172.21.15.142:0/1110277853 >> v1:172.21.15.122:6789/0 conn(0x7f98a8112db0 legacy=0x7f98a81131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.765+0000 7f98ad8ed640 1 -- 172.21.15.142:0/1110277853 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a8113bd0 con 0x7f98a8118ad0 2024-09-15T12:22:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.765+0000 7f98ad8ed640 1 --2- 172.21.15.142:0/1110277853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a8118ad0 0x7f98a8118ee0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f061101b29f2f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.765+0000 7f98ac8eb640 1 -- 172.21.15.142:0/1110277853 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f98a4009d90 con 0x7f98a8118ad0 2024-09-15T12:22:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.765+0000 7f98ac8eb640 1 -- 172.21.15.142:0/1110277853 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f98a400e230 con 0x7f98a8118ad0 2024-09-15T12:22:09.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.765+0000 7f98ac8eb640 1 -- 172.21.15.142:0/1110277853 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f98a400e4d0 con 0x7f98a8118ad0 2024-09-15T12:22:09.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.766+0000 7f98afb51640 1 -- 172.21.15.142:0/1110277853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a8118ad0 msgr2=0x7f98a8118ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:09.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.766+0000 7f98afb51640 1 --2- 172.21.15.142:0/1110277853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a8118ad0 0x7f98a8118ee0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:09.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.766+0000 7f98afb51640 1 -- 172.21.15.142:0/1110277853 shutdown_connections 2024-09-15T12:22:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.766+0000 7f98afb51640 1 --2- 172.21.15.142:0/1110277853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a8118ad0 0x7f98a8118ee0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.766+0000 7f98afb51640 1 -- 172.21.15.142:0/1110277853 >> 172.21.15.142:0/1110277853 conn(0x7f98a8071fb0 msgr2=0x7f98a8074400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.766+0000 7f98afb51640 1 -- 172.21.15.142:0/1110277853 shutdown_connections 2024-09-15T12:22:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.766+0000 7f98afb51640 1 -- 172.21.15.142:0/1110277853 wait complete. 2024-09-15T12:22:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.766+0000 7f98afb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.767+0000 7f98afb51640 1 Processor -- start 2024-09-15T12:22:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.767+0000 7f98afb51640 1 -- start start 2024-09-15T12:22:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.767+0000 7f98afb51640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a8112db0 0x7f98a81a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.767+0000 7f98afb51640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f98a81a7d30 con 0x7f98a8112db0 2024-09-15T12:22:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.768+0000 7f98ad8ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a8112db0 0x7f98a81a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.768+0000 7f98ad8ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a8112db0 0x7f98a81a7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.142:50668/0 (socket says 172.21.15.142:50668) 2024-09-15T12:22:09.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.768+0000 7f98ad8ed640 1 -- 172.21.15.142:0/2523405267 learned_addr learned my addr 172.21.15.142:0/2523405267 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-15T12:22:09.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.768+0000 7f98ad8ed640 1 -- 172.21.15.142:0/2523405267 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a81a7e70 con 0x7f98a8112db0 2024-09-15T12:22:09.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.768+0000 7f98ad8ed640 1 --2- 172.21.15.142:0/2523405267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a8112db0 0x7f98a81a7760 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:09.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.768+0000 7f989e7fc640 1 -- 172.21.15.142:0/2523405267 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f98a4014410 con 0x7f98a8112db0 2024-09-15T12:22:09.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.768+0000 7f989e7fc640 1 -- 172.21.15.142:0/2523405267 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f98a4014570 con 0x7f98a8112db0 2024-09-15T12:22:09.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.768+0000 7f98afb51640 1 -- 172.21.15.142:0/2523405267 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a81a80c0 con 0x7f98a8112db0 2024-09-15T12:22:09.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.768+0000 7f989e7fc640 1 -- 172.21.15.142:0/2523405267 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f98a4014810 con 0x7f98a8112db0 2024-09-15T12:22:09.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.768+0000 7f98afb51640 1 -- 172.21.15.142:0/2523405267 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a81ad040 con 0x7f98a8112db0 2024-09-15T12:22:09.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.769+0000 7f989e7fc640 1 -- 172.21.15.142:0/2523405267 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f98a4013400 con 0x7f98a8112db0 2024-09-15T12:22:09.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.769+0000 7f989e7fc640 1 -- 172.21.15.142:0/2523405267 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 977+0+0 (crc 0 0 0) 0x7f98a4019040 con 0x7f98a8112db0 2024-09-15T12:22:09.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.770+0000 7f98afb51640 1 -- 172.21.15.142:0/2523405267 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a811eb10 con 0x7f98a8112db0 2024-09-15T12:22:09.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.772+0000 7f989e7fc640 1 -- 172.21.15.142:0/2523405267 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f98a40116f0 con 0x7f98a8112db0 2024-09-15T12:22:09.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.843+0000 7f98afb51640 1 -- 172.21.15.142:0/2523405267 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f4153355-ac6b-4693-bea0-9e8c15a6bd88", "id": 2} v 0) -- 0x7f98a811eca0 con 0x7f98a8112db0 2024-09-15T12:22:09.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.845+0000 7f989e7fc640 1 -- 172.21.15.142:0/2523405267 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f4153355-ac6b-4693-bea0-9e8c15a6bd88", "id": 2}]=0 v6) ==== 112+0+2 (crc 0 0 0) 0x7f98a40059f0 con 0x7f98a8112db0 2024-09-15T12:22:09.847 INFO:teuthology.orchestra.run.smithi142.stdout:2 2024-09-15T12:22:09.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.846+0000 7f98afb51640 1 -- 172.21.15.142:0/2523405267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a8112db0 msgr2=0x7f98a81a7760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:09.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.846+0000 7f98afb51640 1 --2- 172.21.15.142:0/2523405267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a8112db0 0x7f98a81a7760 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:09.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.846+0000 7f98afb51640 1 -- 172.21.15.142:0/2523405267 shutdown_connections 2024-09-15T12:22:09.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.846+0000 7f98afb51640 1 --2- 172.21.15.142:0/2523405267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98a8112db0 0x7f98a81a7760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:09.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.846+0000 7f98afb51640 1 -- 172.21.15.142:0/2523405267 >> 172.21.15.142:0/2523405267 conn(0x7f98a8071fb0 msgr2=0x7f98a81174c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:09.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.846+0000 7f98afb51640 1 -- 172.21.15.142:0/2523405267 shutdown_connections 2024-09-15T12:22:09.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.846+0000 7f98afb51640 1 -- 172.21.15.142:0/2523405267 wait complete. 2024-09-15T12:22:09.859 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 70efb372-12e1-471e-a1f6-0d2814bbf30f 3 2024-09-15T12:22:09.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.958+0000 7fb946111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:09.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.964+0000 7fb946111640 1 Processor -- start 2024-09-15T12:22:09.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.965+0000 7fb946111640 1 -- start start 2024-09-15T12:22:09.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.965+0000 7fb946111640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb94011acb0 0x7fb94011b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:09.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.965+0000 7fb946111640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9401158e0 con 0x7fb940114dc0 2024-09-15T12:22:09.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.965+0000 7fb946111640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb940115a70 con 0x7fb94011acb0 2024-09-15T12:22:09.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.965+0000 7fb93f7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb94011acb0 0x7fb94011b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:09.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.965+0000 7fb93f7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb94011acb0 0x7fb94011b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.142:50680/0 (socket says 172.21.15.142:50680) 2024-09-15T12:22:09.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.965+0000 7fb93f7fe640 1 -- 172.21.15.142:0/844268840 learned_addr learned my addr 172.21.15.142:0/844268840 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-15T12:22:09.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.965+0000 7fb937fff640 1 --1- 172.21.15.142:0/844268840 >> v1:172.21.15.122:6789/0 conn(0x7fb940114dc0 0x7fb9401151d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.142:54214/0 (socket says 172.21.15.142:54214) 2024-09-15T12:22:09.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.966+0000 7fb93f7fe640 1 -- 172.21.15.142:0/844268840 >> v1:172.21.15.122:6789/0 conn(0x7fb940114dc0 legacy=0x7fb9401151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:09.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.966+0000 7fb93f7fe640 1 -- 172.21.15.142:0/844268840 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb940115be0 con 0x7fb94011acb0 2024-09-15T12:22:09.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.966+0000 7fb93f7fe640 1 --2- 172.21.15.142:0/844268840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb94011acb0 0x7fb94011b0c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13efe2f8847d1b6f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:09.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.966+0000 7fb93effd640 1 -- 172.21.15.142:0/844268840 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb930009e50 con 0x7fb94011acb0 2024-09-15T12:22:09.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.966+0000 7fb93effd640 1 -- 172.21.15.142:0/844268840 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb93000e230 con 0x7fb94011acb0 2024-09-15T12:22:09.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.966+0000 7fb93effd640 1 -- 172.21.15.142:0/844268840 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb93000e4d0 con 0x7fb94011acb0 2024-09-15T12:22:09.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.967+0000 7fb946111640 1 -- 172.21.15.142:0/844268840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb94011acb0 msgr2=0x7fb94011b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:09.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.967+0000 7fb946111640 1 --2- 172.21.15.142:0/844268840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb94011acb0 0x7fb94011b0c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.967+0000 7fb946111640 1 -- 172.21.15.142:0/844268840 shutdown_connections 2024-09-15T12:22:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.967+0000 7fb946111640 1 --2- 172.21.15.142:0/844268840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb94011acb0 0x7fb94011b0c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.967+0000 7fb946111640 1 -- 172.21.15.142:0/844268840 >> 172.21.15.142:0/844268840 conn(0x7fb94006e9b0 msgr2=0x7fb94006edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.967+0000 7fb946111640 1 -- 172.21.15.142:0/844268840 shutdown_connections 2024-09-15T12:22:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.967+0000 7fb946111640 1 -- 172.21.15.142:0/844268840 wait complete. 2024-09-15T12:22:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.967+0000 7fb946111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.968+0000 7fb946111640 1 Processor -- start 2024-09-15T12:22:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.968+0000 7fb946111640 1 -- start start 2024-09-15T12:22:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.968+0000 7fb946111640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb940114dc0 0x7fb9401a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:09.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.968+0000 7fb946111640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb9401aa090 con 0x7fb940114dc0 2024-09-15T12:22:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.969+0000 7fb93f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb940114dc0 0x7fb9401a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.969+0000 7fb93f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb940114dc0 0x7fb9401a9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.142:50696/0 (socket says 172.21.15.142:50696) 2024-09-15T12:22:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.969+0000 7fb93f7fe640 1 -- 172.21.15.142:0/2243170736 learned_addr learned my addr 172.21.15.142:0/2243170736 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-15T12:22:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.969+0000 7fb93f7fe640 1 -- 172.21.15.142:0/2243170736 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9401aa1d0 con 0x7fb940114dc0 2024-09-15T12:22:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.969+0000 7fb93f7fe640 1 --2- 172.21.15.142:0/2243170736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb940114dc0 0x7fb9401a9ac0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.969+0000 7fb93cff9640 1 -- 172.21.15.142:0/2243170736 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb93000eea0 con 0x7fb940114dc0 2024-09-15T12:22:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.969+0000 7fb93cff9640 1 -- 172.21.15.142:0/2243170736 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb930015420 con 0x7fb940114dc0 2024-09-15T12:22:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.969+0000 7fb946111640 1 -- 172.21.15.142:0/2243170736 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9401aa420 con 0x7fb940114dc0 2024-09-15T12:22:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.970+0000 7fb93cff9640 1 -- 172.21.15.142:0/2243170736 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb9300156c0 con 0x7fb940114dc0 2024-09-15T12:22:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.970+0000 7fb946111640 1 -- 172.21.15.142:0/2243170736 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9401af3a0 con 0x7fb940114dc0 2024-09-15T12:22:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.970+0000 7fb93cff9640 1 -- 172.21.15.142:0/2243170736 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fb930015c50 con 0x7fb940114dc0 2024-09-15T12:22:09.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.970+0000 7fb93cff9640 1 -- 172.21.15.142:0/2243170736 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1092+0+0 (crc 0 0 0) 0x7fb930014860 con 0x7fb940114dc0 2024-09-15T12:22:09.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.971+0000 7fb946111640 1 -- 172.21.15.142:0/2243170736 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb940120cf0 con 0x7fb940114dc0 2024-09-15T12:22:09.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:09.974+0000 7fb93cff9640 1 -- 172.21.15.142:0/2243170736 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fb930014a20 con 0x7fb940114dc0 2024-09-15T12:22:10.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:10.045+0000 7fb946111640 1 -- 172.21.15.142:0/2243170736 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "70efb372-12e1-471e-a1f6-0d2814bbf30f", "id": 3} v 0) -- 0x7fb940120ed0 con 0x7fb940114dc0 2024-09-15T12:22:10.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:10.046+0000 7fb93cff9640 1 -- 172.21.15.142:0/2243170736 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70efb372-12e1-471e-a1f6-0d2814bbf30f", "id": 3}]=0 v7) ==== 112+0+2 (crc 0 0 0) 0x7fb9300143b0 con 0x7fb940114dc0 2024-09-15T12:22:10.049 INFO:teuthology.orchestra.run.smithi142.stdout:3 2024-09-15T12:22:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:10.047+0000 7fb946111640 1 -- 172.21.15.142:0/2243170736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb940114dc0 msgr2=0x7fb9401a9ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:10.047+0000 7fb946111640 1 --2- 172.21.15.142:0/2243170736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb940114dc0 0x7fb9401a9ac0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:10.047+0000 7fb946111640 1 -- 172.21.15.142:0/2243170736 shutdown_connections 2024-09-15T12:22:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:10.047+0000 7fb946111640 1 --2- 172.21.15.142:0/2243170736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb940114dc0 0x7fb9401a9ac0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:10.047+0000 7fb946111640 1 -- 172.21.15.142:0/2243170736 >> 172.21.15.142:0/2243170736 conn(0x7fb94006e9b0 msgr2=0x7fb940113db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:10.047+0000 7fb946111640 1 -- 172.21.15.142:0/2243170736 shutdown_connections 2024-09-15T12:22:10.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-15T12:22:10.047+0000 7fb946111640 1 -- 172.21.15.142:0/2243170736 wait complete. 2024-09-15T12:22:10.060 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-15T12:22:10.096 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-15T12:22:10.096 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-15T12:22:10.139 INFO:tasks.ceph.osd.0:Started 2024-09-15T12:22:10.139 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-15T12:22:10.173 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-15T12:22:10.173 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-15T12:22:10.216 INFO:tasks.ceph.osd.1:Started 2024-09-15T12:22:10.216 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-15T12:22:10.245 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-15T12:22:10.246 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-15T12:22:10.288 INFO:tasks.ceph.osd.2:Started 2024-09-15T12:22:10.288 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-15T12:22:10.317 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-15T12:22:10.317 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-15T12:22:10.359 INFO:tasks.ceph.osd.3:Started 2024-09-15T12:22:10.360 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:22:10.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.468+0000 7fad008c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:10.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.473+0000 7fad008c8640 1 Processor -- start 2024-09-15T12:22:10.475 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.473+0000 7fad008c8640 1 -- start start 2024-09-15T12:22:10.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.474+0000 7fad008c8640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7facfc09d570 0x7facfc13b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:10.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.474+0000 7fad008c8640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facfc0a0060 con 0x7facfc09ca50 2024-09-15T12:22:10.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.474+0000 7fad008c8640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7facfc09fd30 con 0x7facfc09d570 2024-09-15T12:22:10.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.474+0000 7facf9d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7facfc09d570 0x7facfc13b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:10.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.474+0000 7facfa59c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7facfc09ca50 0x7facfc09ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:42574/0 (socket says 172.21.15.122:42574) 2024-09-15T12:22:10.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.475+0000 7facf9d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7facfc09d570 0x7facfc13b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57376/0 (socket says 172.21.15.122:57376) 2024-09-15T12:22:10.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.475+0000 7facfa59c640 1 -- 172.21.15.122:0/765418966 learned_addr learned my addr 172.21.15.122:0/765418966 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:22:10.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.475+0000 7facf9d9b640 1 -- 172.21.15.122:0/765418966 >> v1:172.21.15.122:6789/0 conn(0x7facfc09ca50 legacy=0x7facfc09ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:10.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.475+0000 7facf9d9b640 1 -- 172.21.15.122:0/765418966 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facfc09e3c0 con 0x7facfc09d570 2024-09-15T12:22:10.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.475+0000 7facf9d9b640 1 --2- 172.21.15.122:0/765418966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facfc09d570 0x7facfc13b3b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ace4986cf41b32c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:10.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.475+0000 7facf959a640 1 -- 172.21.15.122:0/765418966 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7facec009d80 con 0x7facfc09d570 2024-09-15T12:22:10.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.475+0000 7facf959a640 1 -- 172.21.15.122:0/765418966 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7facec00e230 con 0x7facfc09d570 2024-09-15T12:22:10.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.475+0000 7facf959a640 1 -- 172.21.15.122:0/765418966 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7facec00e4d0 con 0x7facfc09d570 2024-09-15T12:22:10.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.476+0000 7fad008c8640 1 -- 172.21.15.122:0/765418966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facfc09d570 msgr2=0x7facfc13b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:10.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.476+0000 7fad008c8640 1 --2- 172.21.15.122:0/765418966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facfc09d570 0x7facfc13b3b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:10.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.476+0000 7fad008c8640 1 -- 172.21.15.122:0/765418966 shutdown_connections 2024-09-15T12:22:10.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.476+0000 7fad008c8640 1 --2- 172.21.15.122:0/765418966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facfc09d570 0x7facfc13b3b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:10.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.476+0000 7fad008c8640 1 -- 172.21.15.122:0/765418966 >> 172.21.15.122:0/765418966 conn(0x7facfc0a5230 msgr2=0x7facfc0a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:10.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.476+0000 7fad008c8640 1 -- 172.21.15.122:0/765418966 shutdown_connections 2024-09-15T12:22:10.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.476+0000 7fad008c8640 1 -- 172.21.15.122:0/765418966 wait complete. 2024-09-15T12:22:10.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.476+0000 7fad008c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:10.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.478+0000 7fad008c8640 1 Processor -- start 2024-09-15T12:22:10.480 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.478+0000 7fad008c8640 1 -- start start 2024-09-15T12:22:10.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.479+0000 7fad008c8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facfc09ca50 0x7facfc122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:10.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.479+0000 7fad008c8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7facfc124260 con 0x7facfc09ca50 2024-09-15T12:22:10.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.479+0000 7facfa59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facfc09ca50 0x7facfc122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:10.481 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.479+0000 7facfa59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facfc09ca50 0x7facfc122dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57390/0 (socket says 172.21.15.122:57390) 2024-09-15T12:22:10.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.479+0000 7facfa59c640 1 -- 172.21.15.122:0/3999829954 learned_addr learned my addr 172.21.15.122:0/3999829954 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:10.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.479+0000 7facfa59c640 1 -- 172.21.15.122:0/3999829954 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facfc126cf0 con 0x7facfc09ca50 2024-09-15T12:22:10.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.479+0000 7facfa59c640 1 --2- 172.21.15.122:0/3999829954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facfc09ca50 0x7facfc122dc0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:10.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.479+0000 7faceaffd640 1 -- 172.21.15.122:0/3999829954 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7facf0005a60 con 0x7facfc09ca50 2024-09-15T12:22:10.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.480+0000 7faceaffd640 1 -- 172.21.15.122:0/3999829954 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7facf0005bc0 con 0x7facfc09ca50 2024-09-15T12:22:10.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.480+0000 7faceaffd640 1 -- 172.21.15.122:0/3999829954 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7facf0005e60 con 0x7facfc09ca50 2024-09-15T12:22:10.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.480+0000 7fad008c8640 1 -- 172.21.15.122:0/3999829954 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facfc1269c0 con 0x7facfc09ca50 2024-09-15T12:22:10.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.480+0000 7fad008c8640 1 -- 172.21.15.122:0/3999829954 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facfc126620 con 0x7facfc09ca50 2024-09-15T12:22:10.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.480+0000 7faceaffd640 1 -- 172.21.15.122:0/3999829954 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7facf0007440 con 0x7facfc09ca50 2024-09-15T12:22:10.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.480+0000 7faceaffd640 1 -- 172.21.15.122:0/3999829954 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7facf000fb60 con 0x7facfc09ca50 2024-09-15T12:22:10.483 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.481+0000 7fad008c8640 1 -- 172.21.15.122:0/3999829954 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facfc125120 con 0x7facfc09ca50 2024-09-15T12:22:10.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.483+0000 7faceaffd640 1 -- 172.21.15.122:0/3999829954 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7facf000fdc0 con 0x7facfc09ca50 2024-09-15T12:22:10.544 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.543+0000 7fad008c8640 1 -- 172.21.15.122:0/3999829954 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7facfc09ce60 con 0x7facfc09ca50 2024-09-15T12:22:10.545 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.543+0000 7faceaffd640 1 -- 172.21.15.122:0/3999829954 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7facf000f640 con 0x7facfc09ca50 2024-09-15T12:22:10.545 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:22:10.545 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":7,"fsid":"a718c858-230d-4784-bf30-b6c766b34745","created":"2024-09-15T12:22:07.924324+0000","modified":"2024-09-15T12:22:10.047645+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T12:22:10.047645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"9dec0d05-2ec1-4006-9d4a-5af98be8e5e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b0b12d81-07a4-4437-b931-939ed1a94383","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f4153355-ac6b-4693-bea0-9e8c15a6bd88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"70efb372-12e1-471e-a1f6-0d2814bbf30f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:22:10.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.544+0000 7fad008c8640 1 -- 172.21.15.122:0/3999829954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facfc09ca50 msgr2=0x7facfc122dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:10.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.544+0000 7fad008c8640 1 --2- 172.21.15.122:0/3999829954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facfc09ca50 0x7facfc122dc0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:10.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.544+0000 7fad008c8640 1 -- 172.21.15.122:0/3999829954 shutdown_connections 2024-09-15T12:22:10.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.544+0000 7fad008c8640 1 --2- 172.21.15.122:0/3999829954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facfc09ca50 0x7facfc122dc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:10.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.544+0000 7fad008c8640 1 -- 172.21.15.122:0/3999829954 >> 172.21.15.122:0/3999829954 conn(0x7facfc0a5230 msgr2=0x7facfc0a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:10.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.544+0000 7fad008c8640 1 -- 172.21.15.122:0/3999829954 shutdown_connections 2024-09-15T12:22:10.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:10.545+0000 7fad008c8640 1 -- 172.21.15.122:0/3999829954 wait complete. 2024-09-15T12:22:10.557 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-15T12:22:10.557 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-15T12:22:10.960 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T12:22:11.064 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.058+0000 7f7a3bf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:11.065 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.063+0000 7f7a3bf51640 1 Processor -- start 2024-09-15T12:22:11.065 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.064+0000 7f7a3bf51640 1 -- start start 2024-09-15T12:22:11.067 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.065+0000 7f7a3bf51640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7a3409f990 0x7f7a3409fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:11.067 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.065+0000 7f7a3bf51640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a340a8300 con 0x7f7a340a02e0 2024-09-15T12:22:11.067 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.065+0000 7f7a3bf51640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f7a340a14b0 con 0x7f7a3409f990 2024-09-15T12:22:11.067 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.065+0000 7f7a39ced640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7a3409f990 0x7f7a3409fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:11.068 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.065+0000 7f7a394ec640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f7a340a02e0 0x7f7a3413a600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:42588/0 (socket says 172.21.15.122:42588) 2024-09-15T12:22:11.068 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.065+0000 7f7a394ec640 1 -- 172.21.15.122:0/4233068212 learned_addr learned my addr 172.21.15.122:0/4233068212 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:22:11.068 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.065+0000 7f7a39ced640 1 --2- 172.21.15.122:0/4233068212 >> v2:172.21.15.122:3300/0 conn(0x7f7a3409f990 0x7f7a3409fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57404/0 (socket says 172.21.15.122:57404) 2024-09-15T12:22:11.068 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.065+0000 7f7a39ced640 1 -- 172.21.15.122:0/4233068212 >> v1:172.21.15.122:6789/0 conn(0x7f7a340a02e0 legacy=0x7f7a3413a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:11.068 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.065+0000 7f7a39ced640 1 -- 172.21.15.122:0/4233068212 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a340a1710 con 0x7f7a3409f990 2024-09-15T12:22:11.068 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.065+0000 7f7a39ced640 1 --2- 172.21.15.122:0/4233068212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3409f990 0x7f7a3409fda0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db08ddddda1c2d56 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:11.068 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.065+0000 7f7a38ceb640 1 -- 172.21.15.122:0/4233068212 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7a24009d90 con 0x7f7a3409f990 2024-09-15T12:22:11.068 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.065+0000 7f7a38ceb640 1 -- 172.21.15.122:0/4233068212 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7a2400e230 con 0x7f7a3409f990 2024-09-15T12:22:11.068 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.065+0000 7f7a38ceb640 1 -- 172.21.15.122:0/4233068212 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7a2400e4d0 con 0x7f7a3409f990 2024-09-15T12:22:11.070 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.066+0000 7f7a3bf51640 1 -- 172.21.15.122:0/4233068212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3409f990 msgr2=0x7f7a3409fda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:11.070 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.066+0000 7f7a3bf51640 1 --2- 172.21.15.122:0/4233068212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3409f990 0x7f7a3409fda0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:11.070 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.066+0000 7f7a3bf51640 1 -- 172.21.15.122:0/4233068212 shutdown_connections 2024-09-15T12:22:11.070 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.066+0000 7f7a3bf51640 1 --2- 172.21.15.122:0/4233068212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3409f990 0x7f7a3409fda0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:11.070 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.066+0000 7f7a3bf51640 1 -- 172.21.15.122:0/4233068212 >> 172.21.15.122:0/4233068212 conn(0x7f7a340a6390 msgr2=0x7f7a340a67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:11.070 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.067+0000 7f7a3bf51640 1 -- 172.21.15.122:0/4233068212 shutdown_connections 2024-09-15T12:22:11.070 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.067+0000 7f7a3bf51640 1 -- 172.21.15.122:0/4233068212 wait complete. 2024-09-15T12:22:11.070 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.067+0000 7f7a3bf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:11.070 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.068+0000 7f7a3bf51640 1 Processor -- start 2024-09-15T12:22:11.070 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.068+0000 7f7a3bf51640 1 -- start start 2024-09-15T12:22:11.072 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.069+0000 7f7a3bf51640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3409f990 0x7f7a3409b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:11.072 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.069+0000 7f7a3bf51640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3409f080 con 0x7f7a3409f990 2024-09-15T12:22:11.073 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.069+0000 7f7a39ced640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3409f990 0x7f7a3409b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:11.073 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.069+0000 7f7a39ced640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3409f990 0x7f7a3409b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57412/0 (socket says 172.21.15.122:57412) 2024-09-15T12:22:11.073 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.069+0000 7f7a39ced640 1 -- 172.21.15.122:0/337091889 learned_addr learned my addr 172.21.15.122:0/337091889 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:11.073 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.070+0000 7f7a39ced640 1 -- 172.21.15.122:0/337091889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3409f340 con 0x7f7a3409f990 2024-09-15T12:22:11.073 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.070+0000 7f7a39ced640 1 --2- 172.21.15.122:0/337091889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3409f990 0x7f7a3409b5b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:11.073 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.070+0000 7f7a2a7fc640 1 -- 172.21.15.122:0/337091889 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7a24014620 con 0x7f7a3409f990 2024-09-15T12:22:11.073 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.070+0000 7f7a2a7fc640 1 -- 172.21.15.122:0/337091889 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7a24014780 con 0x7f7a3409f990 2024-09-15T12:22:11.073 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.070+0000 7f7a2a7fc640 1 -- 172.21.15.122:0/337091889 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7a24014a20 con 0x7f7a3409f990 2024-09-15T12:22:11.073 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.070+0000 7f7a3bf51640 1 -- 172.21.15.122:0/337091889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a34099f00 con 0x7f7a3409f990 2024-09-15T12:22:11.073 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.070+0000 7f7a3bf51640 1 -- 172.21.15.122:0/337091889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a34073620 con 0x7f7a3409f990 2024-09-15T12:22:11.073 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.070+0000 7f7a2a7fc640 1 -- 172.21.15.122:0/337091889 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f7a24013400 con 0x7f7a3409f990 2024-09-15T12:22:11.074 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.070+0000 7f7a2a7fc640 1 -- 172.21.15.122:0/337091889 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7f7a24019040 con 0x7f7a3409f990 2024-09-15T12:22:11.074 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.071+0000 7f7a3bf51640 1 -- 172.21.15.122:0/337091889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a3409ac90 con 0x7f7a3409f990 2024-09-15T12:22:11.077 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.075+0000 7f7a2a7fc640 1 -- 172.21.15.122:0/337091889 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f7a24012c30 con 0x7f7a3409f990 2024-09-15T12:22:11.137 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.136+0000 7f7a3bf51640 1 -- 172.21.15.122:0/337091889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a34050fc0 con 0x7f7a3409f990 2024-09-15T12:22:11.138 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.137+0000 7f7a2a7fc640 1 -- 172.21.15.122:0/337091889 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7f7a240125c0 con 0x7f7a3409f990 2024-09-15T12:22:11.138 INFO:teuthology.misc.health.smithi122.stdout: 2024-09-15T12:22:11.138 INFO:teuthology.misc.health.smithi122.stdout:{"epoch":7,"fsid":"a718c858-230d-4784-bf30-b6c766b34745","created":"2024-09-15T12:22:07.924324+0000","modified":"2024-09-15T12:22:10.047645+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T12:22:10.047645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"9dec0d05-2ec1-4006-9d4a-5af98be8e5e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b0b12d81-07a4-4437-b931-939ed1a94383","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f4153355-ac6b-4693-bea0-9e8c15a6bd88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"70efb372-12e1-471e-a1f6-0d2814bbf30f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:22:11.139 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.138+0000 7f7a3bf51640 1 -- 172.21.15.122:0/337091889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3409f990 msgr2=0x7f7a3409b5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:11.139 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.138+0000 7f7a3bf51640 1 --2- 172.21.15.122:0/337091889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3409f990 0x7f7a3409b5b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:11.139 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.138+0000 7f7a3bf51640 1 -- 172.21.15.122:0/337091889 shutdown_connections 2024-09-15T12:22:11.140 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.138+0000 7f7a3bf51640 1 --2- 172.21.15.122:0/337091889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a3409f990 0x7f7a3409b5b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:11.140 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.138+0000 7f7a3bf51640 1 -- 172.21.15.122:0/337091889 >> 172.21.15.122:0/337091889 conn(0x7f7a340a6390 msgr2=0x7f7a340a2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:11.140 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.138+0000 7f7a3bf51640 1 -- 172.21.15.122:0/337091889 shutdown_connections 2024-09-15T12:22:11.140 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:11.138+0000 7f7a3bf51640 1 -- 172.21.15.122:0/337091889 wait complete. 2024-09-15T12:22:11.148 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-15T12:22:13.386 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-09-15T12:22:13.384+0000 7fef6f33d640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-15T12:22:17.553 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T12:22:17.655 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.650+0000 7fb5aab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:17.656 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.654+0000 7fb5aab91640 1 Processor -- start 2024-09-15T12:22:17.656 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.654+0000 7fb5aab91640 1 -- start start 2024-09-15T12:22:17.658 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.655+0000 7fb5aab91640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb5a4133f20 0x7fb5a4134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:17.658 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.656+0000 7fb5aab91640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5a4068e20 con 0x7fb5a4134870 2024-09-15T12:22:17.658 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.656+0000 7fb5aab91640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb5a4133ba0 con 0x7fb5a4133f20 2024-09-15T12:22:17.658 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.656+0000 7fb5a892d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb5a4133f20 0x7fb5a4134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:17.658 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.656+0000 7fb5a3fff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fb5a4134870 0x7fb5a40a0480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38158/0 (socket says 172.21.15.122:38158) 2024-09-15T12:22:17.658 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.656+0000 7fb5a3fff640 1 -- 172.21.15.122:0/727035073 learned_addr learned my addr 172.21.15.122:0/727035073 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:22:17.658 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.656+0000 7fb5a892d640 1 -- 172.21.15.122:0/727035073 >> v1:172.21.15.122:6789/0 conn(0x7fb5a4134870 legacy=0x7fb5a40a0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:17.658 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.656+0000 7fb5a892d640 1 -- 172.21.15.122:0/727035073 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a4069050 con 0x7fb5a4133f20 2024-09-15T12:22:17.659 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.656+0000 7fb5a892d640 1 --2- 172.21.15.122:0/727035073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5a4133f20 0x7fb5a4134330 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bba6349a4b2e28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:17.659 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.656+0000 7fb5a37fe640 1 -- 172.21.15.122:0/727035073 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb598009d90 con 0x7fb5a4133f20 2024-09-15T12:22:17.659 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.656+0000 7fb5a37fe640 1 -- 172.21.15.122:0/727035073 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb59800e230 con 0x7fb5a4133f20 2024-09-15T12:22:17.659 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.656+0000 7fb5a37fe640 1 -- 172.21.15.122:0/727035073 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb59800e4d0 con 0x7fb5a4133f20 2024-09-15T12:22:17.660 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.657+0000 7fb5aab91640 1 -- 172.21.15.122:0/727035073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5a4133f20 msgr2=0x7fb5a4134330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:17.660 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.657+0000 7fb5aab91640 1 --2- 172.21.15.122:0/727035073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5a4133f20 0x7fb5a4134330 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:17.660 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.657+0000 7fb5aab91640 1 -- 172.21.15.122:0/727035073 shutdown_connections 2024-09-15T12:22:17.660 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.657+0000 7fb5aab91640 1 --2- 172.21.15.122:0/727035073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5a4133f20 0x7fb5a4134330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:17.660 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.657+0000 7fb5aab91640 1 -- 172.21.15.122:0/727035073 >> 172.21.15.122:0/727035073 conn(0x7fb5a406eb30 msgr2=0x7fb5a406ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:17.660 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.657+0000 7fb5aab91640 1 -- 172.21.15.122:0/727035073 shutdown_connections 2024-09-15T12:22:17.660 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.657+0000 7fb5aab91640 1 -- 172.21.15.122:0/727035073 wait complete. 2024-09-15T12:22:17.660 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.657+0000 7fb5aab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:17.661 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.659+0000 7fb5aab91640 1 Processor -- start 2024-09-15T12:22:17.661 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.659+0000 7fb5aab91640 1 -- start start 2024-09-15T12:22:17.661 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.660+0000 7fb5aab91640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5a4133f20 0x7fb5a411d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:17.662 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.660+0000 7fb5aab91640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a4121330 con 0x7fb5a4133f20 2024-09-15T12:22:17.662 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.660+0000 7fb5a892d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5a4133f20 0x7fb5a411d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:17.662 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.660+0000 7fb5a892d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5a4133f20 0x7fb5a411d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45690/0 (socket says 172.21.15.122:45690) 2024-09-15T12:22:17.662 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.660+0000 7fb5a892d640 1 -- 172.21.15.122:0/150418049 learned_addr learned my addr 172.21.15.122:0/150418049 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:17.663 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.660+0000 7fb5a892d640 1 -- 172.21.15.122:0/150418049 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a4120650 con 0x7fb5a4133f20 2024-09-15T12:22:17.663 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.661+0000 7fb5a892d640 1 --2- 172.21.15.122:0/150418049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5a4133f20 0x7fb5a411d490 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:17.663 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.661+0000 7fb5a17fa640 1 -- 172.21.15.122:0/150418049 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb598014750 con 0x7fb5a4133f20 2024-09-15T12:22:17.663 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.661+0000 7fb5a17fa640 1 -- 172.21.15.122:0/150418049 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb5980148b0 con 0x7fb5a4133f20 2024-09-15T12:22:17.663 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.661+0000 7fb5a17fa640 1 -- 172.21.15.122:0/150418049 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb598014b50 con 0x7fb5a4133f20 2024-09-15T12:22:17.663 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.661+0000 7fb5aab91640 1 -- 172.21.15.122:0/150418049 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a411ee40 con 0x7fb5a4133f20 2024-09-15T12:22:17.663 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.661+0000 7fb5aab91640 1 -- 172.21.15.122:0/150418049 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a4120f70 con 0x7fb5a4133f20 2024-09-15T12:22:17.663 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.662+0000 7fb5a17fa640 1 -- 172.21.15.122:0/150418049 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7fb598014d00 con 0x7fb5a4133f20 2024-09-15T12:22:17.664 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.662+0000 7fb5a17fa640 1 --2- 172.21.15.122:0/150418049 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb58803e8a0 0x7fb588040db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:17.664 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.662+0000 7fb5a17fa640 1 -- 172.21.15.122:0/150418049 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2308+0+0 (crc 0 0 0) 0x7fb598019040 con 0x7fb5a4133f20 2024-09-15T12:22:17.664 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.662+0000 7fb5aab91640 1 -- 172.21.15.122:0/150418049 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a4134330 con 0x7fb5a4133f20 2024-09-15T12:22:17.665 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.662+0000 7fb5a3fff640 1 --2- 172.21.15.122:0/150418049 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb58803e8a0 0x7fb588040db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:17.665 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.663+0000 7fb5a3fff640 1 --2- 172.21.15.122:0/150418049 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb58803e8a0 0x7fb588040db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:17.669 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.668+0000 7fb5a17fa640 1 -- 172.21.15.122:0/150418049 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fb598011570 con 0x7fb5a4133f20 2024-09-15T12:22:17.845 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.844+0000 7fb5aab91640 1 -- 172.21.15.122:0/150418049 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5a4050fc0 con 0x7fb5a4133f20 2024-09-15T12:22:17.846 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.844+0000 7fb5a17fa640 1 -- 172.21.15.122:0/150418049 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+6979 (crc 0 0 0) 0x7fb598008f20 con 0x7fb5a4133f20 2024-09-15T12:22:17.846 INFO:teuthology.misc.health.smithi122.stdout: 2024-09-15T12:22:17.846 INFO:teuthology.misc.health.smithi122.stdout:{"epoch":11,"fsid":"a718c858-230d-4784-bf30-b6c766b34745","created":"2024-09-15T12:22:07.924324+0000","modified":"2024-09-15T12:22:17.395744+0000","last_up_change":"2024-09-15T12:22:16.394814+0000","last_in_change":"2024-09-15T12:22:10.047645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:22:16.402082+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9dec0d05-2ec1-4006-9d4a-5af98be8e5e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2464407069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6801","nonce":2464407069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6805","nonce":2464407069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2464407069}]},"public_addr":"172.21.15.122:6800/2464407069","cluster_addr":"172.21.15.122:6801/2464407069","heartbeat_back_addr":"172.21.15.122:6805/2464407069","heartbeat_front_addr":"172.21.15.122:6802/2464407069","state":["exists","up"]},{"osd":1,"uuid":"b0b12d81-07a4-4437-b931-939ed1a94383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6803","nonce":3904627990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3904627990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6809","nonce":3904627990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3904627990}]},"public_addr":"172.21.15.122:6803/3904627990","cluster_addr":"172.21.15.122:6804/3904627990","heartbeat_back_addr":"172.21.15.122:6809/3904627990","heartbeat_front_addr":"172.21.15.122:6808/3904627990","state":["exists","up"]},{"osd":2,"uuid":"f4153355-ac6b-4693-bea0-9e8c15a6bd88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":3269009979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3269009979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3269009979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3269009979}]},"public_addr":"172.21.15.142:6803/3269009979","cluster_addr":"172.21.15.142:6804/3269009979","heartbeat_back_addr":"172.21.15.142:6802/3269009979","heartbeat_front_addr":"172.21.15.142:6805/3269009979","state":["exists","up"]},{"osd":3,"uuid":"70efb372-12e1-471e-a1f6-0d2814bbf30f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":2150609480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2150609480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":2150609480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2150609480}]},"public_addr":"172.21.15.142:6811/2150609480","cluster_addr":"172.21.15.142:6810/2150609480","heartbeat_back_addr":"172.21.15.142:6807/2150609480","heartbeat_front_addr":"172.21.15.142:6806/2150609480","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:22:17.849 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.847+0000 7fb5aab91640 1 -- 172.21.15.122:0/150418049 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb58803e8a0 msgr2=0x7fb588040db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:17.849 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.847+0000 7fb5aab91640 1 --2- 172.21.15.122:0/150418049 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb58803e8a0 0x7fb588040db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:17.849 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.847+0000 7fb5aab91640 1 -- 172.21.15.122:0/150418049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5a4133f20 msgr2=0x7fb5a411d490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:17.849 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.847+0000 7fb5aab91640 1 --2- 172.21.15.122:0/150418049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5a4133f20 0x7fb5a411d490 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:17.849 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.847+0000 7fb5aab91640 1 -- 172.21.15.122:0/150418049 shutdown_connections 2024-09-15T12:22:17.849 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.847+0000 7fb5aab91640 1 --2- 172.21.15.122:0/150418049 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb58803e8a0 0x7fb588040db0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:17.849 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.847+0000 7fb5aab91640 1 --2- 172.21.15.122:0/150418049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5a4133f20 0x7fb5a411d490 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:17.849 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.847+0000 7fb5aab91640 1 -- 172.21.15.122:0/150418049 >> 172.21.15.122:0/150418049 conn(0x7fb5a406eb30 msgr2=0x7fb5a40a30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:17.849 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.847+0000 7fb5aab91640 1 -- 172.21.15.122:0/150418049 shutdown_connections 2024-09-15T12:22:17.849 INFO:teuthology.misc.health.smithi122.stderr:2024-09-15T12:22:17.847+0000 7fb5aab91640 1 -- 172.21.15.122:0/150418049 wait complete. 2024-09-15T12:22:17.858 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-15T12:22:17.858 INFO:tasks.ceph:Creating RBD pool 2024-09-15T12:22:17.858 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-15T12:22:17.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.957+0000 7f421a4ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:17.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.966+0000 7f421a4ac640 1 Processor -- start 2024-09-15T12:22:17.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.966+0000 7f421a4ac640 1 -- start start 2024-09-15T12:22:17.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.967+0000 7f421a4ac640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f42141394a0 0x7f421413b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:17.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.967+0000 7f421a4ac640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4214070100 con 0x7f421409fc80 2024-09-15T12:22:17.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.967+0000 7f421a4ac640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f421409e830 con 0x7f42141394a0 2024-09-15T12:22:17.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.967+0000 7f42137fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f42141394a0 0x7f421413b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:17.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.967+0000 7f4213fff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f421409fc80 0x7f42140a0090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38174/0 (socket says 172.21.15.122:38174) 2024-09-15T12:22:17.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.967+0000 7f4213fff640 1 -- 172.21.15.122:0/1557044605 learned_addr learned my addr 172.21.15.122:0/1557044605 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:22:17.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.967+0000 7f42137fe640 1 -- 172.21.15.122:0/1557044605 >> v1:172.21.15.122:6789/0 conn(0x7f421409fc80 legacy=0x7f42140a0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:17.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.967+0000 7f42137fe640 1 -- 172.21.15.122:0/1557044605 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42140a07a0 con 0x7f42141394a0 2024-09-15T12:22:17.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.967+0000 7f42137fe640 1 --2- 172.21.15.122:0/1557044605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42141394a0 0x7f421413b8c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974d562b4f7591d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:17.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.967+0000 7f4212ffd640 1 -- 172.21.15.122:0/1557044605 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4208009d90 con 0x7f42141394a0 2024-09-15T12:22:17.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.967+0000 7f4212ffd640 1 -- 172.21.15.122:0/1557044605 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f420800e230 con 0x7f42141394a0 2024-09-15T12:22:17.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.967+0000 7f4212ffd640 1 -- 172.21.15.122:0/1557044605 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f420800e4d0 con 0x7f42141394a0 2024-09-15T12:22:17.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.968+0000 7f421a4ac640 1 -- 172.21.15.122:0/1557044605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42141394a0 msgr2=0x7f421413b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:17.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.968+0000 7f421a4ac640 1 --2- 172.21.15.122:0/1557044605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42141394a0 0x7f421413b8c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:17.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.968+0000 7f421a4ac640 1 -- 172.21.15.122:0/1557044605 shutdown_connections 2024-09-15T12:22:17.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.968+0000 7f421a4ac640 1 --2- 172.21.15.122:0/1557044605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42141394a0 0x7f421413b8c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:17.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.968+0000 7f421a4ac640 1 -- 172.21.15.122:0/1557044605 >> 172.21.15.122:0/1557044605 conn(0x7f42140a43b0 msgr2=0x7f42140a47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:17.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.968+0000 7f421a4ac640 1 -- 172.21.15.122:0/1557044605 shutdown_connections 2024-09-15T12:22:17.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.968+0000 7f421a4ac640 1 -- 172.21.15.122:0/1557044605 wait complete. 2024-09-15T12:22:17.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.968+0000 7f421a4ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:17.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.970+0000 7f421a4ac640 1 Processor -- start 2024-09-15T12:22:17.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.970+0000 7f421a4ac640 1 -- start start 2024-09-15T12:22:17.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.971+0000 7f421a4ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f421409fc80 0x7f4214092ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:17.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.971+0000 7f421a4ac640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4214095f10 con 0x7f421409fc80 2024-09-15T12:22:17.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.971+0000 7f4213fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f421409fc80 0x7f4214092ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:17.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.971+0000 7f4213fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f421409fc80 0x7f4214092ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45706/0 (socket says 172.21.15.122:45706) 2024-09-15T12:22:17.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.971+0000 7f4213fff640 1 -- 172.21.15.122:0/4078997694 learned_addr learned my addr 172.21.15.122:0/4078997694 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:17.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.971+0000 7f4213fff640 1 -- 172.21.15.122:0/4078997694 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4214092c30 con 0x7f421409fc80 2024-09-15T12:22:17.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.972+0000 7f4213fff640 1 --2- 172.21.15.122:0/4078997694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f421409fc80 0x7f4214092ff0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:17.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.972+0000 7f4210ff9640 1 -- 172.21.15.122:0/4078997694 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4204005a60 con 0x7f421409fc80 2024-09-15T12:22:17.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.972+0000 7f4210ff9640 1 -- 172.21.15.122:0/4078997694 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4204005bc0 con 0x7f421409fc80 2024-09-15T12:22:17.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.972+0000 7f421a4ac640 1 -- 172.21.15.122:0/4078997694 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42140942b0 con 0x7f421409fc80 2024-09-15T12:22:17.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.972+0000 7f4210ff9640 1 -- 172.21.15.122:0/4078997694 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4204005e60 con 0x7f421409fc80 2024-09-15T12:22:17.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.972+0000 7f421a4ac640 1 -- 172.21.15.122:0/4078997694 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4214095200 con 0x7f421409fc80 2024-09-15T12:22:17.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.973+0000 7f4210ff9640 1 -- 172.21.15.122:0/4078997694 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7f420400c7f0 con 0x7f421409fc80 2024-09-15T12:22:17.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.973+0000 7f421a4ac640 1 -- 172.21.15.122:0/4078997694 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f421409da20 con 0x7f421409fc80 2024-09-15T12:22:17.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.973+0000 7f4210ff9640 1 --2- 172.21.15.122:0/4078997694 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f420003e8a0 0x7f4200040db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:17.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.973+0000 7f4210ff9640 1 -- 172.21.15.122:0/4078997694 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2308+0+0 (crc 0 0 0) 0x7f420404f370 con 0x7f421409fc80 2024-09-15T12:22:17.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.974+0000 7f42137fe640 1 --2- 172.21.15.122:0/4078997694 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f420003e8a0 0x7f4200040db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:17.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.974+0000 7f42137fe640 1 --2- 172.21.15.122:0/4078997694 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f420003e8a0 0x7f4200040db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:17.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:17.978+0000 7f4210ff9640 1 -- 172.21.15.122:0/4078997694 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f420400dc10 con 0x7f421409fc80 2024-09-15T12:22:18.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.155+0000 7f421a4ac640 1 -- 172.21.15.122:0/4078997694 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f421406c3b0 con 0x7f421409fc80 2024-09-15T12:22:18.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.396+0000 7f4210ff9640 1 -- 172.21.15.122:0/4078997694 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v12) ==== 109+0+0 (crc 0 0 0) 0x7f420400d610 con 0x7f421409fc80 2024-09-15T12:22:18.398 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'rbd' created 2024-09-15T12:22:18.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.401+0000 7f421a4ac640 1 -- 172.21.15.122:0/4078997694 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f420003e8a0 msgr2=0x7f4200040db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:18.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.401+0000 7f421a4ac640 1 --2- 172.21.15.122:0/4078997694 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f420003e8a0 0x7f4200040db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:18.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.401+0000 7f421a4ac640 1 -- 172.21.15.122:0/4078997694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f421409fc80 msgr2=0x7f4214092ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:18.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.401+0000 7f421a4ac640 1 --2- 172.21.15.122:0/4078997694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f421409fc80 0x7f4214092ff0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:18.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.401+0000 7f421a4ac640 1 -- 172.21.15.122:0/4078997694 shutdown_connections 2024-09-15T12:22:18.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.401+0000 7f421a4ac640 1 --2- 172.21.15.122:0/4078997694 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f420003e8a0 0x7f4200040db0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:18.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.401+0000 7f421a4ac640 1 --2- 172.21.15.122:0/4078997694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f421409fc80 0x7f4214092ff0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:18.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.401+0000 7f421a4ac640 1 -- 172.21.15.122:0/4078997694 >> 172.21.15.122:0/4078997694 conn(0x7f42140a43b0 msgr2=0x7f42141be5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:18.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.401+0000 7f421a4ac640 1 -- 172.21.15.122:0/4078997694 shutdown_connections 2024-09-15T12:22:18.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.401+0000 7f421a4ac640 1 -- 172.21.15.122:0/4078997694 wait complete. 2024-09-15T12:22:18.422 DEBUG:teuthology.orchestra.run.smithi122:> rbd --cluster ceph pool init rbd 2024-09-15T12:22:18.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.592+0000 7f90ede87ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:18.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.592+0000 7f90ede87ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:18.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.594+0000 7f90ede87ac0 1 Processor -- start 2024-09-15T12:22:18.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.594+0000 7f90ede87ac0 1 -- start start 2024-09-15T12:22:18.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.595+0000 7f90ede87ac0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x1558cf0 0x15f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:18.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.595+0000 7f90ede87ac0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x13bd180 con 0x15581d0 2024-09-15T12:22:18.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.595+0000 7f90ede87ac0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x13fcb90 con 0x1558cf0 2024-09-15T12:22:18.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.595+0000 7f90db7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x1558cf0 0x15f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:18.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.595+0000 7f90e3fff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x15581d0 0x15585e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38184/0 (socket says 172.21.15.122:38184) 2024-09-15T12:22:18.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.595+0000 7f90e3fff640 1 -- 172.21.15.122:0/724648486 learned_addr learned my addr 172.21.15.122:0/724648486 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:22:18.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.595+0000 7f90e37fe640 1 -- 172.21.15.122:0/724648486 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3457891242 0 0) 0x13bd180 con 0x15581d0 2024-09-15T12:22:18.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.595+0000 7f90e37fe640 1 -- 172.21.15.122:0/724648486 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90d0002f20 con 0x15581d0 2024-09-15T12:22:18.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.595+0000 7f90db7fe640 1 -- 172.21.15.122:0/724648486 >> v1:172.21.15.122:6789/0 conn(0x15581d0 legacy=0x15585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:18.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.595+0000 7f90db7fe640 1 -- 172.21.15.122:0/724648486 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x1392f80 con 0x1558cf0 2024-09-15T12:22:18.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.597+0000 7f90db7fe640 1 --2- 172.21.15.122:0/724648486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1558cf0 0x15f5ce0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59b810ef200b266 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:18.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.597+0000 7f90e37fe640 1 -- 172.21.15.122:0/724648486 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f90cc02d6f0 con 0x1558cf0 2024-09-15T12:22:18.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.597+0000 7f90e37fe640 1 -- 172.21.15.122:0/724648486 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f90cc02d850 con 0x1558cf0 2024-09-15T12:22:18.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.597+0000 7f90e37fe640 1 -- 172.21.15.122:0/724648486 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f90cc02daf0 con 0x1558cf0 2024-09-15T12:22:18.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.598+0000 7f90ede87ac0 1 -- 172.21.15.122:0/724648486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1558cf0 msgr2=0x15f5ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:18.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.598+0000 7f90ede87ac0 1 --2- 172.21.15.122:0/724648486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1558cf0 0x15f5ce0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:18.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.598+0000 7f90ede87ac0 1 -- 172.21.15.122:0/724648486 shutdown_connections 2024-09-15T12:22:18.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.598+0000 7f90ede87ac0 1 --2- 172.21.15.122:0/724648486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1558cf0 0x15f5ce0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:18.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.598+0000 7f90ede87ac0 1 -- 172.21.15.122:0/724648486 >> 172.21.15.122:0/724648486 conn(0x1365f70 msgr2=0x15566f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:18.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.598+0000 7f90ede87ac0 1 -- 172.21.15.122:0/724648486 shutdown_connections 2024-09-15T12:22:18.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.598+0000 7f90ede87ac0 1 -- 172.21.15.122:0/724648486 wait complete. 2024-09-15T12:22:18.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.599+0000 7f90ede87ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:18.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.600+0000 7f90ede87ac0 1 Processor -- start 2024-09-15T12:22:18.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.600+0000 7f90ede87ac0 1 -- start start 2024-09-15T12:22:18.603 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.601+0000 7f90ede87ac0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15581d0 0x15deec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:18.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.601+0000 7f90ede87ac0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x14078f0 con 0x15581d0 2024-09-15T12:22:18.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.601+0000 7f90e3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15581d0 0x15deec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:18.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.601+0000 7f90e3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15581d0 0x15deec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45730/0 (socket says 172.21.15.122:45730) 2024-09-15T12:22:18.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.601+0000 7f90e3fff640 1 -- 172.21.15.122:0/351539889 learned_addr learned my addr 172.21.15.122:0/351539889 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:18.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.602+0000 7f90e3fff640 1 -- 172.21.15.122:0/351539889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13a1800 con 0x15581d0 2024-09-15T12:22:18.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.602+0000 7f90e3fff640 1 --2- 172.21.15.122:0/351539889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15581d0 0x15deec0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:18.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.602+0000 7f90e0ff9640 1 -- 172.21.15.122:0/351539889 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f90d400c490 con 0x15581d0 2024-09-15T12:22:18.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.602+0000 7f90ede87ac0 1 -- 172.21.15.122:0/351539889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1393310 con 0x15581d0 2024-09-15T12:22:18.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.602+0000 7f90e0ff9640 1 -- 172.21.15.122:0/351539889 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f90d400c5f0 con 0x15581d0 2024-09-15T12:22:18.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.602+0000 7f90e0ff9640 1 -- 172.21.15.122:0/351539889 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f90d400c890 con 0x15581d0 2024-09-15T12:22:18.604 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.602+0000 7f90ede87ac0 1 -- 172.21.15.122:0/351539889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1392d70 con 0x15581d0 2024-09-15T12:22:18.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.603+0000 7f90e0ff9640 1 -- 172.21.15.122:0/351539889 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7f90d400c9f0 con 0x15581d0 2024-09-15T12:22:18.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.604+0000 7f90e0ff9640 1 --2- 172.21.15.122:0/351539889 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f90c403d0e0 0x7f90c403f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:18.605 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.604+0000 7f90e0ff9640 1 -- 172.21.15.122:0/351539889 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2661+0+0 (crc 0 0 0) 0x7f90d404eea0 con 0x15581d0 2024-09-15T12:22:18.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.604+0000 7f90db7fe640 1 --2- 172.21.15.122:0/351539889 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f90c403d0e0 0x7f90c403f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:18.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.604+0000 7f90ede87ac0 1 -- 172.21.15.122:0/351539889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x15e67a0 con 0x15581d0 2024-09-15T12:22:18.606 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:18.604+0000 7f90db7fe640 1 --2- 172.21.15.122:0/351539889 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f90c403d0e0 0x7f90c403f5f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:19.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.412+0000 7f90e0ff9640 1 -- 172.21.15.122:0/351539889 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v13) ==== 141+0+0 (crc 0 0 0) 0x7f90d400ccf0 con 0x15581d0 2024-09-15T12:22:19.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.412+0000 7f90ede87ac0 1 -- 172.21.15.122:0/351539889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x13ba520 con 0x15581d0 2024-09-15T12:22:19.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.418+0000 7f90e0ff9640 1 -- 172.21.15.122:0/351539889 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (crc 0 0 0) 0x7f90d400ccf0 con 0x15581d0 2024-09-15T12:22:19.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.418+0000 7f90e2ffd640 1 -- 172.21.15.122:0/351539889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=13}) -- 0x7f90c8002ae0 con 0x15581d0 2024-09-15T12:22:19.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.418+0000 7f90e0ff9640 1 -- 172.21.15.122:0/351539889 <== mon.0 v2:172.21.15.122:3300/0 8 ==== osd_map(13..13 src has 1..13) ==== 1028+0+0 (crc 0 0 0) 0x7f90d40082c0 con 0x15581d0 2024-09-15T12:22:19.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.419+0000 7f90ede87ac0 1 --2- 172.21.15.122:0/351539889 >> v2:172.21.15.122:6803/3904627990 conn(0x1558cf0 0x1602e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:19.422 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.419+0000 7f90ede87ac0 1 -- 172.21.15.122:0/351539889 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13) -- 0x16033a0 con 0x1558cf0 2024-09-15T12:22:19.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.423+0000 7f90e92ed640 1 --2- 172.21.15.122:0/351539889 >> v2:172.21.15.122:6803/3904627990 conn(0x1558cf0 0x1602e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:22:19.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.453+0000 7f90e92ed640 1 --2- 172.21.15.122:0/351539889 >> v2:172.21.15.122:6803/3904627990 conn(0x1558cf0 0x1602e60 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:19.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.512+0000 7f90e92ed640 1 -- 172.21.15.122:0/351539889 <== osd.1 v2:172.21.15.122:6803/3904627990 1 ==== osd_op_reply(1 rbd_trash [create] v13'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f90dc00a4b0 con 0x1558cf0 2024-09-15T12:22:19.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.515+0000 7f90ede87ac0 1 --2- 172.21.15.122:0/351539889 >> v2:172.21.15.122:6800/2464407069 conn(0x165a440 0x165c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:19.517 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.515+0000 7f90ede87ac0 1 -- 172.21.15.122:0/351539889 --> v2:172.21.15.122:6800/2464407069 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e13) -- 0x165cef0 con 0x165a440 2024-09-15T12:22:19.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.516+0000 7f90e3fff640 1 --2- 172.21.15.122:0/351539889 >> v2:172.21.15.122:6800/2464407069 conn(0x165a440 0x165c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:22:19.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.519+0000 7f90e3fff640 1 --2- 172.21.15.122:0/351539889 >> v2:172.21.15.122:6800/2464407069 conn(0x165a440 0x165c920 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:19.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.524+0000 7f90e3fff640 1 -- 172.21.15.122:0/351539889 <== osd.0 v2:172.21.15.122:6800/2464407069 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90d403c040 con 0x165a440 2024-09-15T12:22:19.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.524+0000 7f90ede87ac0 1 -- 172.21.15.122:0/351539889 --> v2:172.21.15.122:6800/2464407069 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e13) -- 0x1659900 con 0x165a440 2024-09-15T12:22:19.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.527+0000 7f90e3fff640 1 -- 172.21.15.122:0/351539889 <== osd.0 v2:172.21.15.122:6800/2464407069 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f90d403c040 con 0x165a440 2024-09-15T12:22:19.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:19.527+0000 7f90e27fc640 1 -- 172.21.15.122:0/351539889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f90bc001f60 con 0x15581d0 2024-09-15T12:22:20.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:20.416+0000 7f90e0ff9640 1 -- 172.21.15.122:0/351539889 <== mon.0 v2:172.21.15.122:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v14) ==== 55+0+0 (crc 0 0 0) 0x7f90d4006b30 con 0x15581d0 2024-09-15T12:22:20.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:20.417+0000 7f90e0ff9640 1 -- 172.21.15.122:0/351539889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=14}) -- 0x7f90c4042810 con 0x15581d0 2024-09-15T12:22:20.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:20.417+0000 7f90e0ff9640 1 -- 172.21.15.122:0/351539889 <== mon.0 v2:172.21.15.122:3300/0 10 ==== osd_map(14..14 src has 1..14) ==== 626+0+0 (crc 0 0 0) 0x7f90d4006900 con 0x15581d0 2024-09-15T12:22:20.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:20.417+0000 7f90e2ffd640 1 -- 172.21.15.122:0/351539889 --> v2:172.21.15.122:6800/2464407069 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) -- 0x7f90c8005660 con 0x165a440 2024-09-15T12:22:20.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:20.422+0000 7f90e0ff9640 1 -- 172.21.15.122:0/351539889 <== mon.0 v2:172.21.15.122:3300/0 11 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f90d401fa70 con 0x15581d0 2024-09-15T12:22:20.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:20.449+0000 7f90e3fff640 1 -- 172.21.15.122:0/351539889 <== osd.0 v2:172.21.15.122:6800/2464407069 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v14'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f90d403c040 con 0x165a440 2024-09-15T12:22:20.452 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:20.450+0000 7f90e27fc640 1 -- 172.21.15.122:0/351539889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v14) -- 0x7f90bc003370 con 0x15581d0 2024-09-15T12:22:21.425 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.422+0000 7f90e0ff9640 1 -- 172.21.15.122:0/351539889 <== mon.0 v2:172.21.15.122:3300/0 12 ==== pool_op_reply(tid 6 (0) Success v15) ==== 43+0+0 (crc 0 0 0) 0x7f90d4006b30 con 0x15581d0 2024-09-15T12:22:21.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.422+0000 7f90e0ff9640 1 -- 172.21.15.122:0/351539889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7f90c4042ce0 con 0x15581d0 2024-09-15T12:22:21.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.422+0000 7f90e0ff9640 1 -- 172.21.15.122:0/351539889 <== mon.0 v2:172.21.15.122:3300/0 13 ==== osd_map(15..15 src has 1..15) ==== 654+0+0 (crc 0 0 0) 0x7f90d4008e70 con 0x15581d0 2024-09-15T12:22:21.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.423+0000 7f90e2ffd640 1 -- 172.21.15.122:0/351539889 --> v2:172.21.15.122:6800/2464407069 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x7f90c80059c0 con 0x165a440 2024-09-15T12:22:21.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90e3fff640 1 -- 172.21.15.122:0/351539889 <== osd.0 v2:172.21.15.122:6800/2464407069 4 ==== osd_op_reply(7 rbd_info [write 0~19] v15'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90d403c040 con 0x165a440 2024-09-15T12:22:21.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90ede87ac0 1 -- 172.21.15.122:0/351539889 >> v2:172.21.15.122:6800/2464407069 conn(0x165a440 msgr2=0x165c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:21.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90ede87ac0 1 --2- 172.21.15.122:0/351539889 >> v2:172.21.15.122:6800/2464407069 conn(0x165a440 0x165c920 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:21.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90ede87ac0 1 -- 172.21.15.122:0/351539889 >> v2:172.21.15.122:6803/3904627990 conn(0x1558cf0 msgr2=0x1602e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:21.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90ede87ac0 1 --2- 172.21.15.122:0/351539889 >> v2:172.21.15.122:6803/3904627990 conn(0x1558cf0 0x1602e60 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:21.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90ede87ac0 1 -- 172.21.15.122:0/351539889 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f90c403d0e0 msgr2=0x7f90c403f5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:21.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90ede87ac0 1 --2- 172.21.15.122:0/351539889 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f90c403d0e0 0x7f90c403f5f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:21.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90ede87ac0 1 -- 172.21.15.122:0/351539889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15581d0 msgr2=0x15deec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:21.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90ede87ac0 1 --2- 172.21.15.122:0/351539889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15581d0 0x15deec0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:21.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90ede87ac0 1 -- 172.21.15.122:0/351539889 shutdown_connections 2024-09-15T12:22:21.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90ede87ac0 1 --2- 172.21.15.122:0/351539889 >> v2:172.21.15.122:6800/2464407069 conn(0x165a440 0x165c920 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:21.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90ede87ac0 1 --2- 172.21.15.122:0/351539889 >> v2:172.21.15.122:6803/3904627990 conn(0x1558cf0 0x1602e60 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:21.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90ede87ac0 1 --2- 172.21.15.122:0/351539889 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f90c403d0e0 0x7f90c403f5f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:21.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90ede87ac0 1 --2- 172.21.15.122:0/351539889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15581d0 0x15deec0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:21.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90ede87ac0 1 -- 172.21.15.122:0/351539889 >> 172.21.15.122:0/351539889 conn(0x1365f70 msgr2=0x155eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:21.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90ede87ac0 1 -- 172.21.15.122:0/351539889 shutdown_connections 2024-09-15T12:22:21.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.452+0000 7f90ede87ac0 1 -- 172.21.15.122:0/351539889 wait complete. 2024-09-15T12:22:21.459 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-15T12:22:21.460 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-15T12:22:21.461 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-15T12:22:21.569 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.563+0000 7f5ba9191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:21.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.567+0000 7f5ba9191640 1 Processor -- start 2024-09-15T12:22:21.570 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.567+0000 7f5ba9191640 1 -- start start 2024-09-15T12:22:21.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.568+0000 7f5ba9191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5ba409b470 0x7f5ba409b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:21.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.569+0000 7f5ba9191640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ba409f420 con 0x7f5ba4132980 2024-09-15T12:22:21.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.569+0000 7f5ba9191640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f5ba4075380 con 0x7f5ba409b470 2024-09-15T12:22:21.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.569+0000 7f5ba2d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5ba409b470 0x7f5ba409b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:21.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.569+0000 7f5ba2d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5ba409b470 0x7f5ba409b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45732/0 (socket says 172.21.15.122:45732) 2024-09-15T12:22:21.572 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.569+0000 7f5b9a59c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f5ba4132980 0x7f5ba4132d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38188/0 (socket says 172.21.15.122:38188) 2024-09-15T12:22:21.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.569+0000 7f5ba2d9d640 1 -- 172.21.15.122:0/3101139887 learned_addr learned my addr 172.21.15.122:0/3101139887 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:21.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.569+0000 7f5ba2d9d640 1 -- 172.21.15.122:0/3101139887 >> v1:172.21.15.122:6789/0 conn(0x7f5ba4132980 legacy=0x7f5ba4132d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:21.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.569+0000 7f5ba2d9d640 1 -- 172.21.15.122:0/3101139887 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba406d370 con 0x7f5ba409b470 2024-09-15T12:22:21.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.569+0000 7f5ba259c640 1 -- 172.21.15.122:0/3101139887 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80902602 0 0) 0x7f5ba409f420 con 0x7f5ba4132980 2024-09-15T12:22:21.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.569+0000 7f5ba2d9d640 1 --2- 172.21.15.122:0/3101139887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba409b470 0x7f5ba409b880 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6907a6d14694df64 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:21.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.569+0000 7f5ba259c640 1 -- 172.21.15.122:0/3101139887 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5b94009e50 con 0x7f5ba409b470 2024-09-15T12:22:21.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.569+0000 7f5ba259c640 1 -- 172.21.15.122:0/3101139887 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5b9400e230 con 0x7f5ba409b470 2024-09-15T12:22:21.573 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.569+0000 7f5ba259c640 1 -- 172.21.15.122:0/3101139887 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5b9400e4d0 con 0x7f5ba409b470 2024-09-15T12:22:21.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.570+0000 7f5ba9191640 1 -- 172.21.15.122:0/3101139887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba409b470 msgr2=0x7f5ba409b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:21.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.570+0000 7f5ba9191640 1 --2- 172.21.15.122:0/3101139887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba409b470 0x7f5ba409b880 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:21.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.570+0000 7f5ba9191640 1 -- 172.21.15.122:0/3101139887 shutdown_connections 2024-09-15T12:22:21.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.570+0000 7f5ba9191640 1 --2- 172.21.15.122:0/3101139887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba409b470 0x7f5ba409b880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:21.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.570+0000 7f5ba9191640 1 -- 172.21.15.122:0/3101139887 >> 172.21.15.122:0/3101139887 conn(0x7f5ba40a32a0 msgr2=0x7f5ba40a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:21.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.570+0000 7f5ba9191640 1 -- 172.21.15.122:0/3101139887 shutdown_connections 2024-09-15T12:22:21.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.570+0000 7f5ba9191640 1 -- 172.21.15.122:0/3101139887 wait complete. 2024-09-15T12:22:21.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.570+0000 7f5ba9191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:21.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.572+0000 7f5ba9191640 1 Processor -- start 2024-09-15T12:22:21.575 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.572+0000 7f5ba9191640 1 -- start start 2024-09-15T12:22:21.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.573+0000 7f5ba9191640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba409b470 0x7f5ba412cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:21.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.573+0000 7f5ba9191640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba412ed70 con 0x7f5ba409b470 2024-09-15T12:22:21.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.573+0000 7f5ba2d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba409b470 0x7f5ba412cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:21.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.573+0000 7f5ba2d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba409b470 0x7f5ba412cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45746/0 (socket says 172.21.15.122:45746) 2024-09-15T12:22:21.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.573+0000 7f5ba2d9d640 1 -- 172.21.15.122:0/2479106889 learned_addr learned my addr 172.21.15.122:0/2479106889 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:21.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.573+0000 7f5ba2d9d640 1 -- 172.21.15.122:0/2479106889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba408e6e0 con 0x7f5ba409b470 2024-09-15T12:22:21.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.574+0000 7f5ba2d9d640 1 --2- 172.21.15.122:0/2479106889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba409b470 0x7f5ba412cb50 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:21.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.574+0000 7f5b9bfff640 1 -- 172.21.15.122:0/2479106889 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5b94018040 con 0x7f5ba409b470 2024-09-15T12:22:21.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.574+0000 7f5b9bfff640 1 -- 172.21.15.122:0/2479106889 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5b940115e0 con 0x7f5ba409b470 2024-09-15T12:22:21.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.574+0000 7f5b9bfff640 1 -- 172.21.15.122:0/2479106889 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5b94011880 con 0x7f5ba409b470 2024-09-15T12:22:21.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.574+0000 7f5ba9191640 1 -- 172.21.15.122:0/2479106889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba40a10f0 con 0x7f5ba409b470 2024-09-15T12:22:21.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.574+0000 7f5ba9191640 1 -- 172.21.15.122:0/2479106889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba412dc70 con 0x7f5ba409b470 2024-09-15T12:22:21.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.575+0000 7f5b9bfff640 1 -- 172.21.15.122:0/2479106889 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f5b94011a30 con 0x7f5ba409b470 2024-09-15T12:22:21.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.575+0000 7f5ba9191640 1 -- 172.21.15.122:0/2479106889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ba4132650 con 0x7f5ba409b470 2024-09-15T12:22:21.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.575+0000 7f5b9bfff640 1 --2- 172.21.15.122:0/2479106889 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f5b8403e930 0x7f5b84040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:21.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.575+0000 7f5b9bfff640 1 -- 172.21.15.122:0/2479106889 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f5b940520f0 con 0x7f5ba409b470 2024-09-15T12:22:21.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.575+0000 7f5b9a59c640 1 --2- 172.21.15.122:0/2479106889 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f5b8403e930 0x7f5b84040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:21.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.576+0000 7f5b9a59c640 1 --2- 172.21.15.122:0/2479106889 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f5b8403e930 0x7f5b84040e40 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:21.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.580+0000 7f5b9bfff640 1 -- 172.21.15.122:0/2479106889 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f5b9400c750 con 0x7f5ba409b470 2024-09-15T12:22:21.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.757+0000 7f5ba9191640 1 -- 172.21.15.122:0/2479106889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f5ba40a10f0 con 0x7f5ba409b470 2024-09-15T12:22:21.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.758+0000 7f5b9bfff640 1 -- 172.21.15.122:0/2479106889 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (crc 0 0 0) 0x7f5ba40a10f0 con 0x7f5ba409b470 2024-09-15T12:22:21.761 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:22:21.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.760+0000 7f5ba9191640 1 -- 172.21.15.122:0/2479106889 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f5b8403e930 msgr2=0x7f5b84040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:21.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.760+0000 7f5ba9191640 1 --2- 172.21.15.122:0/2479106889 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f5b8403e930 0x7f5b84040e40 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:21.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.760+0000 7f5ba9191640 1 -- 172.21.15.122:0/2479106889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba409b470 msgr2=0x7f5ba412cb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:21.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.760+0000 7f5ba9191640 1 --2- 172.21.15.122:0/2479106889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba409b470 0x7f5ba412cb50 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:21.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.760+0000 7f5ba9191640 1 -- 172.21.15.122:0/2479106889 shutdown_connections 2024-09-15T12:22:21.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.760+0000 7f5ba9191640 1 --2- 172.21.15.122:0/2479106889 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f5b8403e930 0x7f5b84040e40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:21.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.760+0000 7f5ba9191640 1 --2- 172.21.15.122:0/2479106889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ba409b470 0x7f5ba412cb50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:21.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.760+0000 7f5ba9191640 1 -- 172.21.15.122:0/2479106889 >> 172.21.15.122:0/2479106889 conn(0x7f5ba40a32a0 msgr2=0x7f5ba40a0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:21.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.760+0000 7f5ba9191640 1 -- 172.21.15.122:0/2479106889 shutdown_connections 2024-09-15T12:22:21.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.760+0000 7f5ba9191640 1 -- 172.21.15.122:0/2479106889 wait complete. 2024-09-15T12:22:21.774 INFO:teuthology.orchestra.run.smithi122.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-15T12:22:21.774 INFO:tasks.ceph_manager:config epoch is 1 2024-09-15T12:22:21.775 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T12:22:21.775 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-15T12:22:21.775 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-15T12:22:21.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.877+0000 7f7cf7c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:21.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.882+0000 7f7cf7c74640 1 Processor -- start 2024-09-15T12:22:21.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.882+0000 7f7cf7c74640 1 -- start start 2024-09-15T12:22:21.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.883+0000 7f7cf7c74640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7cf009f040 0x7f7cf0068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:21.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.883+0000 7f7cf7c74640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf006d370 con 0x7f7cf009e910 2024-09-15T12:22:21.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.883+0000 7f7cf7c74640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf0070cb0 con 0x7f7cf009f040 2024-09-15T12:22:21.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.883+0000 7f7cf5a10640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7cf009f040 0x7f7cf0068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:21.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.883+0000 7f7cf520f640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f7cf009e910 0x7f7cf0069280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38198/0 (socket says 172.21.15.122:38198) 2024-09-15T12:22:21.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.883+0000 7f7cf5a10640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7cf009f040 0x7f7cf0068d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45760/0 (socket says 172.21.15.122:45760) 2024-09-15T12:22:21.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.883+0000 7f7cf520f640 1 -- 172.21.15.122:0/2272741689 learned_addr learned my addr 172.21.15.122:0/2272741689 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:22:21.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.884+0000 7f7cf5a10640 1 -- 172.21.15.122:0/2272741689 >> v1:172.21.15.122:6789/0 conn(0x7f7cf009e910 legacy=0x7f7cf0069280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:21.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.884+0000 7f7cf4a0e640 1 -- 172.21.15.122:0/2272741689 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 242824266 0 0) 0x7f7cf006d370 con 0x7f7cf009e910 2024-09-15T12:22:21.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.884+0000 7f7cf5a10640 1 -- 172.21.15.122:0/2272741689 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf009c1c0 con 0x7f7cf009f040 2024-09-15T12:22:21.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.884+0000 7f7cf5a10640 1 --2- 172.21.15.122:0/2272741689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf009f040 0x7f7cf0068d40 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be133c36c98be9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:21.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.884+0000 7f7cf4a0e640 1 -- 172.21.15.122:0/2272741689 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7cec009d90 con 0x7f7cf009f040 2024-09-15T12:22:21.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.884+0000 7f7cf4a0e640 1 -- 172.21.15.122:0/2272741689 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7cec00e230 con 0x7f7cf009f040 2024-09-15T12:22:21.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.884+0000 7f7cf4a0e640 1 -- 172.21.15.122:0/2272741689 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7cec00e4d0 con 0x7f7cf009f040 2024-09-15T12:22:21.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.885+0000 7f7cf7c74640 1 -- 172.21.15.122:0/2272741689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf009f040 msgr2=0x7f7cf0068d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:21.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.885+0000 7f7cf7c74640 1 --2- 172.21.15.122:0/2272741689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf009f040 0x7f7cf0068d40 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:21.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.885+0000 7f7cf7c74640 1 -- 172.21.15.122:0/2272741689 shutdown_connections 2024-09-15T12:22:21.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.885+0000 7f7cf7c74640 1 --2- 172.21.15.122:0/2272741689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf009f040 0x7f7cf0068d40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:21.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.885+0000 7f7cf7c74640 1 -- 172.21.15.122:0/2272741689 >> 172.21.15.122:0/2272741689 conn(0x7f7cf00a32a0 msgr2=0x7f7cf00a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:21.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.885+0000 7f7cf7c74640 1 -- 172.21.15.122:0/2272741689 shutdown_connections 2024-09-15T12:22:21.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.885+0000 7f7cf7c74640 1 -- 172.21.15.122:0/2272741689 wait complete. 2024-09-15T12:22:21.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.885+0000 7f7cf7c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:21.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.886+0000 7f7cf7c74640 1 Processor -- start 2024-09-15T12:22:21.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.886+0000 7f7cf7c74640 1 -- start start 2024-09-15T12:22:21.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.887+0000 7f7cf7c74640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf009e910 0x7f7cf0138de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:21.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.887+0000 7f7cf7c74640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf0097760 con 0x7f7cf009e910 2024-09-15T12:22:21.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.888+0000 7f7cf5a10640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf009e910 0x7f7cf0138de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:21.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.888+0000 7f7cf5a10640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf009e910 0x7f7cf0138de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45764/0 (socket says 172.21.15.122:45764) 2024-09-15T12:22:21.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.888+0000 7f7cf5a10640 1 -- 172.21.15.122:0/1871039072 learned_addr learned my addr 172.21.15.122:0/1871039072 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:21.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.888+0000 7f7cf5a10640 1 -- 172.21.15.122:0/1871039072 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf0099840 con 0x7f7cf009e910 2024-09-15T12:22:21.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.888+0000 7f7cf5a10640 1 --2- 172.21.15.122:0/1871039072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf009e910 0x7f7cf0138de0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:21.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.888+0000 7f7ce67fc640 1 -- 172.21.15.122:0/1871039072 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7cec014620 con 0x7f7cf009e910 2024-09-15T12:22:21.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.888+0000 7f7ce67fc640 1 -- 172.21.15.122:0/1871039072 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7cec014780 con 0x7f7cf009e910 2024-09-15T12:22:21.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.888+0000 7f7cf7c74640 1 -- 172.21.15.122:0/1871039072 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf00995a0 con 0x7f7cf009e910 2024-09-15T12:22:21.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.888+0000 7f7ce67fc640 1 -- 172.21.15.122:0/1871039072 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7cec014a20 con 0x7f7cf009e910 2024-09-15T12:22:21.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.888+0000 7f7cf7c74640 1 -- 172.21.15.122:0/1871039072 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf0071800 con 0x7f7cf009e910 2024-09-15T12:22:21.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.889+0000 7f7cf7c74640 1 -- 172.21.15.122:0/1871039072 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf0099dd0 con 0x7f7cf009e910 2024-09-15T12:22:21.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.889+0000 7f7ce67fc640 1 -- 172.21.15.122:0/1871039072 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f7cec014bd0 con 0x7f7cf009e910 2024-09-15T12:22:21.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.889+0000 7f7ce67fc640 1 --2- 172.21.15.122:0/1871039072 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f7cd403e930 0x7f7cd4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:21.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.889+0000 7f7ce67fc640 1 -- 172.21.15.122:0/1871039072 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f7cec019040 con 0x7f7cf009e910 2024-09-15T12:22:21.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.890+0000 7f7cf520f640 1 --2- 172.21.15.122:0/1871039072 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f7cd403e930 0x7f7cd4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:21.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.890+0000 7f7cf520f640 1 --2- 172.21.15.122:0/1871039072 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f7cd403e930 0x7f7cd4040e40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:21.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:21.894+0000 7f7ce67fc640 1 -- 172.21.15.122:0/1871039072 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f7cec011380 con 0x7f7cf009e910 2024-09-15T12:22:22.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.112+0000 7f7cf7c74640 1 -- 172.21.15.122:0/1871039072 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f7cf0099b80 con 0x7f7cf009e910 2024-09-15T12:22:22.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.114+0000 7f7ce67fc640 1 -- 172.21.15.122:0/1871039072 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+97900 (crc 0 0 0) 0x7f7cec008f20 con 0x7f7cf009e910 2024-09-15T12:22:22.117 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:22:22.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.116+0000 7f7cf7c74640 1 -- 172.21.15.122:0/1871039072 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f7cd403e930 msgr2=0x7f7cd4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.116+0000 7f7cf7c74640 1 --2- 172.21.15.122:0/1871039072 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f7cd403e930 0x7f7cd4040e40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.116+0000 7f7cf7c74640 1 -- 172.21.15.122:0/1871039072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf009e910 msgr2=0x7f7cf0138de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.116+0000 7f7cf7c74640 1 --2- 172.21.15.122:0/1871039072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf009e910 0x7f7cf0138de0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.116+0000 7f7cf7c74640 1 -- 172.21.15.122:0/1871039072 shutdown_connections 2024-09-15T12:22:22.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.116+0000 7f7cf7c74640 1 --2- 172.21.15.122:0/1871039072 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f7cd403e930 0x7f7cd4040e40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.116+0000 7f7cf7c74640 1 --2- 172.21.15.122:0/1871039072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7cf009e910 0x7f7cf0138de0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.116+0000 7f7cf7c74640 1 -- 172.21.15.122:0/1871039072 >> 172.21.15.122:0/1871039072 conn(0x7f7cf00a32a0 msgr2=0x7f7cf0072aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:22.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.117+0000 7f7cf7c74640 1 -- 172.21.15.122:0/1871039072 shutdown_connections 2024-09-15T12:22:22.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.117+0000 7f7cf7c74640 1 -- 172.21.15.122:0/1871039072 wait complete. 2024-09-15T12:22:22.129 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":73136857},{"type":"v1","addr":"172.21.15.142:6801","nonce":73136857}]},"active_addr":"172.21.15.142:6801/73136857","active_change":"2024-09-15T12:22:12.378399+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":3726159350}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":2708826280}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":4055651817}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":71448008}]}]} 2024-09-15T12:22:22.131 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-15T12:22:22.131 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-15T12:22:22.132 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:22:22.239 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.234+0000 7f0556b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:22.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.239+0000 7f0556b11640 1 Processor -- start 2024-09-15T12:22:22.240 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.239+0000 7f0556b11640 1 -- start start 2024-09-15T12:22:22.242 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.240+0000 7f0556b11640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f055012fd20 0x7f0550137c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.240+0000 7f0556b11640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055012f370 con 0x7f05500a44a0 2024-09-15T12:22:22.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.240+0000 7f0556b11640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f055006d1d0 con 0x7f055012fd20 2024-09-15T12:22:22.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.240+0000 7f0547fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f055012fd20 0x7f0550137c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.240+0000 7f05548ad640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f05500a44a0 0x7f055012f610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38208/0 (socket says 172.21.15.122:38208) 2024-09-15T12:22:22.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.240+0000 7f0547fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f055012fd20 0x7f0550137c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45774/0 (socket says 172.21.15.122:45774) 2024-09-15T12:22:22.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.240+0000 7f05548ad640 1 -- 172.21.15.122:0/172582167 learned_addr learned my addr 172.21.15.122:0/172582167 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:22:22.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.241+0000 7f0547fff640 1 -- 172.21.15.122:0/172582167 >> v1:172.21.15.122:6789/0 conn(0x7f05500a44a0 legacy=0x7f055012f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.241+0000 7f0547fff640 1 -- 172.21.15.122:0/172582167 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055009ebe0 con 0x7f055012fd20 2024-09-15T12:22:22.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.241+0000 7f05477fe640 1 -- 172.21.15.122:0/172582167 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3717790425 0 0) 0x7f055012f370 con 0x7f05500a44a0 2024-09-15T12:22:22.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.241+0000 7f0547fff640 1 --2- 172.21.15.122:0/172582167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f055012fd20 0x7f0550137c50 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fea43413a22683c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.241+0000 7f05477fe640 1 -- 172.21.15.122:0/172582167 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0540009d80 con 0x7f055012fd20 2024-09-15T12:22:22.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.241+0000 7f05477fe640 1 -- 172.21.15.122:0/172582167 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f054000e230 con 0x7f055012fd20 2024-09-15T12:22:22.244 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.241+0000 7f05477fe640 1 -- 172.21.15.122:0/172582167 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f054000e4d0 con 0x7f055012fd20 2024-09-15T12:22:22.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.242+0000 7f0556b11640 1 -- 172.21.15.122:0/172582167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f055012fd20 msgr2=0x7f0550137c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.242+0000 7f0556b11640 1 --2- 172.21.15.122:0/172582167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f055012fd20 0x7f0550137c50 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.242+0000 7f0556b11640 1 -- 172.21.15.122:0/172582167 shutdown_connections 2024-09-15T12:22:22.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.242+0000 7f0556b11640 1 --2- 172.21.15.122:0/172582167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f055012fd20 0x7f0550137c50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.242+0000 7f0556b11640 1 -- 172.21.15.122:0/172582167 >> 172.21.15.122:0/172582167 conn(0x7f05500a2970 msgr2=0x7f05500a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:22.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.242+0000 7f0556b11640 1 -- 172.21.15.122:0/172582167 shutdown_connections 2024-09-15T12:22:22.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.242+0000 7f0556b11640 1 -- 172.21.15.122:0/172582167 wait complete. 2024-09-15T12:22:22.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.242+0000 7f0556b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:22.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.243+0000 7f0556b11640 1 Processor -- start 2024-09-15T12:22:22.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.243+0000 7f0556b11640 1 -- start start 2024-09-15T12:22:22.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.244+0000 7f0556b11640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05500a44a0 0x7f055012cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.244+0000 7f0556b11640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0550137050 con 0x7f05500a44a0 2024-09-15T12:22:22.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.244+0000 7f05548ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05500a44a0 0x7f055012cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.244+0000 7f05548ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05500a44a0 0x7f055012cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45780/0 (socket says 172.21.15.122:45780) 2024-09-15T12:22:22.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.244+0000 7f05548ad640 1 -- 172.21.15.122:0/692944708 learned_addr learned my addr 172.21.15.122:0/692944708 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:22.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.245+0000 7f05548ad640 1 -- 172.21.15.122:0/692944708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0550135680 con 0x7f05500a44a0 2024-09-15T12:22:22.247 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.245+0000 7f05548ad640 1 --2- 172.21.15.122:0/692944708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05500a44a0 0x7f055012cd80 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.245+0000 7f05457fa640 1 -- 172.21.15.122:0/692944708 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f054c004bc0 con 0x7f05500a44a0 2024-09-15T12:22:22.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.245+0000 7f05457fa640 1 -- 172.21.15.122:0/692944708 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f054c004d20 con 0x7f05500a44a0 2024-09-15T12:22:22.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.245+0000 7f0556b11640 1 -- 172.21.15.122:0/692944708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0550135370 con 0x7f05500a44a0 2024-09-15T12:22:22.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.245+0000 7f05457fa640 1 -- 172.21.15.122:0/692944708 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f054c007120 con 0x7f05500a44a0 2024-09-15T12:22:22.248 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.245+0000 7f0556b11640 1 -- 172.21.15.122:0/692944708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0550137280 con 0x7f05500a44a0 2024-09-15T12:22:22.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.246+0000 7f05457fa640 1 -- 172.21.15.122:0/692944708 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f054c0072d0 con 0x7f05500a44a0 2024-09-15T12:22:22.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.246+0000 7f0556b11640 1 -- 172.21.15.122:0/692944708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0550135870 con 0x7f05500a44a0 2024-09-15T12:22:22.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.246+0000 7f05457fa640 1 --2- 172.21.15.122:0/692944708 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f053c03e930 0x7f053c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.246+0000 7f05457fa640 1 -- 172.21.15.122:0/692944708 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f054c04fee0 con 0x7f05500a44a0 2024-09-15T12:22:22.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.247+0000 7f0547fff640 1 --2- 172.21.15.122:0/692944708 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f053c03e930 0x7f053c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.249 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.247+0000 7f0547fff640 1 --2- 172.21.15.122:0/692944708 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f053c03e930 0x7f053c040e40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.253 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.252+0000 7f05457fa640 1 -- 172.21.15.122:0/692944708 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f054c0066b0 con 0x7f05500a44a0 2024-09-15T12:22:22.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.426+0000 7f0556b11640 1 -- 172.21.15.122:0/692944708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f055012f610 con 0x7f05500a44a0 2024-09-15T12:22:22.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.427+0000 7f05457fa640 1 -- 172.21.15.122:0/692944708 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8900 (crc 0 0 0) 0x7f054c0060b0 con 0x7f05500a44a0 2024-09-15T12:22:22.429 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:22:22.429 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":15,"fsid":"a718c858-230d-4784-bf30-b6c766b34745","created":"2024-09-15T12:22:07.924324+0000","modified":"2024-09-15T12:22:21.420266+0000","last_up_change":"2024-09-15T12:22:16.394814+0000","last_in_change":"2024-09-15T12:22:10.047645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:22:16.402082+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T12:22:18.158875+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9dec0d05-2ec1-4006-9d4a-5af98be8e5e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2464407069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6801","nonce":2464407069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6805","nonce":2464407069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2464407069}]},"public_addr":"172.21.15.122:6800/2464407069","cluster_addr":"172.21.15.122:6801/2464407069","heartbeat_back_addr":"172.21.15.122:6805/2464407069","heartbeat_front_addr":"172.21.15.122:6802/2464407069","state":["exists","up"]},{"osd":1,"uuid":"b0b12d81-07a4-4437-b931-939ed1a94383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6803","nonce":3904627990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3904627990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6809","nonce":3904627990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3904627990}]},"public_addr":"172.21.15.122:6803/3904627990","cluster_addr":"172.21.15.122:6804/3904627990","heartbeat_back_addr":"172.21.15.122:6809/3904627990","heartbeat_front_addr":"172.21.15.122:6808/3904627990","state":["exists","up"]},{"osd":2,"uuid":"f4153355-ac6b-4693-bea0-9e8c15a6bd88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":3269009979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3269009979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3269009979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3269009979}]},"public_addr":"172.21.15.142:6803/3269009979","cluster_addr":"172.21.15.142:6804/3269009979","heartbeat_back_addr":"172.21.15.142:6802/3269009979","heartbeat_front_addr":"172.21.15.142:6805/3269009979","state":["exists","up"]},{"osd":3,"uuid":"70efb372-12e1-471e-a1f6-0d2814bbf30f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":2150609480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2150609480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":2150609480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2150609480}]},"public_addr":"172.21.15.142:6811/2150609480","cluster_addr":"172.21.15.142:6810/2150609480","heartbeat_back_addr":"172.21.15.142:6807/2150609480","heartbeat_front_addr":"172.21.15.142:6806/2150609480","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:22:22.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.429+0000 7f0556b11640 1 -- 172.21.15.122:0/692944708 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f053c03e930 msgr2=0x7f053c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.429+0000 7f0556b11640 1 --2- 172.21.15.122:0/692944708 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f053c03e930 0x7f053c040e40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.429+0000 7f0556b11640 1 -- 172.21.15.122:0/692944708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05500a44a0 msgr2=0x7f055012cd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.429+0000 7f0556b11640 1 --2- 172.21.15.122:0/692944708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05500a44a0 0x7f055012cd80 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.429+0000 7f0556b11640 1 -- 172.21.15.122:0/692944708 shutdown_connections 2024-09-15T12:22:22.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.429+0000 7f0556b11640 1 --2- 172.21.15.122:0/692944708 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f053c03e930 0x7f053c040e40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.429+0000 7f0556b11640 1 --2- 172.21.15.122:0/692944708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05500a44a0 0x7f055012cd80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.429+0000 7f0556b11640 1 -- 172.21.15.122:0/692944708 >> 172.21.15.122:0/692944708 conn(0x7f05500a2970 msgr2=0x7f055009f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:22.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.429+0000 7f0556b11640 1 -- 172.21.15.122:0/692944708 shutdown_connections 2024-09-15T12:22:22.432 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.429+0000 7f0556b11640 1 -- 172.21.15.122:0/692944708 wait complete. 2024-09-15T12:22:22.442 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-15T12:22:22.443 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:22:22.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.545+0000 7f67aa391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:22.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.549+0000 7f67aa391640 1 Processor -- start 2024-09-15T12:22:22.551 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.549+0000 7f67aa391640 1 -- start start 2024-09-15T12:22:22.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.550+0000 7f67aa391640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f67a4068d40 0x7f67a4069150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.551+0000 7f67aa391640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a409d6b0 con 0x7f67a4069690 2024-09-15T12:22:22.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.551+0000 7f67aa391640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f67a409f6f0 con 0x7f67a4068d40 2024-09-15T12:22:22.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.551+0000 7f67a3fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f67a4068d40 0x7f67a4069150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.551+0000 7f67a37fe640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f67a4069690 0x7f67a413a3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:49978/0 (socket says 172.21.15.122:49978) 2024-09-15T12:22:22.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.551+0000 7f67a3fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f67a4068d40 0x7f67a4069150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38818/0 (socket says 172.21.15.122:38818) 2024-09-15T12:22:22.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.551+0000 7f67a37fe640 1 -- 172.21.15.122:0/2574818050 learned_addr learned my addr 172.21.15.122:0/2574818050 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:22:22.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.551+0000 7f67a3fff640 1 -- 172.21.15.122:0/2574818050 >> v1:172.21.15.122:6789/0 conn(0x7f67a4069690 legacy=0x7f67a413a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.551+0000 7f67a3fff640 1 -- 172.21.15.122:0/2574818050 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a406d370 con 0x7f67a4068d40 2024-09-15T12:22:22.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.551+0000 7f67a3fff640 1 --2- 172.21.15.122:0/2574818050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67a4068d40 0x7f67a4069150 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff74eb72ac7cbb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.551+0000 7f67a2ffd640 1 -- 172.21.15.122:0/2574818050 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6794009d90 con 0x7f67a4068d40 2024-09-15T12:22:22.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.551+0000 7f67a2ffd640 1 -- 172.21.15.122:0/2574818050 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f679400e230 con 0x7f67a4068d40 2024-09-15T12:22:22.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.551+0000 7f67a2ffd640 1 -- 172.21.15.122:0/2574818050 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f679400e4d0 con 0x7f67a4068d40 2024-09-15T12:22:22.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.552+0000 7f67aa391640 1 -- 172.21.15.122:0/2574818050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67a4068d40 msgr2=0x7f67a4069150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.552+0000 7f67aa391640 1 --2- 172.21.15.122:0/2574818050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67a4068d40 0x7f67a4069150 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.552+0000 7f67aa391640 1 -- 172.21.15.122:0/2574818050 shutdown_connections 2024-09-15T12:22:22.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.552+0000 7f67aa391640 1 --2- 172.21.15.122:0/2574818050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67a4068d40 0x7f67a4069150 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.552+0000 7f67aa391640 1 -- 172.21.15.122:0/2574818050 >> 172.21.15.122:0/2574818050 conn(0x7f67a40a32a0 msgr2=0x7f67a40a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:22.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.552+0000 7f67aa391640 1 -- 172.21.15.122:0/2574818050 shutdown_connections 2024-09-15T12:22:22.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.552+0000 7f67aa391640 1 -- 172.21.15.122:0/2574818050 wait complete. 2024-09-15T12:22:22.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.552+0000 7f67aa391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:22.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.554+0000 7f67aa391640 1 Processor -- start 2024-09-15T12:22:22.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.554+0000 7f67aa391640 1 -- start start 2024-09-15T12:22:22.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.555+0000 7f67aa391640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67a4068d40 0x7f67a409bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.555+0000 7f67aa391640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f67a409ac90 con 0x7f67a4068d40 2024-09-15T12:22:22.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.555+0000 7f67a3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67a4068d40 0x7f67a409bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.555+0000 7f67a3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67a4068d40 0x7f67a409bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38830/0 (socket says 172.21.15.122:38830) 2024-09-15T12:22:22.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.555+0000 7f67a3fff640 1 -- 172.21.15.122:0/3715587471 learned_addr learned my addr 172.21.15.122:0/3715587471 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:22.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.555+0000 7f67a3fff640 1 -- 172.21.15.122:0/3715587471 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a409a680 con 0x7f67a4068d40 2024-09-15T12:22:22.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.555+0000 7f67a3fff640 1 --2- 172.21.15.122:0/3715587471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67a4068d40 0x7f67a409bb30 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.555+0000 7f67a0ff9640 1 -- 172.21.15.122:0/3715587471 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6794014620 con 0x7f67a4068d40 2024-09-15T12:22:22.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.555+0000 7f67a0ff9640 1 -- 172.21.15.122:0/3715587471 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6794014780 con 0x7f67a4068d40 2024-09-15T12:22:22.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.555+0000 7f67a0ff9640 1 -- 172.21.15.122:0/3715587471 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6794014a20 con 0x7f67a4068d40 2024-09-15T12:22:22.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.555+0000 7f67aa391640 1 -- 172.21.15.122:0/3715587471 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a41be1e0 con 0x7f67a4068d40 2024-09-15T12:22:22.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.556+0000 7f67aa391640 1 -- 172.21.15.122:0/3715587471 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a409af10 con 0x7f67a4068d40 2024-09-15T12:22:22.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.557+0000 7f67a0ff9640 1 -- 172.21.15.122:0/3715587471 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6794014bd0 con 0x7f67a4068d40 2024-09-15T12:22:22.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.557+0000 7f67aa391640 1 -- 172.21.15.122:0/3715587471 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a4077260 con 0x7f67a4068d40 2024-09-15T12:22:22.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.557+0000 7f67a0ff9640 1 --2- 172.21.15.122:0/3715587471 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f679003e930 0x7f6790040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.557+0000 7f67a0ff9640 1 -- 172.21.15.122:0/3715587471 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f6794019040 con 0x7f67a4068d40 2024-09-15T12:22:22.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.557+0000 7f67a37fe640 1 --2- 172.21.15.122:0/3715587471 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f679003e930 0x7f6790040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.558+0000 7f67a37fe640 1 --2- 172.21.15.122:0/3715587471 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f679003e930 0x7f6790040e40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.562+0000 7f67a0ff9640 1 -- 172.21.15.122:0/3715587471 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f6794012390 con 0x7f67a4068d40 2024-09-15T12:22:22.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.737+0000 7f67aa391640 1 -- 172.21.15.122:0/3715587471 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67a40990c0 con 0x7f67a4068d40 2024-09-15T12:22:22.739 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.738+0000 7f67a0ff9640 1 -- 172.21.15.122:0/3715587471 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8900 (crc 0 0 0) 0x7f6794018190 con 0x7f67a4068d40 2024-09-15T12:22:22.740 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:22:22.740 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":15,"fsid":"a718c858-230d-4784-bf30-b6c766b34745","created":"2024-09-15T12:22:07.924324+0000","modified":"2024-09-15T12:22:21.420266+0000","last_up_change":"2024-09-15T12:22:16.394814+0000","last_in_change":"2024-09-15T12:22:10.047645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:22:16.402082+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T12:22:18.158875+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9dec0d05-2ec1-4006-9d4a-5af98be8e5e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2464407069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6801","nonce":2464407069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6805","nonce":2464407069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2464407069}]},"public_addr":"172.21.15.122:6800/2464407069","cluster_addr":"172.21.15.122:6801/2464407069","heartbeat_back_addr":"172.21.15.122:6805/2464407069","heartbeat_front_addr":"172.21.15.122:6802/2464407069","state":["exists","up"]},{"osd":1,"uuid":"b0b12d81-07a4-4437-b931-939ed1a94383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6803","nonce":3904627990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3904627990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6809","nonce":3904627990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3904627990}]},"public_addr":"172.21.15.122:6803/3904627990","cluster_addr":"172.21.15.122:6804/3904627990","heartbeat_back_addr":"172.21.15.122:6809/3904627990","heartbeat_front_addr":"172.21.15.122:6808/3904627990","state":["exists","up"]},{"osd":2,"uuid":"f4153355-ac6b-4693-bea0-9e8c15a6bd88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":3269009979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3269009979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3269009979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3269009979}]},"public_addr":"172.21.15.142:6803/3269009979","cluster_addr":"172.21.15.142:6804/3269009979","heartbeat_back_addr":"172.21.15.142:6802/3269009979","heartbeat_front_addr":"172.21.15.142:6805/3269009979","state":["exists","up"]},{"osd":3,"uuid":"70efb372-12e1-471e-a1f6-0d2814bbf30f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":2150609480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2150609480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":2150609480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2150609480}]},"public_addr":"172.21.15.142:6811/2150609480","cluster_addr":"172.21.15.142:6810/2150609480","heartbeat_back_addr":"172.21.15.142:6807/2150609480","heartbeat_front_addr":"172.21.15.142:6806/2150609480","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:22:22.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.740+0000 7f67aa391640 1 -- 172.21.15.122:0/3715587471 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f679003e930 msgr2=0x7f6790040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.740+0000 7f67aa391640 1 --2- 172.21.15.122:0/3715587471 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f679003e930 0x7f6790040e40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.740+0000 7f67aa391640 1 -- 172.21.15.122:0/3715587471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67a4068d40 msgr2=0x7f67a409bb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.740+0000 7f67aa391640 1 --2- 172.21.15.122:0/3715587471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67a4068d40 0x7f67a409bb30 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.740+0000 7f67aa391640 1 -- 172.21.15.122:0/3715587471 shutdown_connections 2024-09-15T12:22:22.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.740+0000 7f67aa391640 1 --2- 172.21.15.122:0/3715587471 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f679003e930 0x7f6790040e40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.740+0000 7f67aa391640 1 --2- 172.21.15.122:0/3715587471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67a4068d40 0x7f67a409bb30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.740+0000 7f67aa391640 1 -- 172.21.15.122:0/3715587471 >> 172.21.15.122:0/3715587471 conn(0x7f67a40a32a0 msgr2=0x7f67a41be3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:22.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.740+0000 7f67aa391640 1 -- 172.21.15.122:0/3715587471 shutdown_connections 2024-09-15T12:22:22.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.740+0000 7f67aa391640 1 -- 172.21.15.122:0/3715587471 wait complete. 2024-09-15T12:22:22.753 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-15T12:22:22.754 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-15T12:22:22.754 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-15T12:22:22.755 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-15T12:22:22.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.866+0000 7f1b73391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:22.873 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.866+0000 7f3b344ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:22.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.866+0000 7fabfc511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:22.874 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.866+0000 7f058d06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:22.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.872+0000 7f1b73391640 1 Processor -- start 2024-09-15T12:22:22.875 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.872+0000 7f058d06c640 1 Processor -- start 2024-09-15T12:22:22.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.872+0000 7fabfc511640 1 Processor -- start 2024-09-15T12:22:22.876 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.872+0000 7f3b344ac640 1 Processor -- start 2024-09-15T12:22:22.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.872+0000 7f058d06c640 1 -- start start 2024-09-15T12:22:22.877 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.872+0000 7f3b344ac640 1 -- start start 2024-09-15T12:22:22.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.872+0000 7fabfc511640 1 -- start start 2024-09-15T12:22:22.878 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.872+0000 7f1b73391640 1 -- start start 2024-09-15T12:22:22.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7f058d06c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0588132790 0x7f0588132ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7f058d06c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0588098840 con 0x7f058809b680 2024-09-15T12:22:22.879 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7f058d06c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f058809ac90 con 0x7f0588132790 2024-09-15T12:22:22.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7f3b344ac640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3b2c12f730 0x7f3b2c12fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7f1b73391640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1b6c09f040 0x7f1b6c068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7f3b344ac640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b2c09ddb0 con 0x7f3b2c130080 2024-09-15T12:22:22.880 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7f3b344ac640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f3b2c09dfe0 con 0x7f3b2c12f730 2024-09-15T12:22:22.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7f1b73391640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b6c06d370 con 0x7f1b6c09e910 2024-09-15T12:22:22.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7f1b73391640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f1b6c070cb0 con 0x7f1b6c09f040 2024-09-15T12:22:22.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7f0586d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0588132790 0x7f0588132ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.881 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7f0586d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0588132790 0x7f0588132ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38836/0 (socket says 172.21.15.122:38836) 2024-09-15T12:22:22.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7f0586d9d640 1 -- 172.21.15.122:0/925054305 learned_addr learned my addr 172.21.15.122:0/925054305 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:22.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7fabfc511640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fabf41360f0 0x7fabf4136500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7fabfc511640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabf40a5c40 con 0x7fabf409e170 2024-09-15T12:22:22.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7fabfc511640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fabf40a6010 con 0x7fabf41360f0 2024-09-15T12:22:22.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7f3b31a47640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f3b2c130080 0x7f3b2c09c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:50000/0 (socket says 172.21.15.122:50000) 2024-09-15T12:22:22.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7fabfa2ad640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fabf41360f0 0x7fabf4136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7f3b31a47640 1 -- 172.21.15.122:0/1000012890 learned_addr learned my addr 172.21.15.122:0/1000012890 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:22:22.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7f3b32248640 1 --2- 172.21.15.122:0/1000012890 >> v2:172.21.15.122:3300/0 conn(0x7f3b2c12f730 0x7f3b2c12fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.873+0000 7fabfa2ad640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fabf41360f0 0x7fabf4136500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38858/0 (socket says 172.21.15.122:38858) 2024-09-15T12:22:22.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7fabfa2ad640 1 -- 172.21.15.122:0/851456167 learned_addr learned my addr 172.21.15.122:0/851456167 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:22.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7f1b7112d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1b6c09f040 0x7f1b6c068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7f1b7112d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1b6c09f040 0x7f1b6c068d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38844/0 (socket says 172.21.15.122:38844) 2024-09-15T12:22:22.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7f1b7112d640 1 -- 172.21.15.122:0/3810129587 learned_addr learned my addr 172.21.15.122:0/3810129587 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:22.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7f0586d9d640 1 -- 172.21.15.122:0/925054305 >> v1:172.21.15.122:6789/0 conn(0x7f058809b680 legacy=0x7f058809ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7f0586d9d640 1 -- 172.21.15.122:0/925054305 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058809cb70 con 0x7f0588132790 2024-09-15T12:22:22.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7fabfa2ad640 1 -- 172.21.15.122:0/851456167 >> v1:172.21.15.122:6789/0 conn(0x7fabf409e170 legacy=0x7fabf409e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T12:22:22.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7fabfa2ad640 1 -- 172.21.15.122:0/851456167 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf409f510 con 0x7fabf41360f0 2024-09-15T12:22:22.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7f1b7112d640 1 -- 172.21.15.122:0/3810129587 >> v1:172.21.15.122:6789/0 conn(0x7f1b6c09e910 legacy=0x7f1b6c069280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7f1b7112d640 1 -- 172.21.15.122:0/3810129587 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6c09c1c0 con 0x7f1b6c09f040 2024-09-15T12:22:22.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7fabfa2ad640 1 --2- 172.21.15.122:0/851456167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf41360f0 0x7fabf4136500 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a499fdd5e16a563e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7f3b32248640 1 -- 172.21.15.122:0/1000012890 >> v1:172.21.15.122:6789/0 conn(0x7f3b2c130080 legacy=0x7f3b2c09c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7f3b32248640 1 -- 172.21.15.122:0/1000012890 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2c098180 con 0x7f3b2c12f730 2024-09-15T12:22:22.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7f1b7112d640 1 --2- 172.21.15.122:0/3810129587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b6c09f040 0x7f1b6c068d40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df50da9e6d41c2df server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.887 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7f0586d9d640 1 --2- 172.21.15.122:0/925054305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0588132790 0x7f0588132ba0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bdaf02276665a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.874+0000 7fabf92ab640 1 -- 172.21.15.122:0/851456167 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fabf0009db0 con 0x7fabf41360f0 2024-09-15T12:22:22.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.875+0000 7f3b32248640 1 --2- 172.21.15.122:0/1000012890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b2c12f730 0x7f3b2c12fb40 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f233118024bda87 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.888 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.875+0000 7f1b63fff640 1 -- 172.21.15.122:0/3810129587 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1b68009e50 con 0x7f1b6c09f040 2024-09-15T12:22:22.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.875+0000 7fabf92ab640 1 -- 172.21.15.122:0/851456167 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fabf000e230 con 0x7fabf41360f0 2024-09-15T12:22:22.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.875+0000 7fabf92ab640 1 -- 172.21.15.122:0/851456167 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fabf000e4d0 con 0x7fabf41360f0 2024-09-15T12:22:22.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.875+0000 7f3b31246640 1 -- 172.21.15.122:0/1000012890 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b2400e040 con 0x7f3b2c12f730 2024-09-15T12:22:22.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.875+0000 7f1b63fff640 1 -- 172.21.15.122:0/3810129587 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1b6800e230 con 0x7f1b6c09f040 2024-09-15T12:22:22.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.875+0000 7f1b63fff640 1 -- 172.21.15.122:0/3810129587 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1b6800e4d0 con 0x7f1b6c09f040 2024-09-15T12:22:22.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.875+0000 7f0585d9b640 1 -- 172.21.15.122:0/925054305 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0578009e40 con 0x7f0588132790 2024-09-15T12:22:22.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.875+0000 7f0585d9b640 1 -- 172.21.15.122:0/925054305 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0578010440 con 0x7f0588132790 2024-09-15T12:22:22.890 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.875+0000 7f0585d9b640 1 -- 172.21.15.122:0/925054305 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f05780106e0 con 0x7f0588132790 2024-09-15T12:22:22.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.875+0000 7f3b31246640 1 -- 172.21.15.122:0/1000012890 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3b24007670 con 0x7f3b2c12f730 2024-09-15T12:22:22.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.875+0000 7f3b31246640 1 -- 172.21.15.122:0/1000012890 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b24007910 con 0x7f3b2c12f730 2024-09-15T12:22:22.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7fabfc511640 1 -- 172.21.15.122:0/851456167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf41360f0 msgr2=0x7fabf4136500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.891 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7fabfc511640 1 --2- 172.21.15.122:0/851456167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf41360f0 0x7fabf4136500 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f058d06c640 1 -- 172.21.15.122:0/925054305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0588132790 msgr2=0x7f0588132ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f058d06c640 1 --2- 172.21.15.122:0/925054305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0588132790 0x7f0588132ba0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f1b73391640 1 -- 172.21.15.122:0/3810129587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b6c09f040 msgr2=0x7f1b6c068d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f1b73391640 1 --2- 172.21.15.122:0/3810129587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b6c09f040 0x7f1b6c068d40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f058d06c640 1 -- 172.21.15.122:0/925054305 shutdown_connections 2024-09-15T12:22:22.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f058d06c640 1 --2- 172.21.15.122:0/925054305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0588132790 0x7f0588132ba0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f058d06c640 1 -- 172.21.15.122:0/925054305 >> 172.21.15.122:0/925054305 conn(0x7f05880a11f0 msgr2=0x7f05880a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:22.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f1b73391640 1 -- 172.21.15.122:0/3810129587 shutdown_connections 2024-09-15T12:22:22.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f1b73391640 1 --2- 172.21.15.122:0/3810129587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b6c09f040 0x7f1b6c068d40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7fabfc511640 1 -- 172.21.15.122:0/851456167 shutdown_connections 2024-09-15T12:22:22.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7fabfc511640 1 --2- 172.21.15.122:0/851456167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf41360f0 0x7fabf4136500 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f1b73391640 1 -- 172.21.15.122:0/3810129587 >> 172.21.15.122:0/3810129587 conn(0x7f1b6c0a32a0 msgr2=0x7f1b6c0a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:22.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f3b344ac640 1 -- 172.21.15.122:0/1000012890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b2c12f730 msgr2=0x7f3b2c12fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f3b344ac640 1 --2- 172.21.15.122:0/1000012890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b2c12f730 0x7f3b2c12fb40 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7fabfc511640 1 -- 172.21.15.122:0/851456167 >> 172.21.15.122:0/851456167 conn(0x7fabf406f850 msgr2=0x7fabf409ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:22.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f058d06c640 1 -- 172.21.15.122:0/925054305 shutdown_connections 2024-09-15T12:22:22.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f058d06c640 1 -- 172.21.15.122:0/925054305 wait complete. 2024-09-15T12:22:22.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7fabfc511640 1 -- 172.21.15.122:0/851456167 shutdown_connections 2024-09-15T12:22:22.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7fabfc511640 1 -- 172.21.15.122:0/851456167 wait complete. 2024-09-15T12:22:22.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f1b73391640 1 -- 172.21.15.122:0/3810129587 shutdown_connections 2024-09-15T12:22:22.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f1b73391640 1 -- 172.21.15.122:0/3810129587 wait complete. 2024-09-15T12:22:22.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f3b344ac640 1 -- 172.21.15.122:0/1000012890 shutdown_connections 2024-09-15T12:22:22.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f3b344ac640 1 --2- 172.21.15.122:0/1000012890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b2c12f730 0x7f3b2c12fb40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f3b344ac640 1 -- 172.21.15.122:0/1000012890 >> 172.21.15.122:0/1000012890 conn(0x7f3b2c0a11f0 msgr2=0x7f3b2c0a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:22.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f3b344ac640 1 -- 172.21.15.122:0/1000012890 shutdown_connections 2024-09-15T12:22:22.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f3b344ac640 1 -- 172.21.15.122:0/1000012890 wait complete. 2024-09-15T12:22:22.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f058d06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:22.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7fabfc511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:22.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f1b73391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:22.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.876+0000 7f3b344ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:22.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.878+0000 7f3b344ac640 1 Processor -- start 2024-09-15T12:22:22.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.878+0000 7f3b344ac640 1 -- start start 2024-09-15T12:22:22.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.878+0000 7f058d06c640 1 Processor -- start 2024-09-15T12:22:22.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.878+0000 7f058d06c640 1 -- start start 2024-09-15T12:22:22.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.879+0000 7f1b73391640 1 Processor -- start 2024-09-15T12:22:22.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.879+0000 7fabfc511640 1 Processor -- start 2024-09-15T12:22:22.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.879+0000 7f1b73391640 1 -- start start 2024-09-15T12:22:22.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.879+0000 7f3b344ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b2c12f730 0x7f3b2c073a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.879+0000 7f3b344ac640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2c06f920 con 0x7f3b2c12f730 2024-09-15T12:22:22.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.879+0000 7fabfc511640 1 -- start start 2024-09-15T12:22:22.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.879+0000 7f3b32248640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b2c12f730 0x7f3b2c073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.879+0000 7f3b32248640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b2c12f730 0x7f3b2c073a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38872/0 (socket says 172.21.15.122:38872) 2024-09-15T12:22:22.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.879+0000 7f3b32248640 1 -- 172.21.15.122:0/889067664 learned_addr learned my addr 172.21.15.122:0/889067664 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:22.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.879+0000 7f058d06c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f058809b680 0x7f058812a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.879+0000 7f0586d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f058809b680 0x7f058812a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.879+0000 7f3b32248640 1 -- 172.21.15.122:0/889067664 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2c0737f0 con 0x7f3b2c12f730 2024-09-15T12:22:22.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.879+0000 7f0586d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f058809b680 0x7f058812a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38884/0 (socket says 172.21.15.122:38884) 2024-09-15T12:22:22.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.879+0000 7f0586d9d640 1 -- 172.21.15.122:0/857706971 learned_addr learned my addr 172.21.15.122:0/857706971 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:22.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.879+0000 7f058d06c640 1 -- 172.21.15.122:0/857706971 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f058812b3f0 con 0x7f058809b680 2024-09-15T12:22:22.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.879+0000 7f3b32248640 1 --2- 172.21.15.122:0/889067664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b2c12f730 0x7f3b2c073a70 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.880+0000 7f3b22ffd640 1 -- 172.21.15.122:0/889067664 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b2400e040 con 0x7f3b2c12f730 2024-09-15T12:22:22.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.880+0000 7f3b22ffd640 1 -- 172.21.15.122:0/889067664 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3b24011c10 con 0x7f3b2c12f730 2024-09-15T12:22:22.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.880+0000 7f3b344ac640 1 -- 172.21.15.122:0/889067664 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2c071270 con 0x7f3b2c12f730 2024-09-15T12:22:22.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.880+0000 7f0586d9d640 1 -- 172.21.15.122:0/857706971 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05881311d0 con 0x7f058809b680 2024-09-15T12:22:22.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.880+0000 7f3b344ac640 1 -- 172.21.15.122:0/889067664 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b2c074b20 con 0x7f3b2c12f730 2024-09-15T12:22:22.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.880+0000 7f0586d9d640 1 --2- 172.21.15.122:0/857706971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f058809b680 0x7f058812a0b0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7f3b22ffd640 1 -- 172.21.15.122:0/889067664 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b2400e040 con 0x7f3b2c12f730 2024-09-15T12:22:22.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7f1b73391640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b6c09e910 0x7f1b6c130240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7f057f7fe640 1 -- 172.21.15.122:0/857706971 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0578015040 con 0x7f058809b680 2024-09-15T12:22:22.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7f057f7fe640 1 -- 172.21.15.122:0/857706971 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f057800f710 con 0x7f058809b680 2024-09-15T12:22:22.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7f057f7fe640 1 -- 172.21.15.122:0/857706971 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f057800f9b0 con 0x7f058809b680 2024-09-15T12:22:22.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7f1b73391640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6c133910 con 0x7f1b6c09e910 2024-09-15T12:22:22.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7fabfc511640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf409e170 0x7fabf4121b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7f1b7112d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b6c09e910 0x7f1b6c130240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7f058d06c640 1 -- 172.21.15.122:0/857706971 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058812e090 con 0x7f058809b680 2024-09-15T12:22:22.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7f1b7112d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b6c09e910 0x7f1b6c130240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38886/0 (socket says 172.21.15.122:38886) 2024-09-15T12:22:22.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7f1b7112d640 1 -- 172.21.15.122:0/2507278640 learned_addr learned my addr 172.21.15.122:0/2507278640 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:22.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7f058d06c640 1 -- 172.21.15.122:0/857706971 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0588131d50 con 0x7f058809b680 2024-09-15T12:22:22.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7fabfa2ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf409e170 0x7fabf4121b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7fabfa2ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf409e170 0x7fabf4121b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38894/0 (socket says 172.21.15.122:38894) 2024-09-15T12:22:22.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7fabfa2ad640 1 -- 172.21.15.122:0/1766323571 learned_addr learned my addr 172.21.15.122:0/1766323571 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:22.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7fabfc511640 1 -- 172.21.15.122:0/1766323571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fabf4125ac0 con 0x7fabf409e170 2024-09-15T12:22:22.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7f3b344ac640 1 -- 172.21.15.122:0/889067664 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b2c12e020 con 0x7f3b2c12f730 2024-09-15T12:22:22.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7fabfa2ad640 1 -- 172.21.15.122:0/1766323571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf4125790 con 0x7fabf409e170 2024-09-15T12:22:22.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.882+0000 7fabfa2ad640 1 --2- 172.21.15.122:0/1766323571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf409e170 0x7fabf4121b00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.881+0000 7f3b22ffd640 1 -- 172.21.15.122:0/889067664 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3b24015450 con 0x7f3b2c12f730 2024-09-15T12:22:22.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.882+0000 7f3b22ffd640 1 --2- 172.21.15.122:0/889067664 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3b1003e920 0x7f3b10040e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.882+0000 7fabeaffd640 1 -- 172.21.15.122:0/1766323571 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fabf000ee40 con 0x7fabf409e170 2024-09-15T12:22:22.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.882+0000 7fabfc511640 1 -- 172.21.15.122:0/1766323571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf40a4930 con 0x7fabf409e170 2024-09-15T12:22:22.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.882+0000 7fabeaffd640 1 -- 172.21.15.122:0/1766323571 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fabf0015420 con 0x7fabf409e170 2024-09-15T12:22:22.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.882+0000 7fabfc511640 1 -- 172.21.15.122:0/1766323571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf41253a0 con 0x7fabf409e170 2024-09-15T12:22:22.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.882+0000 7f3b22ffd640 1 -- 172.21.15.122:0/889067664 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f3b2400fac0 con 0x7f3b2c12f730 2024-09-15T12:22:22.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.882+0000 7f3b22ffd640 1 --2- 172.21.15.122:0/889067664 >> v2:172.21.15.122:6803/3904627990 conn(0x7f3b10044120 0x7f3b10046610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.882+0000 7f3b22ffd640 1 -- 172.21.15.122:0/889067664 --> v2:172.21.15.122:6803/3904627990 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b10046ca0 con 0x7f3b10044120 2024-09-15T12:22:22.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.882+0000 7f1b7112d640 1 -- 172.21.15.122:0/2507278640 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6c131b10 con 0x7f1b6c09e910 2024-09-15T12:22:22.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.882+0000 7fabeaffd640 1 -- 172.21.15.122:0/1766323571 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fabf00156c0 con 0x7fabf409e170 2024-09-15T12:22:22.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.882+0000 7f057f7fe640 1 -- 172.21.15.122:0/857706971 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f057800fb10 con 0x7f058809b680 2024-09-15T12:22:22.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.883+0000 7f3b22ffd640 1 -- 172.21.15.122:0/889067664 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f3b24007910 con 0x7f3b2c12f730 2024-09-15T12:22:22.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.883+0000 7f058d06c640 1 -- 172.21.15.122:0/857706971 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f058809a1a0 con 0x7f058809b680 2024-09-15T12:22:22.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.883+0000 7f1b7112d640 1 --2- 172.21.15.122:0/2507278640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b6c09e910 0x7f1b6c130240 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.913 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.883+0000 7fabfc511640 1 -- 172.21.15.122:0/1766323571 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fabf406fec0 con 0x7fabf409e170 2024-09-15T12:22:22.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.883+0000 7f057f7fe640 1 --2- 172.21.15.122:0/857706971 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f056803e9d0 0x7f0568040ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.883+0000 7f3b31a47640 1 --2- 172.21.15.122:0/889067664 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3b1003e920 0x7f3b10040e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.883+0000 7f057f7fe640 1 -- 172.21.15.122:0/857706971 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f0578050660 con 0x7f058809b680 2024-09-15T12:22:22.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.883+0000 7f057f7fe640 1 --2- 172.21.15.122:0/857706971 >> v2:172.21.15.142:6803/3269009979 conn(0x7f05680439d0 0x7f0568045ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.883+0000 7f057f7fe640 1 -- 172.21.15.122:0/857706971 --> v2:172.21.15.142:6803/3269009979 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0568046530 con 0x7f05680439d0 2024-09-15T12:22:22.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.883+0000 7f057f7fe640 1 -- 172.21.15.122:0/857706971 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f0578016e40 con 0x7f058809b680 2024-09-15T12:22:22.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.883+0000 7f058659c640 1 --2- 172.21.15.122:0/857706971 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f056803e9d0 0x7f0568040ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.883+0000 7f3b32a49640 1 --2- 172.21.15.122:0/889067664 >> v2:172.21.15.122:6803/3904627990 conn(0x7f3b10044120 0x7f3b10046610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:22:22.915 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.883+0000 7f1b61ffb640 1 -- 172.21.15.122:0/2507278640 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1b6800ee10 con 0x7f1b6c09e910 2024-09-15T12:22:22.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.884+0000 7fabeaffd640 1 -- 172.21.15.122:0/1766323571 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fabf00158c0 con 0x7fabf409e170 2024-09-15T12:22:22.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.884+0000 7f3b31a47640 1 --2- 172.21.15.122:0/889067664 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3b1003e920 0x7f3b10040e30 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.884+0000 7fabeaffd640 1 --2- 172.21.15.122:0/1766323571 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fabd803e910 0x7fabd8040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.884+0000 7f1b61ffb640 1 -- 172.21.15.122:0/2507278640 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1b68015420 con 0x7f1b6c09e910 2024-09-15T12:22:22.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.884+0000 7f1b61ffb640 1 -- 172.21.15.122:0/2507278640 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1b680156c0 con 0x7f1b6c09e910 2024-09-15T12:22:22.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.884+0000 7f1b73391640 1 -- 172.21.15.122:0/2507278640 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b6c133b00 con 0x7f1b6c09e910 2024-09-15T12:22:22.917 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.884+0000 7f1b73391640 1 -- 172.21.15.122:0/2507278640 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b6c133430 con 0x7f1b6c09e910 2024-09-15T12:22:22.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.884+0000 7fabeaffd640 1 -- 172.21.15.122:0/1766323571 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fabf0050dd0 con 0x7fabf409e170 2024-09-15T12:22:22.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.884+0000 7fabeaffd640 1 --2- 172.21.15.122:0/1766323571 >> v2:172.21.15.142:6811/2150609480 conn(0x7fabd8043910 0x7fabd8045de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.884+0000 7fabf9aac640 1 --2- 172.21.15.122:0/1766323571 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fabd803e910 0x7fabd8040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.885+0000 7fabeaffd640 1 -- 172.21.15.122:0/1766323571 --> v2:172.21.15.142:6811/2150609480 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fabd8046470 con 0x7fabd8043910 2024-09-15T12:22:22.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.885+0000 7fabeaffd640 1 -- 172.21.15.122:0/1766323571 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7fabf000f2a0 con 0x7fabf409e170 2024-09-15T12:22:22.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.885+0000 7f058759e640 1 --2- 172.21.15.122:0/857706971 >> v2:172.21.15.142:6803/3269009979 conn(0x7f05680439d0 0x7f0568045ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:22:22.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.885+0000 7f058659c640 1 --2- 172.21.15.122:0/857706971 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f056803e9d0 0x7f0568040ee0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.885+0000 7fabf9aac640 1 --2- 172.21.15.122:0/1766323571 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fabd803e910 0x7fabd8040e20 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.885+0000 7f1b73391640 1 -- 172.21.15.122:0/2507278640 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1b6c134160 con 0x7f1b6c09e910 2024-09-15T12:22:22.920 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.885+0000 7fabfaaae640 1 --2- 172.21.15.122:0/1766323571 >> v2:172.21.15.142:6811/2150609480 conn(0x7fabd8043910 0x7fabd8045de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:22:22.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.886+0000 7f1b61ffb640 1 -- 172.21.15.122:0/2507278640 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1b68015870 con 0x7f1b6c09e910 2024-09-15T12:22:22.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.886+0000 7f1b61ffb640 1 --2- 172.21.15.122:0/2507278640 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f1b5003e930 0x7f1b50040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.886+0000 7f1b61ffb640 1 -- 172.21.15.122:0/2507278640 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f1b68050df0 con 0x7f1b6c09e910 2024-09-15T12:22:22.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.887+0000 7f1b61ffb640 1 --2- 172.21.15.122:0/2507278640 >> v2:172.21.15.122:6800/2464407069 conn(0x7f1b50043930 0x7f1b50045e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:22.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.887+0000 7f1b61ffb640 1 -- 172.21.15.122:0/2507278640 --> v2:172.21.15.122:6800/2464407069 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b50046490 con 0x7f1b50043930 2024-09-15T12:22:22.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.887+0000 7f1b61ffb640 1 -- 172.21.15.122:0/2507278640 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f1b680511d0 con 0x7f1b6c09e910 2024-09-15T12:22:22.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.887+0000 7f1b7092c640 1 --2- 172.21.15.122:0/2507278640 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f1b5003e930 0x7f1b50040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:22.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.887+0000 7f1b7092c640 1 --2- 172.21.15.122:0/2507278640 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f1b5003e930 0x7f1b50040e40 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.888+0000 7f1b7192e640 1 --2- 172.21.15.122:0/2507278640 >> v2:172.21.15.122:6800/2464407069 conn(0x7f1b50043930 0x7f1b50045e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:22:22.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.888+0000 7f3b32a49640 1 --2- 172.21.15.122:0/889067664 >> v2:172.21.15.122:6803/3904627990 conn(0x7f3b10044120 0x7f3b10046610 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.889+0000 7fabfaaae640 1 --2- 172.21.15.122:0/1766323571 >> v2:172.21.15.142:6811/2150609480 conn(0x7fabd8043910 0x7fabd8045de0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.889+0000 7f058759e640 1 --2- 172.21.15.122:0/857706971 >> v2:172.21.15.142:6803/3269009979 conn(0x7f05680439d0 0x7f0568045ea0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.890+0000 7f3b22ffd640 1 -- 172.21.15.122:0/889067664 <== osd.1 v2:172.21.15.122:6803/3904627990 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f3b10046ca0 con 0x7f3b10044120 2024-09-15T12:22:22.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.890+0000 7fabeaffd640 1 -- 172.21.15.122:0/1766323571 <== osd.3 v2:172.21.15.142:6811/2150609480 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7fabd8046470 con 0x7fabd8043910 2024-09-15T12:22:22.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.891+0000 7f057f7fe640 1 -- 172.21.15.122:0/857706971 <== osd.2 v2:172.21.15.142:6803/3269009979 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f0568046530 con 0x7f05680439d0 2024-09-15T12:22:22.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.892+0000 7f1b7192e640 1 --2- 172.21.15.122:0/2507278640 >> v2:172.21.15.122:6800/2464407069 conn(0x7f1b50043930 0x7f1b50045e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:22.925 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.894+0000 7f3b344ac640 1 -- 172.21.15.122:0/889067664 --> v2:172.21.15.122:6803/3904627990 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b2c098a10 con 0x7f3b10044120 2024-09-15T12:22:22.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.894+0000 7f1b61ffb640 1 -- 172.21.15.122:0/2507278640 <== osd.0 v2:172.21.15.122:6800/2464407069 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f1b50046490 con 0x7f1b50043930 2024-09-15T12:22:22.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.895+0000 7f3b22ffd640 1 -- 172.21.15.122:0/889067664 <== osd.1 v2:172.21.15.122:6803/3904627990 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3b28009830 con 0x7f3b10044120 2024-09-15T12:22:22.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.895+0000 7fabfc511640 1 -- 172.21.15.122:0/1766323571 --> v2:172.21.15.142:6811/2150609480 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fabf40a1120 con 0x7fabd8043910 2024-09-15T12:22:22.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.896+0000 7f3b344ac640 1 -- 172.21.15.122:0/889067664 >> v2:172.21.15.122:6803/3904627990 conn(0x7f3b10044120 msgr2=0x7f3b10046610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.896+0000 7f3b344ac640 1 --2- 172.21.15.122:0/889067664 >> v2:172.21.15.122:6803/3904627990 conn(0x7f3b10044120 0x7f3b10046610 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.896+0000 7f3b344ac640 1 -- 172.21.15.122:0/889067664 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3b1003e920 msgr2=0x7f3b10040e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.896+0000 7f3b344ac640 1 --2- 172.21.15.122:0/889067664 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3b1003e920 0x7f3b10040e30 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.896+0000 7f3b344ac640 1 -- 172.21.15.122:0/889067664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b2c12f730 msgr2=0x7f3b2c073a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.896+0000 7f3b344ac640 1 --2- 172.21.15.122:0/889067664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b2c12f730 0x7f3b2c073a70 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.896+0000 7f3b344ac640 1 -- 172.21.15.122:0/889067664 shutdown_connections 2024-09-15T12:22:22.928 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.896+0000 7f3b344ac640 1 --2- 172.21.15.122:0/889067664 >> v2:172.21.15.122:6803/3904627990 conn(0x7f3b10044120 0x7f3b10046610 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.929 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.896+0000 7f3b344ac640 1 --2- 172.21.15.122:0/889067664 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3b1003e920 0x7f3b10040e30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.929 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.896+0000 7f3b344ac640 1 --2- 172.21.15.122:0/889067664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b2c12f730 0x7f3b2c073a70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.929 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.896+0000 7f3b344ac640 1 -- 172.21.15.122:0/889067664 >> 172.21.15.122:0/889067664 conn(0x7f3b2c0a11f0 msgr2=0x7f3b2c12ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:22.929 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.896+0000 7f3b344ac640 1 -- 172.21.15.122:0/889067664 shutdown_connections 2024-09-15T12:22:22.929 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.896+0000 7f3b344ac640 1 -- 172.21.15.122:0/889067664 wait complete. 2024-09-15T12:22:22.929 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.897+0000 7fabeaffd640 1 -- 172.21.15.122:0/1766323571 <== osd.3 v2:172.21.15.142:6811/2150609480 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fabec00a820 con 0x7fabd8043910 2024-09-15T12:22:22.929 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.897+0000 7f058d06c640 1 -- 172.21.15.122:0/857706971 --> v2:172.21.15.142:6803/3269009979 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f058809df90 con 0x7f05680439d0 2024-09-15T12:22:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.898+0000 7fabe8ff9640 1 -- 172.21.15.122:0/1766323571 >> v2:172.21.15.142:6811/2150609480 conn(0x7fabd8043910 msgr2=0x7fabd8045de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.898+0000 7fabe8ff9640 1 --2- 172.21.15.122:0/1766323571 >> v2:172.21.15.142:6811/2150609480 conn(0x7fabd8043910 0x7fabd8045de0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.898+0000 7fabe8ff9640 1 -- 172.21.15.122:0/1766323571 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fabd803e910 msgr2=0x7fabd8040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.898+0000 7fabe8ff9640 1 --2- 172.21.15.122:0/1766323571 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fabd803e910 0x7fabd8040e20 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.898+0000 7fabe8ff9640 1 -- 172.21.15.122:0/1766323571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf409e170 msgr2=0x7fabf4121b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.898+0000 7fabe8ff9640 1 --2- 172.21.15.122:0/1766323571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf409e170 0x7fabf4121b00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.931 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.898+0000 7fabe8ff9640 1 -- 172.21.15.122:0/1766323571 shutdown_connections 2024-09-15T12:22:22.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.898+0000 7fabe8ff9640 1 --2- 172.21.15.122:0/1766323571 >> v2:172.21.15.142:6811/2150609480 conn(0x7fabd8043910 0x7fabd8045de0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.898+0000 7fabe8ff9640 1 --2- 172.21.15.122:0/1766323571 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fabd803e910 0x7fabd8040e20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.898+0000 7fabe8ff9640 1 --2- 172.21.15.122:0/1766323571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabf409e170 0x7fabf4121b00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.898+0000 7fabe8ff9640 1 -- 172.21.15.122:0/1766323571 >> 172.21.15.122:0/1766323571 conn(0x7fabf406f850 msgr2=0x7fabf41bdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:22.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.898+0000 7fabe8ff9640 1 -- 172.21.15.122:0/1766323571 shutdown_connections 2024-09-15T12:22:22.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.898+0000 7fabe8ff9640 1 -- 172.21.15.122:0/1766323571 wait complete. 2024-09-15T12:22:22.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.899+0000 7f057f7fe640 1 -- 172.21.15.122:0/857706971 <== osd.2 v2:172.21.15.142:6803/3269009979 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f058000a820 con 0x7f05680439d0 2024-09-15T12:22:22.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.900+0000 7f1b73391640 1 -- 172.21.15.122:0/2507278640 --> v2:172.21.15.122:6800/2464407069 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1b6c070340 con 0x7f1b50043930 2024-09-15T12:22:22.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.900+0000 7f058d06c640 1 -- 172.21.15.122:0/857706971 >> v2:172.21.15.142:6803/3269009979 conn(0x7f05680439d0 msgr2=0x7f0568045ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.900+0000 7f058d06c640 1 --2- 172.21.15.122:0/857706971 >> v2:172.21.15.142:6803/3269009979 conn(0x7f05680439d0 0x7f0568045ea0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.900+0000 7f058d06c640 1 -- 172.21.15.122:0/857706971 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f056803e9d0 msgr2=0x7f0568040ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.900+0000 7f058d06c640 1 --2- 172.21.15.122:0/857706971 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f056803e9d0 0x7f0568040ee0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.900+0000 7f058d06c640 1 -- 172.21.15.122:0/857706971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f058809b680 msgr2=0x7f058812a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.900+0000 7f058d06c640 1 --2- 172.21.15.122:0/857706971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f058809b680 0x7f058812a0b0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.900+0000 7f058d06c640 1 -- 172.21.15.122:0/857706971 shutdown_connections 2024-09-15T12:22:22.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.900+0000 7f058d06c640 1 --2- 172.21.15.122:0/857706971 >> v2:172.21.15.142:6803/3269009979 conn(0x7f05680439d0 0x7f0568045ea0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.900+0000 7f058d06c640 1 --2- 172.21.15.122:0/857706971 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f056803e9d0 0x7f0568040ee0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.900+0000 7f058d06c640 1 --2- 172.21.15.122:0/857706971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f058809b680 0x7f058812a0b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.900+0000 7f058d06c640 1 -- 172.21.15.122:0/857706971 >> 172.21.15.122:0/857706971 conn(0x7f05880a11f0 msgr2=0x7f058806efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:22.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.901+0000 7f058d06c640 1 -- 172.21.15.122:0/857706971 shutdown_connections 2024-09-15T12:22:22.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.901+0000 7f058d06c640 1 -- 172.21.15.122:0/857706971 wait complete. 2024-09-15T12:22:22.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.905+0000 7f1b61ffb640 1 -- 172.21.15.122:0/2507278640 <== osd.0 v2:172.21.15.122:6800/2464407069 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1b6400a820 con 0x7f1b50043930 2024-09-15T12:22:22.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.905+0000 7f1b4f7fe640 1 -- 172.21.15.122:0/2507278640 >> v2:172.21.15.122:6800/2464407069 conn(0x7f1b50043930 msgr2=0x7f1b50045e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.905+0000 7f1b4f7fe640 1 --2- 172.21.15.122:0/2507278640 >> v2:172.21.15.122:6800/2464407069 conn(0x7f1b50043930 0x7f1b50045e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.905+0000 7f1b4f7fe640 1 -- 172.21.15.122:0/2507278640 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f1b5003e930 msgr2=0x7f1b50040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.905+0000 7f1b4f7fe640 1 --2- 172.21.15.122:0/2507278640 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f1b5003e930 0x7f1b50040e40 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.905+0000 7f1b4f7fe640 1 -- 172.21.15.122:0/2507278640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b6c09e910 msgr2=0x7f1b6c130240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.905+0000 7f1b4f7fe640 1 --2- 172.21.15.122:0/2507278640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b6c09e910 0x7f1b6c130240 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.906+0000 7f1b4f7fe640 1 -- 172.21.15.122:0/2507278640 shutdown_connections 2024-09-15T12:22:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.906+0000 7f1b4f7fe640 1 --2- 172.21.15.122:0/2507278640 >> v2:172.21.15.122:6800/2464407069 conn(0x7f1b50043930 0x7f1b50045e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.906+0000 7f1b4f7fe640 1 --2- 172.21.15.122:0/2507278640 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f1b5003e930 0x7f1b50040e40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.906+0000 7f1b4f7fe640 1 --2- 172.21.15.122:0/2507278640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b6c09e910 0x7f1b6c130240 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:22.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.906+0000 7f1b4f7fe640 1 -- 172.21.15.122:0/2507278640 >> 172.21.15.122:0/2507278640 conn(0x7f1b6c0a32a0 msgr2=0x7f1b6c09fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:22.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.906+0000 7f1b4f7fe640 1 -- 172.21.15.122:0/2507278640 shutdown_connections 2024-09-15T12:22:22.939 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:22.907+0000 7f1b4f7fe640 1 -- 172.21.15.122:0/2507278640 wait complete. 2024-09-15T12:22:22.940 INFO:teuthology.orchestra.run.smithi122.stdout:38654705671 2024-09-15T12:22:22.940 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T12:22:22.941 INFO:teuthology.orchestra.run.smithi122.stdout:42949672966 2024-09-15T12:22:22.942 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T12:22:22.943 INFO:teuthology.orchestra.run.smithi122.stdout:38654705671 2024-09-15T12:22:22.943 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T12:22:22.944 INFO:teuthology.orchestra.run.smithi122.stdout:38654705671 2024-09-15T12:22:22.944 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T12:22:23.100 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.094+0000 7f2fbd151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:23.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.094+0000 7f6284911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:23.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.094+0000 7f6b45191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:23.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.094+0000 7fd1f32ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:23.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.100+0000 7f2fbd151640 1 Processor -- start 2024-09-15T12:22:23.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.100+0000 7f2fbd151640 1 -- start start 2024-09-15T12:22:23.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.100+0000 7f6b45191640 1 Processor -- start 2024-09-15T12:22:23.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.100+0000 7fd1f32ec640 1 Processor -- start 2024-09-15T12:22:23.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.100+0000 7f6b45191640 1 -- start start 2024-09-15T12:22:23.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.100+0000 7f6284911640 1 Processor -- start 2024-09-15T12:22:23.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.100+0000 7f6284911640 1 -- start start 2024-09-15T12:22:23.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.100+0000 7fd1f32ec640 1 -- start start 2024-09-15T12:22:23.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.101+0000 7f6b45191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6b4009db00 0x7f6b4009df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.101+0000 7f6b45191640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b4009ed40 con 0x7f6b4009e450 2024-09-15T12:22:23.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.101+0000 7f6284911640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f628009d570 0x7f628013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.101+0000 7f6b45191640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f6b400a0700 con 0x7f6b4009db00 2024-09-15T12:22:23.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.101+0000 7f6284911640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62800a0060 con 0x7f628009ca50 2024-09-15T12:22:23.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.101+0000 7f6284911640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f628009fd30 con 0x7f628009d570 2024-09-15T12:22:23.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.101+0000 7f6b3ed9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6b4009db00 0x7f6b4009df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.101+0000 7f6b3ed9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6b4009db00 0x7f6b4009df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38908/0 (socket says 172.21.15.122:38908) 2024-09-15T12:22:23.106 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.101+0000 7f6b3ed9d640 1 -- 172.21.15.122:0/1947699089 learned_addr learned my addr 172.21.15.122:0/1947699089 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:23.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.101+0000 7f6277fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f628009d570 0x7f628013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.101+0000 7f6277fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f628009d570 0x7f628013b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38918/0 (socket says 172.21.15.122:38918) 2024-09-15T12:22:23.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.101+0000 7f6277fff640 1 -- 172.21.15.122:0/1318049852 learned_addr learned my addr 172.21.15.122:0/1318049852 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:23.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.101+0000 7f627e59c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f628009ca50 0x7f628009ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:50032/0 (socket says 172.21.15.122:50032) 2024-09-15T12:22:23.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.102+0000 7f6b3ed9d640 1 -- 172.21.15.122:0/1947699089 >> v1:172.21.15.122:6789/0 conn(0x7f6b4009e450 legacy=0x7f6b40138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.102+0000 7f6b3dd9b640 1 -- 172.21.15.122:0/1947699089 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1165363994 0 0) 0x7f6b4009ed40 con 0x7f6b4009e450 2024-09-15T12:22:23.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.102+0000 7f6b3ed9d640 1 -- 172.21.15.122:0/1947699089 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4009fbd0 con 0x7f6b4009db00 2024-09-15T12:22:23.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.102+0000 7f6277fff640 1 -- 172.21.15.122:0/1318049852 >> v1:172.21.15.122:6789/0 conn(0x7f628009ca50 legacy=0x7f628009ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.102+0000 7f6277fff640 1 -- 172.21.15.122:0/1318049852 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628009e3c0 con 0x7f628009d570 2024-09-15T12:22:23.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.102+0000 7f6b3ed9d640 1 --2- 172.21.15.122:0/1947699089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b4009db00 0x7f6b4009df10 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b1dc249713127c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.102+0000 7f6277fff640 1 --2- 172.21.15.122:0/1318049852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f628009d570 0x7f628013b3b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76692cf40ca0beb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.102+0000 7f6b3dd9b640 1 -- 172.21.15.122:0/1947699089 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6b30009e40 con 0x7f6b4009db00 2024-09-15T12:22:23.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.102+0000 7f6b3dd9b640 1 -- 172.21.15.122:0/1947699089 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6b3000e230 con 0x7f6b4009db00 2024-09-15T12:22:23.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.102+0000 7f6b3dd9b640 1 -- 172.21.15.122:0/1947699089 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6b3000e4d0 con 0x7f6b4009db00 2024-09-15T12:22:23.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.102+0000 7f627dd9b640 1 -- 172.21.15.122:0/1318049852 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6268009e40 con 0x7f628009d570 2024-09-15T12:22:23.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.102+0000 7f627dd9b640 1 -- 172.21.15.122:0/1318049852 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f626800e230 con 0x7f628009d570 2024-09-15T12:22:23.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.102+0000 7f627dd9b640 1 -- 172.21.15.122:0/1318049852 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f626800e4d0 con 0x7f628009d570 2024-09-15T12:22:23.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.102+0000 7f2fbd151640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2fb81360f0 0x7f2fb8136500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7f2fbd151640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fb80a5c40 con 0x7f2fb809e170 2024-09-15T12:22:23.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7f2fbd151640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb80a6010 con 0x7f2fb81360f0 2024-09-15T12:22:23.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7f2fb6d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2fb81360f0 0x7f2fb8136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7f2fb6d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2fb81360f0 0x7f2fb8136500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38934/0 (socket says 172.21.15.122:38934) 2024-09-15T12:22:23.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7f2fb6d9d640 1 -- 172.21.15.122:0/3199794182 learned_addr learned my addr 172.21.15.122:0/3199794182 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:23.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7fd1f32ec640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd1ec09ca50 0x7fd1ec09ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7fd1f32ec640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1ec0a0060 con 0x7fd1ec09d3a0 2024-09-15T12:22:23.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7fd1f32ec640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fd1ec09fd30 con 0x7fd1ec09ca50 2024-09-15T12:22:23.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7f2fb5d9b640 1 -- 172.21.15.122:0/3199794182 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222530265 0 0) 0x7f2fb80a5c40 con 0x7f2fb809e170 2024-09-15T12:22:23.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7fd1f0887640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd1ec09d3a0 0x7fd1ec135ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:50066/0 (socket says 172.21.15.122:50066) 2024-09-15T12:22:23.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7fd1f0887640 1 -- 172.21.15.122:0/3919565156 learned_addr learned my addr 172.21.15.122:0/3919565156 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:22:23.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7f2fb5d9b640 1 -- 172.21.15.122:0/3199794182 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fa0003580 con 0x7f2fb809e170 2024-09-15T12:22:23.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7f2fb6d9d640 1 -- 172.21.15.122:0/3199794182 >> v1:172.21.15.122:6789/0 conn(0x7f2fb809e170 legacy=0x7f2fb809e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7fd1f1088640 1 --2- 172.21.15.122:0/3919565156 >> v2:172.21.15.122:3300/0 conn(0x7fd1ec09ca50 0x7fd1ec09ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7f6b45191640 1 -- 172.21.15.122:0/1947699089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b4009db00 msgr2=0x7f6b4009df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7f6b45191640 1 --2- 172.21.15.122:0/1947699089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b4009db00 0x7f6b4009df10 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.103+0000 7f2fb6d9d640 1 -- 172.21.15.122:0/3199794182 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb809f510 con 0x7f2fb81360f0 2024-09-15T12:22:23.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7fd1e3fff640 1 -- 172.21.15.122:0/3919565156 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 443553626 0 0) 0x7fd1ec0a0060 con 0x7fd1ec09d3a0 2024-09-15T12:22:23.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f6b45191640 1 -- 172.21.15.122:0/1947699089 shutdown_connections 2024-09-15T12:22:23.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f6b45191640 1 --2- 172.21.15.122:0/1947699089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b4009db00 0x7f6b4009df10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f6284911640 1 -- 172.21.15.122:0/1318049852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f628009d570 msgr2=0x7f628013b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f6284911640 1 --2- 172.21.15.122:0/1318049852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f628009d570 0x7f628013b3b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7fd1e3fff640 1 -- 172.21.15.122:0/3919565156 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1d8003580 con 0x7fd1ec09d3a0 2024-09-15T12:22:23.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f6284911640 1 -- 172.21.15.122:0/1318049852 shutdown_connections 2024-09-15T12:22:23.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f6284911640 1 --2- 172.21.15.122:0/1318049852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f628009d570 0x7f628013b3b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f6284911640 1 -- 172.21.15.122:0/1318049852 >> 172.21.15.122:0/1318049852 conn(0x7f62800a5230 msgr2=0x7f62800a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:23.116 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f6284911640 1 -- 172.21.15.122:0/1318049852 shutdown_connections 2024-09-15T12:22:23.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7fd1f1088640 1 -- 172.21.15.122:0/3919565156 >> v1:172.21.15.122:6789/0 conn(0x7fd1ec09d3a0 legacy=0x7fd1ec135ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7fd1f1088640 1 -- 172.21.15.122:0/3919565156 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ec09e3c0 con 0x7fd1ec09ca50 2024-09-15T12:22:23.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f6284911640 1 -- 172.21.15.122:0/1318049852 wait complete. 2024-09-15T12:22:23.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f6b45191640 1 -- 172.21.15.122:0/1947699089 >> 172.21.15.122:0/1947699089 conn(0x7f6b400a45b0 msgr2=0x7f6b400a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:23.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f6b45191640 1 -- 172.21.15.122:0/1947699089 shutdown_connections 2024-09-15T12:22:23.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f6b45191640 1 -- 172.21.15.122:0/1947699089 wait complete. 2024-09-15T12:22:23.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f2fb6d9d640 1 --2- 172.21.15.122:0/3199794182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fb81360f0 0x7f2fb8136500 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f8ebda8ea8cd27 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7fd1f1088640 1 --2- 172.21.15.122:0/3919565156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec09ce60 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf426d70e74429e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f6b45191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:23.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f2fb5d9b640 1 -- 172.21.15.122:0/3199794182 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2fa8009e50 con 0x7f2fb81360f0 2024-09-15T12:22:23.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f6284911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:23.119 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f2fb5d9b640 1 -- 172.21.15.122:0/3199794182 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2fa800e230 con 0x7f2fb81360f0 2024-09-15T12:22:23.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7f2fb5d9b640 1 -- 172.21.15.122:0/3199794182 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2fa800e4d0 con 0x7f2fb81360f0 2024-09-15T12:22:23.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7fd1e3fff640 1 -- 172.21.15.122:0/3919565156 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd1e8009d80 con 0x7fd1ec09ca50 2024-09-15T12:22:23.120 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7fd1e3fff640 1 -- 172.21.15.122:0/3919565156 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd1e800e230 con 0x7fd1ec09ca50 2024-09-15T12:22:23.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.104+0000 7fd1e3fff640 1 -- 172.21.15.122:0/3919565156 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd1e800e4d0 con 0x7fd1ec09ca50 2024-09-15T12:22:23.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.105+0000 7fd1f32ec640 1 -- 172.21.15.122:0/3919565156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ec09ca50 msgr2=0x7fd1ec09ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.105+0000 7fd1f32ec640 1 --2- 172.21.15.122:0/3919565156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec09ce60 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.105+0000 7f2fbd151640 1 -- 172.21.15.122:0/3199794182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fb81360f0 msgr2=0x7f2fb8136500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.106+0000 7f6284911640 1 Processor -- start 2024-09-15T12:22:23.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.105+0000 7f2fbd151640 1 --2- 172.21.15.122:0/3199794182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fb81360f0 0x7f2fb8136500 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.106+0000 7fd1f32ec640 1 -- 172.21.15.122:0/3919565156 shutdown_connections 2024-09-15T12:22:23.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.106+0000 7f2fbd151640 1 -- 172.21.15.122:0/3199794182 shutdown_connections 2024-09-15T12:22:23.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.106+0000 7fd1f32ec640 1 --2- 172.21.15.122:0/3919565156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec09ce60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.106+0000 7f2fbd151640 1 --2- 172.21.15.122:0/3199794182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fb81360f0 0x7f2fb8136500 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.106+0000 7f6284911640 1 -- start start 2024-09-15T12:22:23.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.106+0000 7fd1f32ec640 1 -- 172.21.15.122:0/3919565156 >> 172.21.15.122:0/3919565156 conn(0x7fd1ec0a5230 msgr2=0x7fd1ec0a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:23.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.106+0000 7f2fbd151640 1 -- 172.21.15.122:0/3199794182 >> 172.21.15.122:0/3199794182 conn(0x7f2fb806f850 msgr2=0x7f2fb809ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:23.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.106+0000 7f2fbd151640 1 -- 172.21.15.122:0/3199794182 shutdown_connections 2024-09-15T12:22:23.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.106+0000 7f2fbd151640 1 -- 172.21.15.122:0/3199794182 wait complete. 2024-09-15T12:22:23.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.106+0000 7fd1f32ec640 1 -- 172.21.15.122:0/3919565156 shutdown_connections 2024-09-15T12:22:23.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.106+0000 7fd1f32ec640 1 -- 172.21.15.122:0/3919565156 wait complete. 2024-09-15T12:22:23.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.106+0000 7f6b45191640 1 Processor -- start 2024-09-15T12:22:23.125 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.106+0000 7f2fbd151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:23.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.106+0000 7f6b45191640 1 -- start start 2024-09-15T12:22:23.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.106+0000 7fd1f32ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:23.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.107+0000 7f6284911640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f628009ca50 0x7f6280122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.107+0000 7f6284911640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6280124260 con 0x7f628009ca50 2024-09-15T12:22:23.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.107+0000 7f627e59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f628009ca50 0x7f6280122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.107+0000 7f6b45191640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b4009db00 0x7f6b40093280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.107+0000 7f627e59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f628009ca50 0x7f6280122dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38958/0 (socket says 172.21.15.122:38958) 2024-09-15T12:22:23.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.107+0000 7f627e59c640 1 -- 172.21.15.122:0/1766863428 learned_addr learned my addr 172.21.15.122:0/1766863428 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:23.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.107+0000 7f6b45191640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6b40097120 con 0x7f6b4009db00 2024-09-15T12:22:23.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.107+0000 7f6b3ed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b4009db00 0x7f6b40093280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.107+0000 7f6b3ed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b4009db00 0x7f6b40093280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38964/0 (socket says 172.21.15.122:38964) 2024-09-15T12:22:23.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.107+0000 7f6b3ed9d640 1 -- 172.21.15.122:0/2516006997 learned_addr learned my addr 172.21.15.122:0/2516006997 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:23.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7fd1f32ec640 1 Processor -- start 2024-09-15T12:22:23.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7fd1f32ec640 1 -- start start 2024-09-15T12:22:23.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7f2fbd151640 1 Processor -- start 2024-09-15T12:22:23.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7f627e59c640 1 -- 172.21.15.122:0/1766863428 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6280126cf0 con 0x7f628009ca50 2024-09-15T12:22:23.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7f2fbd151640 1 -- start start 2024-09-15T12:22:23.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7f627e59c640 1 --2- 172.21.15.122:0/1766863428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f628009ca50 0x7f6280122dc0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7f6b3ed9d640 1 -- 172.21.15.122:0/2516006997 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b40096260 con 0x7f6b4009db00 2024-09-15T12:22:23.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7f6b3ed9d640 1 --2- 172.21.15.122:0/2516006997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b4009db00 0x7f6b40093280 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7f6276ffd640 1 -- 172.21.15.122:0/1766863428 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62700059a0 con 0x7f628009ca50 2024-09-15T12:22:23.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7f6284911640 1 -- 172.21.15.122:0/1766863428 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62801269c0 con 0x7f628009ca50 2024-09-15T12:22:23.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7f6276ffd640 1 -- 172.21.15.122:0/1766863428 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6270005b00 con 0x7f628009ca50 2024-09-15T12:22:23.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7f6276ffd640 1 -- 172.21.15.122:0/1766863428 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6270005da0 con 0x7f628009ca50 2024-09-15T12:22:23.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7f6b277fe640 1 -- 172.21.15.122:0/2516006997 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6b3000ee10 con 0x7f6b4009db00 2024-09-15T12:22:23.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7f6284911640 1 -- 172.21.15.122:0/1766863428 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6280126620 con 0x7f628009ca50 2024-09-15T12:22:23.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.109+0000 7fd1f32ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec121eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.109+0000 7fd1f32ec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec125100 con 0x7fd1ec09ca50 2024-09-15T12:22:23.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7f6b277fe640 1 -- 172.21.15.122:0/2516006997 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6b30015420 con 0x7f6b4009db00 2024-09-15T12:22:23.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7f6b277fe640 1 -- 172.21.15.122:0/2516006997 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6b300156c0 con 0x7f6b4009db00 2024-09-15T12:22:23.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7f6b45191640 1 -- 172.21.15.122:0/2516006997 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b40074580 con 0x7f6b4009db00 2024-09-15T12:22:23.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.108+0000 7f6b45191640 1 -- 172.21.15.122:0/2516006997 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b40095ec0 con 0x7f6b4009db00 2024-09-15T12:22:23.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.109+0000 7f2fbd151640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fb809e170 0x7f2fb8121cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.109+0000 7f2fbd151640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb8125c90 con 0x7f2fb809e170 2024-09-15T12:22:23.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.110+0000 7fd1f1088640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec121eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.110+0000 7fd1f1088640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec121eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38974/0 (socket says 172.21.15.122:38974) 2024-09-15T12:22:23.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.110+0000 7fd1f1088640 1 -- 172.21.15.122:0/3213799074 learned_addr learned my addr 172.21.15.122:0/3213799074 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:23.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.110+0000 7f6284911640 1 -- 172.21.15.122:0/1766863428 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6280125120 con 0x7f628009ca50 2024-09-15T12:22:23.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.110+0000 7f2fb6d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fb809e170 0x7f2fb8121cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.110+0000 7f2fb6d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fb809e170 0x7f2fb8121cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38978/0 (socket says 172.21.15.122:38978) 2024-09-15T12:22:23.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.110+0000 7f2fb6d9d640 1 -- 172.21.15.122:0/3522223765 learned_addr learned my addr 172.21.15.122:0/3522223765 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:23.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.110+0000 7f6b45191640 1 -- 172.21.15.122:0/2516006997 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b400008d0 con 0x7f6b4009db00 2024-09-15T12:22:23.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.110+0000 7fd1f1088640 1 -- 172.21.15.122:0/3213799074 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ec123930 con 0x7fd1ec09ca50 2024-09-15T12:22:23.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.110+0000 7f2fb6d9d640 1 -- 172.21.15.122:0/3522223765 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb8123730 con 0x7f2fb809e170 2024-09-15T12:22:23.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.110+0000 7f6276ffd640 1 -- 172.21.15.122:0/1766863428 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f62700070b0 con 0x7f628009ca50 2024-09-15T12:22:23.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.110+0000 7f2fb6d9d640 1 --2- 172.21.15.122:0/3522223765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fb809e170 0x7f2fb8121cf0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.110+0000 7fd1f1088640 1 --2- 172.21.15.122:0/3213799074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec121eb0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.110+0000 7f2f9f7fe640 1 -- 172.21.15.122:0/3522223765 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2fa800eb60 con 0x7f2fb809e170 2024-09-15T12:22:23.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.110+0000 7f6276ffd640 1 --2- 172.21.15.122:0/1766863428 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f626403e910 0x7f6264040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.111+0000 7fd1e1ffb640 1 -- 172.21.15.122:0/3213799074 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd1e8013400 con 0x7fd1ec09ca50 2024-09-15T12:22:23.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.111+0000 7f2fbd151640 1 -- 172.21.15.122:0/3522223765 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb80a48a0 con 0x7f2fb809e170 2024-09-15T12:22:23.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.111+0000 7f2fbd151640 1 -- 172.21.15.122:0/3522223765 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb8135a10 con 0x7f2fb809e170 2024-09-15T12:22:23.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.111+0000 7f6b277fe640 1 -- 172.21.15.122:0/2516006997 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6b30015870 con 0x7f6b4009db00 2024-09-15T12:22:23.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.111+0000 7f6276ffd640 1 -- 172.21.15.122:0/1766863428 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f627004f6b0 con 0x7f628009ca50 2024-09-15T12:22:23.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.111+0000 7fd1f32ec640 1 -- 172.21.15.122:0/3213799074 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ec124df0 con 0x7fd1ec09ca50 2024-09-15T12:22:23.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.111+0000 7fd1f32ec640 1 -- 172.21.15.122:0/3213799074 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ec125b20 con 0x7fd1ec09ca50 2024-09-15T12:22:23.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.111+0000 7f6277fff640 1 --2- 172.21.15.122:0/1766863428 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f626403e910 0x7f6264040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.111+0000 7f6b277fe640 1 --2- 172.21.15.122:0/2516006997 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6b2c03e960 0x7f6b2c040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.111+0000 7f6b277fe640 1 -- 172.21.15.122:0/2516006997 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f6b30050d50 con 0x7f6b4009db00 2024-09-15T12:22:23.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.111+0000 7f6b3e59c640 1 --2- 172.21.15.122:0/2516006997 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6b2c03e960 0x7f6b2c040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.112+0000 7f6277fff640 1 --2- 172.21.15.122:0/1766863428 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f626403e910 0x7f6264040e20 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.112+0000 7f2fbd151640 1 -- 172.21.15.122:0/3522223765 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb80008d0 con 0x7f2fb809e170 2024-09-15T12:22:23.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.112+0000 7f6b3e59c640 1 --2- 172.21.15.122:0/2516006997 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6b2c03e960 0x7f6b2c040e70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.112+0000 7fd1f32ec640 1 -- 172.21.15.122:0/3213799074 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1ec125f90 con 0x7fd1ec09ca50 2024-09-15T12:22:23.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.116+0000 7fd1e1ffb640 1 -- 172.21.15.122:0/3213799074 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd1e8013560 con 0x7fd1ec09ca50 2024-09-15T12:22:23.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.116+0000 7fd1e1ffb640 1 -- 172.21.15.122:0/3213799074 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd1e8013800 con 0x7fd1ec09ca50 2024-09-15T12:22:23.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.116+0000 7f6276ffd640 1 -- 172.21.15.122:0/1766863428 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f627000dc60 con 0x7f628009ca50 2024-09-15T12:22:23.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.116+0000 7f2f9f7fe640 1 -- 172.21.15.122:0/3522223765 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2fa800ecc0 con 0x7f2fb809e170 2024-09-15T12:22:23.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.117+0000 7f2f9f7fe640 1 -- 172.21.15.122:0/3522223765 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2fa8015420 con 0x7f2fb809e170 2024-09-15T12:22:23.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.122+0000 7f6b277fe640 1 -- 172.21.15.122:0/2516006997 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f6b30010a00 con 0x7f6b4009db00 2024-09-15T12:22:23.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.123+0000 7fd1e1ffb640 1 -- 172.21.15.122:0/3213799074 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd1e80123f0 con 0x7fd1ec09ca50 2024-09-15T12:22:23.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.123+0000 7fd1e1ffb640 1 --2- 172.21.15.122:0/3213799074 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd1d003e930 0x7fd1d0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.123+0000 7fd1e1ffb640 1 -- 172.21.15.122:0/3213799074 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fd1e8018040 con 0x7fd1ec09ca50 2024-09-15T12:22:23.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.124+0000 7fd1f0887640 1 --2- 172.21.15.122:0/3213799074 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd1d003e930 0x7fd1d0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.124+0000 7f2f9f7fe640 1 -- 172.21.15.122:0/3522223765 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2fa8015580 con 0x7f2fb809e170 2024-09-15T12:22:23.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.124+0000 7f2f9f7fe640 1 --2- 172.21.15.122:0/3522223765 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f2fa403e930 0x7f2fa4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.124+0000 7f2f9f7fe640 1 -- 172.21.15.122:0/3522223765 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f2fa8050c20 con 0x7f2fb809e170 2024-09-15T12:22:23.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.124+0000 7fd1f0887640 1 --2- 172.21.15.122:0/3213799074 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd1d003e930 0x7fd1d0040e40 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.124+0000 7f2fb659c640 1 --2- 172.21.15.122:0/3522223765 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f2fa403e930 0x7f2fa4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.125+0000 7f2fb659c640 1 --2- 172.21.15.122:0/3522223765 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f2fa403e930 0x7f2fa4040e40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.144 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.129+0000 7fd1e1ffb640 1 -- 172.21.15.122:0/3213799074 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fd1e8011710 con 0x7fd1ec09ca50 2024-09-15T12:22:23.145 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.134+0000 7f2f9f7fe640 1 -- 172.21.15.122:0/3522223765 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f2fa8011380 con 0x7f2fb809e170 2024-09-15T12:22:23.300 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.299+0000 7f6284911640 1 -- 172.21.15.122:0/1766863428 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f628009ce60 con 0x7f628009ca50 2024-09-15T12:22:23.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.300+0000 7f6276ffd640 1 -- 172.21.15.122:0/1766863428 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f627000d660 con 0x7f628009ca50 2024-09-15T12:22:23.301 INFO:teuthology.orchestra.run.smithi122.stdout:38654705671 2024-09-15T12:22:23.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.303+0000 7f6284911640 1 -- 172.21.15.122:0/1766863428 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f626403e910 msgr2=0x7f6264040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.303+0000 7f6284911640 1 --2- 172.21.15.122:0/1766863428 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f626403e910 0x7f6264040e20 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.303+0000 7f6284911640 1 -- 172.21.15.122:0/1766863428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f628009ca50 msgr2=0x7f6280122dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.303+0000 7f6284911640 1 --2- 172.21.15.122:0/1766863428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f628009ca50 0x7f6280122dc0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.303+0000 7f6284911640 1 -- 172.21.15.122:0/1766863428 shutdown_connections 2024-09-15T12:22:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.303+0000 7f6284911640 1 --2- 172.21.15.122:0/1766863428 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f626403e910 0x7f6264040e20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.303+0000 7f6284911640 1 --2- 172.21.15.122:0/1766863428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f628009ca50 0x7f6280122dc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.303+0000 7f6284911640 1 -- 172.21.15.122:0/1766863428 >> 172.21.15.122:0/1766863428 conn(0x7f62800a5230 msgr2=0x7f62800a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.303+0000 7f6284911640 1 -- 172.21.15.122:0/1766863428 shutdown_connections 2024-09-15T12:22:23.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.303+0000 7f6284911640 1 -- 172.21.15.122:0/1766863428 wait complete. 2024-09-15T12:22:23.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.316+0000 7fd1f32ec640 1 -- 172.21.15.122:0/3213799074 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd1ec125f90 con 0x7fd1ec09ca50 2024-09-15T12:22:23.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.316+0000 7fd1e1ffb640 1 -- 172.21.15.122:0/3213799074 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7fd1ec125f90 con 0x7fd1ec09ca50 2024-09-15T12:22:23.318 INFO:teuthology.orchestra.run.smithi122.stdout:38654705671 2024-09-15T12:22:23.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2024-09-15T12:22:23.320 DEBUG:teuthology.parallel:result is None 2024-09-15T12:22:23.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.319+0000 7fd1f32ec640 1 -- 172.21.15.122:0/3213799074 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd1d003e930 msgr2=0x7fd1d0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.319+0000 7fd1f32ec640 1 --2- 172.21.15.122:0/3213799074 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd1d003e930 0x7fd1d0040e40 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.319+0000 7fd1f32ec640 1 -- 172.21.15.122:0/3213799074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ec09ca50 msgr2=0x7fd1ec121eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.319+0000 7fd1f32ec640 1 --2- 172.21.15.122:0/3213799074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec121eb0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.319+0000 7fd1f32ec640 1 -- 172.21.15.122:0/3213799074 shutdown_connections 2024-09-15T12:22:23.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.319+0000 7fd1f32ec640 1 --2- 172.21.15.122:0/3213799074 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd1d003e930 0x7fd1d0040e40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.319+0000 7fd1f32ec640 1 --2- 172.21.15.122:0/3213799074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1ec09ca50 0x7fd1ec121eb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.319+0000 7fd1f32ec640 1 -- 172.21.15.122:0/3213799074 >> 172.21.15.122:0/3213799074 conn(0x7fd1ec0a5230 msgr2=0x7fd1ec0a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:23.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.319+0000 7fd1f32ec640 1 -- 172.21.15.122:0/3213799074 shutdown_connections 2024-09-15T12:22:23.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.319+0000 7fd1f32ec640 1 -- 172.21.15.122:0/3213799074 wait complete. 2024-09-15T12:22:23.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.1 2024-09-15T12:22:23.331 DEBUG:teuthology.parallel:result is None 2024-09-15T12:22:23.342 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.341+0000 7f6b45191640 1 -- 172.21.15.122:0/2516006997 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6b4009df10 con 0x7f6b4009db00 2024-09-15T12:22:23.343 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.341+0000 7f6b277fe640 1 -- 172.21.15.122:0/2516006997 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f6b30011dd0 con 0x7f6b4009db00 2024-09-15T12:22:23.343 INFO:teuthology.orchestra.run.smithi122.stdout:38654705671 2024-09-15T12:22:23.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.343+0000 7f6b45191640 1 -- 172.21.15.122:0/2516006997 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6b2c03e960 msgr2=0x7f6b2c040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.343+0000 7f6b45191640 1 --2- 172.21.15.122:0/2516006997 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6b2c03e960 0x7f6b2c040e70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.343+0000 7f6b45191640 1 -- 172.21.15.122:0/2516006997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b4009db00 msgr2=0x7f6b40093280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.343+0000 7f6b45191640 1 --2- 172.21.15.122:0/2516006997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b4009db00 0x7f6b40093280 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.343+0000 7f6b45191640 1 -- 172.21.15.122:0/2516006997 shutdown_connections 2024-09-15T12:22:23.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.343+0000 7f6b45191640 1 --2- 172.21.15.122:0/2516006997 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6b2c03e960 0x7f6b2c040e70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.343+0000 7f6b45191640 1 --2- 172.21.15.122:0/2516006997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b4009db00 0x7f6b40093280 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.343+0000 7f6b45191640 1 -- 172.21.15.122:0/2516006997 >> 172.21.15.122:0/2516006997 conn(0x7f6b400a45b0 msgr2=0x7f6b400732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:23.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.344+0000 7f6b45191640 1 -- 172.21.15.122:0/2516006997 shutdown_connections 2024-09-15T12:22:23.346 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.344+0000 7f6b45191640 1 -- 172.21.15.122:0/2516006997 wait complete. 2024-09-15T12:22:23.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.344+0000 7f2fbd151640 1 -- 172.21.15.122:0/3522223765 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2fb8125010 con 0x7f2fb809e170 2024-09-15T12:22:23.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.345+0000 7f2f9f7fe640 1 -- 172.21.15.122:0/3522223765 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f2fa8010820 con 0x7f2fb809e170 2024-09-15T12:22:23.347 INFO:teuthology.orchestra.run.smithi122.stdout:42949672966 2024-09-15T12:22:23.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.347+0000 7f2fbd151640 1 -- 172.21.15.122:0/3522223765 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f2fa403e930 msgr2=0x7f2fa4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.347+0000 7f2fbd151640 1 --2- 172.21.15.122:0/3522223765 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f2fa403e930 0x7f2fa4040e40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.347+0000 7f2fbd151640 1 -- 172.21.15.122:0/3522223765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fb809e170 msgr2=0x7f2fb8121cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.347+0000 7f2fbd151640 1 --2- 172.21.15.122:0/3522223765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fb809e170 0x7f2fb8121cf0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.349 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.347+0000 7f2fbd151640 1 -- 172.21.15.122:0/3522223765 shutdown_connections 2024-09-15T12:22:23.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.347+0000 7f2fbd151640 1 --2- 172.21.15.122:0/3522223765 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f2fa403e930 0x7f2fa4040e40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.347+0000 7f2fbd151640 1 --2- 172.21.15.122:0/3522223765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fb809e170 0x7f2fb8121cf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.347+0000 7f2fbd151640 1 -- 172.21.15.122:0/3522223765 >> 172.21.15.122:0/3522223765 conn(0x7f2fb806f850 msgr2=0x7f2fb80a6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:23.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.347+0000 7f2fbd151640 1 -- 172.21.15.122:0/3522223765 shutdown_connections 2024-09-15T12:22:23.350 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.347+0000 7f2fbd151640 1 -- 172.21.15.122:0/3522223765 wait complete. 2024-09-15T12:22:23.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-09-15T12:22:23.360 DEBUG:teuthology.parallel:result is None 2024-09-15T12:22:23.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.3 2024-09-15T12:22:23.362 DEBUG:teuthology.parallel:result is None 2024-09-15T12:22:23.362 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T12:22:23.362 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:22:23.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.505+0000 7fd4a5257640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:23.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.510+0000 7fd4a5257640 1 Processor -- start 2024-09-15T12:22:23.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.510+0000 7fd4a5257640 1 -- start start 2024-09-15T12:22:23.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.511+0000 7fd4a5257640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd4a0135c90 0x7fd4a01380b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.511+0000 7fd4a5257640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4a009f420 con 0x7fd4a009b470 2024-09-15T12:22:23.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.511+0000 7fd4a5257640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fd4a0075380 con 0x7fd4a0135c90 2024-09-15T12:22:23.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.511+0000 7fd49ed9d640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd4a009b470 0x7fd4a009b880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:50070/0 (socket says 172.21.15.122:50070) 2024-09-15T12:22:23.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.511+0000 7fd49ed9d640 1 -- 172.21.15.122:0/2487583957 learned_addr learned my addr 172.21.15.122:0/2487583957 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:22:23.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.511+0000 7fd497fff640 1 --2- 172.21.15.122:0/2487583957 >> v2:172.21.15.122:3300/0 conn(0x7fd4a0135c90 0x7fd4a01380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.512+0000 7fd497fff640 1 -- 172.21.15.122:0/2487583957 >> v1:172.21.15.122:6789/0 conn(0x7fd4a009b470 legacy=0x7fd4a009b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.512+0000 7fd497fff640 1 -- 172.21.15.122:0/2487583957 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a006d370 con 0x7fd4a0135c90 2024-09-15T12:22:23.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.512+0000 7fd497fff640 1 --2- 172.21.15.122:0/2487583957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4a0135c90 0x7fd4a01380b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695214b37254915 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.512+0000 7fd49e59c640 1 -- 172.21.15.122:0/2487583957 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd488009d90 con 0x7fd4a0135c90 2024-09-15T12:22:23.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.512+0000 7fd49e59c640 1 -- 172.21.15.122:0/2487583957 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd48800e230 con 0x7fd4a0135c90 2024-09-15T12:22:23.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.512+0000 7fd49e59c640 1 -- 172.21.15.122:0/2487583957 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd48800e4d0 con 0x7fd4a0135c90 2024-09-15T12:22:23.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.513+0000 7fd4a5257640 1 -- 172.21.15.122:0/2487583957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4a0135c90 msgr2=0x7fd4a01380b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.513+0000 7fd4a5257640 1 --2- 172.21.15.122:0/2487583957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4a0135c90 0x7fd4a01380b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.513+0000 7fd4a5257640 1 -- 172.21.15.122:0/2487583957 shutdown_connections 2024-09-15T12:22:23.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.513+0000 7fd4a5257640 1 --2- 172.21.15.122:0/2487583957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4a0135c90 0x7fd4a01380b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.513+0000 7fd4a5257640 1 -- 172.21.15.122:0/2487583957 >> 172.21.15.122:0/2487583957 conn(0x7fd4a00a32a0 msgr2=0x7fd4a00a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:23.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.513+0000 7fd4a5257640 1 -- 172.21.15.122:0/2487583957 shutdown_connections 2024-09-15T12:22:23.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.513+0000 7fd4a5257640 1 -- 172.21.15.122:0/2487583957 wait complete. 2024-09-15T12:22:23.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.513+0000 7fd4a5257640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:23.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.514+0000 7fd4a5257640 1 Processor -- start 2024-09-15T12:22:23.516 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.514+0000 7fd4a5257640 1 -- start start 2024-09-15T12:22:23.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.515+0000 7fd4a5257640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4a009b470 0x7fd4a012c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.515+0000 7fd4a5257640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a012f880 con 0x7fd4a009b470 2024-09-15T12:22:23.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.515+0000 7fd49ed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4a009b470 0x7fd4a012c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.516+0000 7fd49ed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4a009b470 0x7fd4a012c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:39002/0 (socket says 172.21.15.122:39002) 2024-09-15T12:22:23.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.516+0000 7fd49ed9d640 1 -- 172.21.15.122:0/3457907782 learned_addr learned my addr 172.21.15.122:0/3457907782 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:23.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.516+0000 7fd49ed9d640 1 -- 172.21.15.122:0/3457907782 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a012e9d0 con 0x7fd4a009b470 2024-09-15T12:22:23.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.516+0000 7fd49ed9d640 1 --2- 172.21.15.122:0/3457907782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4a009b470 0x7fd4a012c9a0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.516+0000 7fd4977fe640 1 -- 172.21.15.122:0/3457907782 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd490005a60 con 0x7fd4a009b470 2024-09-15T12:22:23.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.516+0000 7fd4a5257640 1 -- 172.21.15.122:0/3457907782 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4a012dcb0 con 0x7fd4a009b470 2024-09-15T12:22:23.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.516+0000 7fd4977fe640 1 -- 172.21.15.122:0/3457907782 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd490005bc0 con 0x7fd4a009b470 2024-09-15T12:22:23.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.516+0000 7fd4977fe640 1 -- 172.21.15.122:0/3457907782 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd490005e60 con 0x7fd4a009b470 2024-09-15T12:22:23.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.516+0000 7fd4a5257640 1 -- 172.21.15.122:0/3457907782 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4a0068fd0 con 0x7fd4a009b470 2024-09-15T12:22:23.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.517+0000 7fd4977fe640 1 -- 172.21.15.122:0/3457907782 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd4900070b0 con 0x7fd4a009b470 2024-09-15T12:22:23.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.517+0000 7fd4977fe640 1 --2- 172.21.15.122:0/3457907782 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd48003e8e0 0x7fd480040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.517+0000 7fd4a5257640 1 -- 172.21.15.122:0/3457907782 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4a012dcb0 con 0x7fd4a009b470 2024-09-15T12:22:23.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.517+0000 7fd4977fe640 1 -- 172.21.15.122:0/3457907782 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fd49004f470 con 0x7fd4a009b470 2024-09-15T12:22:23.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.518+0000 7fd497fff640 1 --2- 172.21.15.122:0/3457907782 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd48003e8e0 0x7fd480040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.520 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.518+0000 7fd497fff640 1 --2- 172.21.15.122:0/3457907782 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd48003e8e0 0x7fd480040df0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.523+0000 7fd4977fe640 1 -- 172.21.15.122:0/3457907782 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fd4a012dcb0 con 0x7fd4a009b470 2024-09-15T12:22:23.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.696+0000 7fd4a5257640 1 -- 172.21.15.122:0/3457907782 --> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4a0135250 con 0x7fd48003e8e0 2024-09-15T12:22:23.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.697+0000 7fd4977fe640 1 -- 172.21.15.122:0/3457907782 <== mgr.4100 v2:172.21.15.142:6800/73136857 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31131 (crc 0 0 0) 0x7fd4a0135250 con 0x7fd48003e8e0 2024-09-15T12:22:23.699 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:22:23.700 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-15T12:22:23.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.700+0000 7fd4a5257640 1 -- 172.21.15.122:0/3457907782 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd48003e8e0 msgr2=0x7fd480040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.700+0000 7fd4a5257640 1 --2- 172.21.15.122:0/3457907782 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd48003e8e0 0x7fd480040df0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.700+0000 7fd4a5257640 1 -- 172.21.15.122:0/3457907782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4a009b470 msgr2=0x7fd4a012c9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.700+0000 7fd4a5257640 1 --2- 172.21.15.122:0/3457907782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4a009b470 0x7fd4a012c9a0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.700+0000 7fd4a5257640 1 -- 172.21.15.122:0/3457907782 shutdown_connections 2024-09-15T12:22:23.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.700+0000 7fd4a5257640 1 --2- 172.21.15.122:0/3457907782 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd48003e8e0 0x7fd480040df0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.700+0000 7fd4a5257640 1 --2- 172.21.15.122:0/3457907782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4a009b470 0x7fd4a012c9a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.700+0000 7fd4a5257640 1 -- 172.21.15.122:0/3457907782 >> 172.21.15.122:0/3457907782 conn(0x7fd4a00a32a0 msgr2=0x7fd4a0133a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:23.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.700+0000 7fd4a5257640 1 -- 172.21.15.122:0/3457907782 shutdown_connections 2024-09-15T12:22:23.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.700+0000 7fd4a5257640 1 -- 172.21.15.122:0/3457907782 wait complete. 2024-09-15T12:22:23.712 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-15T12:22:22.907013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":107984,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379376,"statfs":{"total":386547056640,"available":386436481024,"internally_reserved":0,"allocated":638976,"data_stored":1315618,"data_compressed":60088,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.432823+0000","last_change":"2024-09-15T12:22:21.439357+0000","last_active":"2024-09-15T12:22:21.432823+0000","last_peered":"2024-09-15T12:22:21.432823+0000","last_clean":"2024-09-15T12:22:21.432823+0000","last_became_active":"2024-09-15T12:22:19.461505+0000","last_became_peered":"2024-09-15T12:22:19.461505+0000","last_unstale":"2024-09-15T12:22:21.432823+0000","last_undegraded":"2024-09-15T12:22:21.432823+0000","last_fullsized":"2024-09-15T12:22:21.432823+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.435721+0000","last_change":"2024-09-15T12:22:21.437833+0000","last_active":"2024-09-15T12:22:21.435721+0000","last_peered":"2024-09-15T12:22:21.435721+0000","last_clean":"2024-09-15T12:22:21.435721+0000","last_became_active":"2024-09-15T12:22:19.483223+0000","last_became_peered":"2024-09-15T12:22:19.483223+0000","last_unstale":"2024-09-15T12:22:21.435721+0000","last_undegraded":"2024-09-15T12:22:21.435721+0000","last_fullsized":"2024-09-15T12:22:21.435721+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.436122+0000","last_change":"2024-09-15T12:22:21.438624+0000","last_active":"2024-09-15T12:22:21.436122+0000","last_peered":"2024-09-15T12:22:21.436122+0000","last_clean":"2024-09-15T12:22:21.436122+0000","last_became_active":"2024-09-15T12:22:19.461144+0000","last_became_peered":"2024-09-15T12:22:19.461144+0000","last_unstale":"2024-09-15T12:22:21.436122+0000","last_undegraded":"2024-09-15T12:22:21.436122+0000","last_fullsized":"2024-09-15T12:22:21.436122+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.432472+0000","last_change":"2024-09-15T12:22:21.436163+0000","last_active":"2024-09-15T12:22:21.432472+0000","last_peered":"2024-09-15T12:22:21.432472+0000","last_clean":"2024-09-15T12:22:21.432472+0000","last_became_active":"2024-09-15T12:22:19.461497+0000","last_became_peered":"2024-09-15T12:22:19.461497+0000","last_unstale":"2024-09-15T12:22:21.432472+0000","last_undegraded":"2024-09-15T12:22:21.432472+0000","last_fullsized":"2024-09-15T12:22:21.432472+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.438691+0000","last_change":"2024-09-15T12:22:21.438691+0000","last_active":"2024-09-15T12:22:21.438691+0000","last_peered":"2024-09-15T12:22:21.438691+0000","last_clean":"2024-09-15T12:22:21.438691+0000","last_became_active":"2024-09-15T12:22:19.461584+0000","last_became_peered":"2024-09-15T12:22:19.461584+0000","last_unstale":"2024-09-15T12:22:21.438691+0000","last_undegraded":"2024-09-15T12:22:21.438691+0000","last_fullsized":"2024-09-15T12:22:21.438691+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.435681+0000","last_change":"2024-09-15T12:22:21.438817+0000","last_active":"2024-09-15T12:22:21.435681+0000","last_peered":"2024-09-15T12:22:21.435681+0000","last_clean":"2024-09-15T12:22:21.435681+0000","last_became_active":"2024-09-15T12:22:19.466495+0000","last_became_peered":"2024-09-15T12:22:19.466495+0000","last_unstale":"2024-09-15T12:22:21.435681+0000","last_undegraded":"2024-09-15T12:22:21.435681+0000","last_fullsized":"2024-09-15T12:22:21.435681+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.436461+0000","last_change":"2024-09-15T12:22:21.438734+0000","last_active":"2024-09-15T12:22:21.436461+0000","last_peered":"2024-09-15T12:22:21.436461+0000","last_clean":"2024-09-15T12:22:21.436461+0000","last_became_active":"2024-09-15T12:22:19.475039+0000","last_became_peered":"2024-09-15T12:22:19.475039+0000","last_unstale":"2024-09-15T12:22:21.436461+0000","last_undegraded":"2024-09-15T12:22:21.436461+0000","last_fullsized":"2024-09-15T12:22:21.436461+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.438599+0000","last_change":"2024-09-15T12:22:21.441279+0000","last_active":"2024-09-15T12:22:21.438599+0000","last_peered":"2024-09-15T12:22:21.438599+0000","last_clean":"2024-09-15T12:22:21.438599+0000","last_became_active":"2024-09-15T12:22:19.485089+0000","last_became_peered":"2024-09-15T12:22:19.485089+0000","last_unstale":"2024-09-15T12:22:21.438599+0000","last_undegraded":"2024-09-15T12:22:21.438599+0000","last_fullsized":"2024-09-15T12:22:21.438599+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":84,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.432197+0000","last_change":"2024-09-15T12:22:18.465473+0000","last_active":"2024-09-15T12:22:21.432197+0000","last_peered":"2024-09-15T12:22:21.432197+0000","last_clean":"2024-09-15T12:22:21.432197+0000","last_became_active":"2024-09-15T12:22:18.457094+0000","last_became_peered":"2024-09-15T12:22:18.457094+0000","last_unstale":"2024-09-15T12:22:21.432197+0000","last_undegraded":"2024-09-15T12:22:21.432197+0000","last_fullsized":"2024-09-15T12:22:21.432197+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:17.395744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:17.395744+0000","last_clean_scrub_stamp":"2024-09-15T12:22:17.395744+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27032,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344808,"statfs":{"total":96636764160,"available":96609083392,"internally_reserved":0,"allocated":188416,"data_stored":624079,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":33730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26956,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344884,"statfs":{"total":96636764160,"available":96609161216,"internally_reserved":0,"allocated":126976,"data_stored":33711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624098,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:22:23.713 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:22:23.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.816+0000 7f84c5591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:23.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.821+0000 7f84c5591640 1 Processor -- start 2024-09-15T12:22:23.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.821+0000 7f84c5591640 1 -- start start 2024-09-15T12:22:23.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.822+0000 7f84c5591640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f84c01346b0 0x7f84c0138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.822+0000 7f84c5591640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c009d410 con 0x7f84c009af30 2024-09-15T12:22:23.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.822+0000 7f84c5591640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f84c0134ac0 con 0x7f84c01346b0 2024-09-15T12:22:23.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.822+0000 7f84be7fc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f84c01346b0 0x7f84c0138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.822+0000 7f84beffd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f84c009af30 0x7f84c0133fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:50076/0 (socket says 172.21.15.122:50076) 2024-09-15T12:22:23.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.822+0000 7f84beffd640 1 -- 172.21.15.122:0/2829412085 learned_addr learned my addr 172.21.15.122:0/2829412085 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:22:23.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.822+0000 7f84be7fc640 1 -- 172.21.15.122:0/2829412085 >> v1:172.21.15.122:6789/0 conn(0x7f84c009af30 legacy=0x7f84c0133fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.822+0000 7f84be7fc640 1 -- 172.21.15.122:0/2829412085 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c0133cd0 con 0x7f84c01346b0 2024-09-15T12:22:23.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.822+0000 7f84bdffb640 1 -- 172.21.15.122:0/2829412085 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776887358 0 0) 0x7f84c009d410 con 0x7f84c009af30 2024-09-15T12:22:23.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.822+0000 7f84be7fc640 1 --2- 172.21.15.122:0/2829412085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84c01346b0 0x7f84c0138ed0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b4c43352a777aa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.822+0000 7f84bdffb640 1 -- 172.21.15.122:0/2829412085 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f84b4009d90 con 0x7f84c01346b0 2024-09-15T12:22:23.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.823+0000 7f84bdffb640 1 -- 172.21.15.122:0/2829412085 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f84b400e230 con 0x7f84c01346b0 2024-09-15T12:22:23.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.823+0000 7f84bdffb640 1 -- 172.21.15.122:0/2829412085 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f84b400e4d0 con 0x7f84c01346b0 2024-09-15T12:22:23.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.823+0000 7f84c5591640 1 -- 172.21.15.122:0/2829412085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84c01346b0 msgr2=0x7f84c0138ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:23.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.823+0000 7f84c5591640 1 --2- 172.21.15.122:0/2829412085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84c01346b0 0x7f84c0138ed0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.823+0000 7f84c5591640 1 -- 172.21.15.122:0/2829412085 shutdown_connections 2024-09-15T12:22:23.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.823+0000 7f84c5591640 1 --2- 172.21.15.122:0/2829412085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84c01346b0 0x7f84c0138ed0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:23.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.823+0000 7f84c5591640 1 -- 172.21.15.122:0/2829412085 >> 172.21.15.122:0/2829412085 conn(0x7f84c00a11f0 msgr2=0x7f84c00a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:23.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.823+0000 7f84c5591640 1 -- 172.21.15.122:0/2829412085 shutdown_connections 2024-09-15T12:22:23.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.823+0000 7f84c5591640 1 -- 172.21.15.122:0/2829412085 wait complete. 2024-09-15T12:22:23.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.824+0000 7f84c5591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:23.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.825+0000 7f84c5591640 1 Processor -- start 2024-09-15T12:22:23.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.825+0000 7f84c5591640 1 -- start start 2024-09-15T12:22:23.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.826+0000 7f84c5591640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84c009af30 0x7f84c0129ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.826+0000 7f84c5591640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f84c0074ec0 con 0x7f84c009af30 2024-09-15T12:22:23.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.826+0000 7f84beffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84c009af30 0x7f84c0129ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.826+0000 7f84beffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84c009af30 0x7f84c0129ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:39016/0 (socket says 172.21.15.122:39016) 2024-09-15T12:22:23.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.826+0000 7f84beffd640 1 -- 172.21.15.122:0/137660507 learned_addr learned my addr 172.21.15.122:0/137660507 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:23.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.826+0000 7f84beffd640 1 -- 172.21.15.122:0/137660507 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c0132810 con 0x7f84c009af30 2024-09-15T12:22:23.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.827+0000 7f84beffd640 1 --2- 172.21.15.122:0/137660507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84c009af30 0x7f84c0129ab0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.827+0000 7f84a77fe640 1 -- 172.21.15.122:0/137660507 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f84b0004b80 con 0x7f84c009af30 2024-09-15T12:22:23.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.827+0000 7f84a77fe640 1 -- 172.21.15.122:0/137660507 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f84b0004ce0 con 0x7f84c009af30 2024-09-15T12:22:23.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.827+0000 7f84c5591640 1 -- 172.21.15.122:0/137660507 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c009c720 con 0x7f84c009af30 2024-09-15T12:22:23.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.827+0000 7f84a77fe640 1 -- 172.21.15.122:0/137660507 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f84b0007120 con 0x7f84c009af30 2024-09-15T12:22:23.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.827+0000 7f84c5591640 1 -- 172.21.15.122:0/137660507 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c0131350 con 0x7f84c009af30 2024-09-15T12:22:23.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.828+0000 7f84a77fe640 1 -- 172.21.15.122:0/137660507 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f84b00072d0 con 0x7f84c009af30 2024-09-15T12:22:23.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.828+0000 7f84c5591640 1 -- 172.21.15.122:0/137660507 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c0073bd0 con 0x7f84c009af30 2024-09-15T12:22:23.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.828+0000 7f84a77fe640 1 --2- 172.21.15.122:0/137660507 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f84ac03e930 0x7f84ac040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:23.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.828+0000 7f84a77fe640 1 -- 172.21.15.122:0/137660507 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f84b004f670 con 0x7f84c009af30 2024-09-15T12:22:23.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.829+0000 7f84be7fc640 1 --2- 172.21.15.122:0/137660507 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f84ac03e930 0x7f84ac040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:23.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.829+0000 7f84be7fc640 1 --2- 172.21.15.122:0/137660507 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f84ac03e930 0x7f84ac040e40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:23.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:23.833+0000 7f84a77fe640 1 -- 172.21.15.122:0/137660507 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f84b000a890 con 0x7f84c009af30 2024-09-15T12:22:24.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.003+0000 7f84c5591640 1 -- 172.21.15.122:0/137660507 --> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84c0133450 con 0x7f84ac03e930 2024-09-15T12:22:24.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.005+0000 7f84a77fe640 1 -- 172.21.15.122:0/137660507 <== mgr.4100 v2:172.21.15.142:6800/73136857 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31131 (crc 0 0 0) 0x7f84c0133450 con 0x7f84ac03e930 2024-09-15T12:22:24.007 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:22:24.007 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-15T12:22:24.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.007+0000 7f84c5591640 1 -- 172.21.15.122:0/137660507 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f84ac03e930 msgr2=0x7f84ac040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:24.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.007+0000 7f84c5591640 1 --2- 172.21.15.122:0/137660507 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f84ac03e930 0x7f84ac040e40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:24.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.007+0000 7f84c5591640 1 -- 172.21.15.122:0/137660507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84c009af30 msgr2=0x7f84c0129ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:24.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.007+0000 7f84c5591640 1 --2- 172.21.15.122:0/137660507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84c009af30 0x7f84c0129ab0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:24.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.007+0000 7f84c5591640 1 -- 172.21.15.122:0/137660507 shutdown_connections 2024-09-15T12:22:24.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.007+0000 7f84c5591640 1 --2- 172.21.15.122:0/137660507 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f84ac03e930 0x7f84ac040e40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:24.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.007+0000 7f84c5591640 1 --2- 172.21.15.122:0/137660507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84c009af30 0x7f84c0129ab0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:24.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.007+0000 7f84c5591640 1 -- 172.21.15.122:0/137660507 >> 172.21.15.122:0/137660507 conn(0x7f84c00a11f0 msgr2=0x7f84c0134ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:24.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.007+0000 7f84c5591640 1 -- 172.21.15.122:0/137660507 shutdown_connections 2024-09-15T12:22:24.010 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.007+0000 7f84c5591640 1 -- 172.21.15.122:0/137660507 wait complete. 2024-09-15T12:22:24.020 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-15T12:22:22.907013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":107984,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379376,"statfs":{"total":386547056640,"available":386436481024,"internally_reserved":0,"allocated":638976,"data_stored":1315618,"data_compressed":60088,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.432823+0000","last_change":"2024-09-15T12:22:21.439357+0000","last_active":"2024-09-15T12:22:21.432823+0000","last_peered":"2024-09-15T12:22:21.432823+0000","last_clean":"2024-09-15T12:22:21.432823+0000","last_became_active":"2024-09-15T12:22:19.461505+0000","last_became_peered":"2024-09-15T12:22:19.461505+0000","last_unstale":"2024-09-15T12:22:21.432823+0000","last_undegraded":"2024-09-15T12:22:21.432823+0000","last_fullsized":"2024-09-15T12:22:21.432823+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.435721+0000","last_change":"2024-09-15T12:22:21.437833+0000","last_active":"2024-09-15T12:22:21.435721+0000","last_peered":"2024-09-15T12:22:21.435721+0000","last_clean":"2024-09-15T12:22:21.435721+0000","last_became_active":"2024-09-15T12:22:19.483223+0000","last_became_peered":"2024-09-15T12:22:19.483223+0000","last_unstale":"2024-09-15T12:22:21.435721+0000","last_undegraded":"2024-09-15T12:22:21.435721+0000","last_fullsized":"2024-09-15T12:22:21.435721+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.436122+0000","last_change":"2024-09-15T12:22:21.438624+0000","last_active":"2024-09-15T12:22:21.436122+0000","last_peered":"2024-09-15T12:22:21.436122+0000","last_clean":"2024-09-15T12:22:21.436122+0000","last_became_active":"2024-09-15T12:22:19.461144+0000","last_became_peered":"2024-09-15T12:22:19.461144+0000","last_unstale":"2024-09-15T12:22:21.436122+0000","last_undegraded":"2024-09-15T12:22:21.436122+0000","last_fullsized":"2024-09-15T12:22:21.436122+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.432472+0000","last_change":"2024-09-15T12:22:21.436163+0000","last_active":"2024-09-15T12:22:21.432472+0000","last_peered":"2024-09-15T12:22:21.432472+0000","last_clean":"2024-09-15T12:22:21.432472+0000","last_became_active":"2024-09-15T12:22:19.461497+0000","last_became_peered":"2024-09-15T12:22:19.461497+0000","last_unstale":"2024-09-15T12:22:21.432472+0000","last_undegraded":"2024-09-15T12:22:21.432472+0000","last_fullsized":"2024-09-15T12:22:21.432472+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.438691+0000","last_change":"2024-09-15T12:22:21.438691+0000","last_active":"2024-09-15T12:22:21.438691+0000","last_peered":"2024-09-15T12:22:21.438691+0000","last_clean":"2024-09-15T12:22:21.438691+0000","last_became_active":"2024-09-15T12:22:19.461584+0000","last_became_peered":"2024-09-15T12:22:19.461584+0000","last_unstale":"2024-09-15T12:22:21.438691+0000","last_undegraded":"2024-09-15T12:22:21.438691+0000","last_fullsized":"2024-09-15T12:22:21.438691+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.435681+0000","last_change":"2024-09-15T12:22:21.438817+0000","last_active":"2024-09-15T12:22:21.435681+0000","last_peered":"2024-09-15T12:22:21.435681+0000","last_clean":"2024-09-15T12:22:21.435681+0000","last_became_active":"2024-09-15T12:22:19.466495+0000","last_became_peered":"2024-09-15T12:22:19.466495+0000","last_unstale":"2024-09-15T12:22:21.435681+0000","last_undegraded":"2024-09-15T12:22:21.435681+0000","last_fullsized":"2024-09-15T12:22:21.435681+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.436461+0000","last_change":"2024-09-15T12:22:21.438734+0000","last_active":"2024-09-15T12:22:21.436461+0000","last_peered":"2024-09-15T12:22:21.436461+0000","last_clean":"2024-09-15T12:22:21.436461+0000","last_became_active":"2024-09-15T12:22:19.475039+0000","last_became_peered":"2024-09-15T12:22:19.475039+0000","last_unstale":"2024-09-15T12:22:21.436461+0000","last_undegraded":"2024-09-15T12:22:21.436461+0000","last_fullsized":"2024-09-15T12:22:21.436461+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.438599+0000","last_change":"2024-09-15T12:22:21.441279+0000","last_active":"2024-09-15T12:22:21.438599+0000","last_peered":"2024-09-15T12:22:21.438599+0000","last_clean":"2024-09-15T12:22:21.438599+0000","last_became_active":"2024-09-15T12:22:19.485089+0000","last_became_peered":"2024-09-15T12:22:19.485089+0000","last_unstale":"2024-09-15T12:22:21.438599+0000","last_undegraded":"2024-09-15T12:22:21.438599+0000","last_fullsized":"2024-09-15T12:22:21.438599+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":84,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:22:21.432197+0000","last_change":"2024-09-15T12:22:18.465473+0000","last_active":"2024-09-15T12:22:21.432197+0000","last_peered":"2024-09-15T12:22:21.432197+0000","last_clean":"2024-09-15T12:22:21.432197+0000","last_became_active":"2024-09-15T12:22:18.457094+0000","last_became_peered":"2024-09-15T12:22:18.457094+0000","last_unstale":"2024-09-15T12:22:21.432197+0000","last_undegraded":"2024-09-15T12:22:21.432197+0000","last_fullsized":"2024-09-15T12:22:21.432197+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:17.395744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:17.395744+0000","last_clean_scrub_stamp":"2024-09-15T12:22:17.395744+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27032,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344808,"statfs":{"total":96636764160,"available":96609083392,"internally_reserved":0,"allocated":188416,"data_stored":624079,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":33730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26956,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344884,"statfs":{"total":96636764160,"available":96609161216,"internally_reserved":0,"allocated":126976,"data_stored":33711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624098,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:22:24.020 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T12:22:24.020 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T12:22:24.021 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-15T12:22:24.021 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-15T12:22:24.128 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.123+0000 7f4117191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:24.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.127+0000 7f4117191640 1 Processor -- start 2024-09-15T12:22:24.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.127+0000 7f4117191640 1 -- start start 2024-09-15T12:22:24.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.128+0000 7f4117191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f411006fec0 0x7f4110138020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:24.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.128+0000 7f4117191640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f411006ed60 con 0x7f411006f3a0 2024-09-15T12:22:24.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.128+0000 7f4117191640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f41100a3ed0 con 0x7f411006fec0 2024-09-15T12:22:24.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.128+0000 7f410ffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f411006fec0 0x7f4110138020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:24.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.129+0000 7f4114f2d640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f411006f3a0 0x7f411006f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:50084/0 (socket says 172.21.15.122:50084) 2024-09-15T12:22:24.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.129+0000 7f4114f2d640 1 -- 172.21.15.122:0/1922848144 learned_addr learned my addr 172.21.15.122:0/1922848144 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:22:24.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.129+0000 7f410ffff640 1 -- 172.21.15.122:0/1922848144 >> v1:172.21.15.122:6789/0 conn(0x7f411006f3a0 legacy=0x7f411006f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:24.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.129+0000 7f410ffff640 1 -- 172.21.15.122:0/1922848144 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41100a4170 con 0x7f411006fec0 2024-09-15T12:22:24.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.129+0000 7f410ffff640 1 --2- 172.21.15.122:0/1922848144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f411006fec0 0x7f4110138020 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abb1bfa7967a2fb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:24.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.129+0000 7f410f7fe640 1 -- 172.21.15.122:0/1922848144 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4100009d80 con 0x7f411006fec0 2024-09-15T12:22:24.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.129+0000 7f410f7fe640 1 -- 172.21.15.122:0/1922848144 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f410000e230 con 0x7f411006fec0 2024-09-15T12:22:24.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.129+0000 7f410f7fe640 1 -- 172.21.15.122:0/1922848144 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f410000e4d0 con 0x7f411006fec0 2024-09-15T12:22:24.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.130+0000 7f4117191640 1 -- 172.21.15.122:0/1922848144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f411006fec0 msgr2=0x7f4110138020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:24.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.130+0000 7f4117191640 1 --2- 172.21.15.122:0/1922848144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f411006fec0 0x7f4110138020 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:24.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.130+0000 7f4117191640 1 -- 172.21.15.122:0/1922848144 shutdown_connections 2024-09-15T12:22:24.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.130+0000 7f4117191640 1 --2- 172.21.15.122:0/1922848144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f411006fec0 0x7f4110138020 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:24.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.130+0000 7f4117191640 1 -- 172.21.15.122:0/1922848144 >> 172.21.15.122:0/1922848144 conn(0x7f41100a33b0 msgr2=0x7f41100a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:24.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.130+0000 7f4117191640 1 -- 172.21.15.122:0/1922848144 shutdown_connections 2024-09-15T12:22:24.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.130+0000 7f4117191640 1 -- 172.21.15.122:0/1922848144 wait complete. 2024-09-15T12:22:24.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.130+0000 7f4117191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:24.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.131+0000 7f4117191640 1 Processor -- start 2024-09-15T12:22:24.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.131+0000 7f4117191640 1 -- start start 2024-09-15T12:22:24.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.133+0000 7f4117191640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f411006f3a0 0x7f4110132990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:24.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.133+0000 7f4117191640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4110123aa0 con 0x7f411006f3a0 2024-09-15T12:22:24.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.133+0000 7f4114f2d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f411006f3a0 0x7f4110132990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:24.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.133+0000 7f4114f2d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f411006f3a0 0x7f4110132990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:39038/0 (socket says 172.21.15.122:39038) 2024-09-15T12:22:24.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.133+0000 7f4114f2d640 1 -- 172.21.15.122:0/3915267332 learned_addr learned my addr 172.21.15.122:0/3915267332 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:22:24.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.133+0000 7f4114f2d640 1 -- 172.21.15.122:0/3915267332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41100a0790 con 0x7f411006f3a0 2024-09-15T12:22:24.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.133+0000 7f4114f2d640 1 --2- 172.21.15.122:0/3915267332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f411006f3a0 0x7f4110132990 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:24.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.133+0000 7f410d7fa640 1 -- 172.21.15.122:0/3915267332 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f40f8005a60 con 0x7f411006f3a0 2024-09-15T12:22:24.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.133+0000 7f410d7fa640 1 -- 172.21.15.122:0/3915267332 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f40f8005bc0 con 0x7f411006f3a0 2024-09-15T12:22:24.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.133+0000 7f4117191640 1 -- 172.21.15.122:0/3915267332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41101330e0 con 0x7f411006f3a0 2024-09-15T12:22:24.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.133+0000 7f410d7fa640 1 -- 172.21.15.122:0/3915267332 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f40f8005e60 con 0x7f411006f3a0 2024-09-15T12:22:24.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.133+0000 7f4117191640 1 -- 172.21.15.122:0/3915267332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41100a03f0 con 0x7f411006f3a0 2024-09-15T12:22:24.138 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.134+0000 7f4117191640 1 -- 172.21.15.122:0/3915267332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f411006f7b0 con 0x7f411006f3a0 2024-09-15T12:22:24.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.134+0000 7f410d7fa640 1 -- 172.21.15.122:0/3915267332 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f40f80070b0 con 0x7f411006f3a0 2024-09-15T12:22:24.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.135+0000 7f410d7fa640 1 --2- 172.21.15.122:0/3915267332 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f40f003e960 0x7f40f0040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:22:24.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.135+0000 7f410d7fa640 1 -- 172.21.15.122:0/3915267332 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f40f804f570 con 0x7f411006f3a0 2024-09-15T12:22:24.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.135+0000 7f410ffff640 1 --2- 172.21.15.122:0/3915267332 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f40f003e960 0x7f40f0040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:22:24.140 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.135+0000 7f410ffff640 1 --2- 172.21.15.122:0/3915267332 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f40f003e960 0x7f40f0040e70 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:22:24.141 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.140+0000 7f410d7fa640 1 -- 172.21.15.122:0/3915267332 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f40f800d900 con 0x7f411006f3a0 2024-09-15T12:22:24.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.349+0000 7f4117191640 1 -- 172.21.15.122:0/3915267332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f41101330e0 con 0x7f411006f3a0 2024-09-15T12:22:24.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.350+0000 7f410d7fa640 1 -- 172.21.15.122:0/3915267332 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (crc 0 0 0) 0x7f41101330e0 con 0x7f411006f3a0 2024-09-15T12:22:24.352 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:22:24.352 INFO:teuthology.orchestra.run.smithi122.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T12:22:24.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.352+0000 7f4117191640 1 -- 172.21.15.122:0/3915267332 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f40f003e960 msgr2=0x7f40f0040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:24.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.352+0000 7f4117191640 1 --2- 172.21.15.122:0/3915267332 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f40f003e960 0x7f40f0040e70 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:24.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.352+0000 7f4117191640 1 -- 172.21.15.122:0/3915267332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f411006f3a0 msgr2=0x7f4110132990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:22:24.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.352+0000 7f4117191640 1 --2- 172.21.15.122:0/3915267332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f411006f3a0 0x7f4110132990 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:24.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.352+0000 7f4117191640 1 -- 172.21.15.122:0/3915267332 shutdown_connections 2024-09-15T12:22:24.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.352+0000 7f4117191640 1 --2- 172.21.15.122:0/3915267332 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f40f003e960 0x7f40f0040e70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:24.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.352+0000 7f4117191640 1 --2- 172.21.15.122:0/3915267332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f411006f3a0 0x7f4110132990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:22:24.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.352+0000 7f4117191640 1 -- 172.21.15.122:0/3915267332 >> 172.21.15.122:0/3915267332 conn(0x7f41100a33b0 msgr2=0x7f411009e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:22:24.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.352+0000 7f4117191640 1 -- 172.21.15.122:0/3915267332 shutdown_connections 2024-09-15T12:22:24.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:22:24.352+0000 7f4117191640 1 -- 172.21.15.122:0/3915267332 wait complete. 2024-09-15T12:22:24.364 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-15T12:22:24.365 INFO:teuthology.run_tasks:Running task workunit... 2024-09-15T12:22:24.381 INFO:tasks.workunit:Pulling workunits from ref 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-15T12:22:24.381 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-15T12:22:24.382 DEBUG:teuthology.orchestra.run.smithi122:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-15T12:22:24.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:22:24.397 INFO:teuthology.orchestra.run.smithi122.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-15T12:22:24.398 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-15T12:22:24.453 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-15T12:22:24.453 DEBUG:teuthology.orchestra.run.smithi122:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-15T12:22:24.509 INFO:tasks.workunit:timeout=3h 2024-09-15T12:22:24.509 INFO:tasks.workunit:cleanup=True 2024-09-15T12:22:24.509 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-15T12:22:24.564 INFO:tasks.workunit.client.0.smithi122.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-15T12:23:16.011 INFO:tasks.workunit.client.0.smithi122.stderr:Note: switching to '0325fd3c11a225c0fd9eb38fab88aad1370ad779'. 2024-09-15T12:23:16.012 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-15T12:23:16.012 INFO:tasks.workunit.client.0.smithi122.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-15T12:23:16.012 INFO:tasks.workunit.client.0.smithi122.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-15T12:23:16.012 INFO:tasks.workunit.client.0.smithi122.stderr:state without impacting any branches by switching back to a branch. 2024-09-15T12:23:16.012 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-15T12:23:16.012 INFO:tasks.workunit.client.0.smithi122.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-15T12:23:16.012 INFO:tasks.workunit.client.0.smithi122.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-15T12:23:16.012 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-15T12:23:16.012 INFO:tasks.workunit.client.0.smithi122.stderr: git switch -c 2024-09-15T12:23:16.013 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-15T12:23:16.013 INFO:tasks.workunit.client.0.smithi122.stderr:Or undo this operation with: 2024-09-15T12:23:16.013 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-15T12:23:16.013 INFO:tasks.workunit.client.0.smithi122.stderr: git switch - 2024-09-15T12:23:16.013 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-15T12:23:16.013 INFO:tasks.workunit.client.0.smithi122.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-15T12:23:16.013 INFO:tasks.workunit.client.0.smithi122.stderr: 2024-09-15T12:23:16.013 INFO:tasks.workunit.client.0.smithi122.stderr:HEAD is now at 0325fd3c11a Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication 2024-09-15T12:23:16.016 DEBUG:teuthology.orchestra.run.smithi122:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-15T12:23:16.082 INFO:tasks.workunit.client.0.smithi122.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-15T12:23:16.084 INFO:tasks.workunit.client.0.smithi122.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T12:23:16.084 INFO:tasks.workunit.client.0.smithi122.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-15T12:23:16.779 INFO:tasks.workunit.client.0.smithi122.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-15T12:23:16.866 INFO:tasks.workunit.client.0.smithi122.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-15T12:23:16.908 INFO:tasks.workunit.client.0.smithi122.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T12:23:16.909 INFO:tasks.workunit.client.0.smithi122.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T12:23:16.910 INFO:tasks.workunit.client.0.smithi122.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-15T12:23:16.949 INFO:tasks.workunit.client.0.smithi122.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T12:23:16.952 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-15T12:23:16.953 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-15T12:23:17.008 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-09-15T12:23:17.009 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-09-15T12:23:17.010 DEBUG:teuthology.orchestra.run.smithi122:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson 2024-09-15T12:23:17.068 INFO:tasks.workunit.client.0.smithi122.stderr:+ parallel=1 2024-09-15T12:23:17.069 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' --crimson = --serial ']' 2024-09-15T12:23:17.069 INFO:tasks.workunit.client.0.smithi122.stderr:+ crimson=0 2024-09-15T12:23:17.069 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' --crimson = --crimson ']' 2024-09-15T12:23:17.069 INFO:tasks.workunit.client.0.smithi122.stderr:+ parallel=0 2024-09-15T12:23:17.069 INFO:tasks.workunit.client.0.smithi122.stderr:+ crimson=1 2024-09-15T12:23:17.069 INFO:tasks.workunit.client.0.smithi122.stderr:+ color= 2024-09-15T12:23:17.069 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' -t 1 ']' 2024-09-15T12:23:17.069 INFO:tasks.workunit.client.0.smithi122.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-09-15T12:23:17.069 INFO:tasks.workunit.client.0.smithi122.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-15T12:23:17.069 INFO:tasks.workunit.client.0.smithi122.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-15T12:23:17.070 INFO:tasks.workunit.client.0.smithi122.stderr:+ declare -A pids 2024-09-15T12:23:17.070 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:23:17.070 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:23:17.070 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_aio 2024-09-15T12:23:17.086 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:23:17.086 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 42 tests from 2 test suites. 2024-09-15T12:23:17.086 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:23:17.086 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 26 tests from LibRadosAio 2024-09-15T12:23:17.086 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.TooBig 2024-09-15T12:23:19.952 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.TooBig (2865 ms) 2024-09-15T12:23:19.952 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.SimpleWrite 2024-09-15T12:23:22.976 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.SimpleWrite (3024 ms) 2024-09-15T12:23:22.976 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.WaitForSafe 2024-09-15T12:23:25.991 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.WaitForSafe (3014 ms) 2024-09-15T12:23:25.991 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTrip 2024-09-15T12:23:29.003 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTrip (3012 ms) 2024-09-15T12:23:29.003 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTrip2 2024-09-15T12:23:32.018 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTrip2 (3016 ms) 2024-09-15T12:23:32.019 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTrip3 2024-09-15T12:23:35.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTrip3 (3015 ms) 2024-09-15T12:23:35.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTripAppend 2024-09-15T12:23:38.045 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTripAppend (3012 ms) 2024-09-15T12:23:38.046 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RemoveTest 2024-09-15T12:23:41.065 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RemoveTest (3019 ms) 2024-09-15T12:23:41.065 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.XattrsRoundTrip 2024-09-15T12:23:44.075 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.XattrsRoundTrip (3010 ms) 2024-09-15T12:23:44.075 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RmXattr 2024-09-15T12:23:47.100 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RmXattr (3025 ms) 2024-09-15T12:23:47.100 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.XattrIter 2024-09-15T12:23:50.109 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.XattrIter (3009 ms) 2024-09-15T12:23:50.109 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.IsComplete 2024-09-15T12:23:53.129 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.IsComplete (3020 ms) 2024-09-15T12:23:53.129 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.IsSafe 2024-09-15T12:23:56.138 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.IsSafe (3009 ms) 2024-09-15T12:23:56.138 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.ReturnValue 2024-09-15T12:23:59.162 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.ReturnValue (3024 ms) 2024-09-15T12:23:59.162 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.Flush 2024-09-15T12:24:02.172 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.Flush (3010 ms) 2024-09-15T12:24:02.172 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.FlushAsync 2024-09-15T12:24:05.196 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.FlushAsync (3024 ms) 2024-09-15T12:24:05.196 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTripWriteFull 2024-09-15T12:24:08.204 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTripWriteFull (3008 ms) 2024-09-15T12:24:08.204 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTripWriteSame 2024-09-15T12:24:11.222 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTripWriteSame (3018 ms) 2024-09-15T12:24:11.222 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.SimpleStat 2024-09-15T12:24:13.939 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.SimpleStat (2717 ms) 2024-09-15T12:24:13.939 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-15T12:24:16.951 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.OperateMtime (3013 ms) 2024-09-15T12:24:16.952 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.Operate2Mtime 2024-09-15T12:24:19.957 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.Operate2Mtime (3006 ms) 2024-09-15T12:24:19.957 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.SimpleStatNS 2024-09-15T12:24:22.975 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.SimpleStatNS (3017 ms) 2024-09-15T12:24:22.975 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.StatRemove 2024-09-15T12:24:25.990 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.StatRemove (3015 ms) 2024-09-15T12:24:25.990 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.ExecuteClass 2024-09-15T12:24:29.002 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.ExecuteClass (3013 ms) 2024-09-15T12:24:29.002 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.MultiWrite 2024-09-15T12:24:32.011 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.MultiWrite (3008 ms) 2024-09-15T12:24:32.011 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.AioUnlock 2024-09-15T12:24:35.027 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.AioUnlock (3014 ms) 2024-09-15T12:24:35.027 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 26 tests from LibRadosAio (77938 ms total) 2024-09-15T12:24:35.027 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:24:35.027 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 16 tests from LibRadosAioEC 2024-09-15T12:24:35.027 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.SimpleWrite 2024-09-15T12:24:35.027 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1100: Skipped 2024-09-15T12:24:35.027 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:24:35.027 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2024-09-15T12:24:35.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.WaitForComplete 2024-09-15T12:24:35.028 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1132: Skipped 2024-09-15T12:24:35.028 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:24:35.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2024-09-15T12:24:35.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.RoundTrip 2024-09-15T12:24:35.028 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1149: Skipped 2024-09-15T12:24:35.028 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:24:35.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2024-09-15T12:24:35.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.RoundTrip2 2024-09-15T12:24:35.028 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1182: Skipped 2024-09-15T12:24:35.028 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:24:35.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2024-09-15T12:24:35.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.RoundTripAppend 2024-09-15T12:24:35.029 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1215: Skipped 2024-09-15T12:24:35.029 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:24:35.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2024-09-15T12:24:35.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.IsComplete 2024-09-15T12:24:35.029 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1286: Skipped 2024-09-15T12:24:35.029 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:24:35.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2024-09-15T12:24:35.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.IsSafe 2024-09-15T12:24:35.029 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1326: Skipped 2024-09-15T12:24:35.029 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:24:35.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2024-09-15T12:24:35.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.ReturnValue 2024-09-15T12:24:35.030 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1366: Skipped 2024-09-15T12:24:35.030 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:24:35.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2024-09-15T12:24:35.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.Flush 2024-09-15T12:24:35.030 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1385: Skipped 2024-09-15T12:24:35.030 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:24:35.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2024-09-15T12:24:35.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.FlushAsync 2024-09-15T12:24:35.030 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1415: Skipped 2024-09-15T12:24:35.030 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:24:35.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2024-09-15T12:24:35.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-09-15T12:24:35.030 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1454: Skipped 2024-09-15T12:24:35.031 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:24:35.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2024-09-15T12:24:35.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.SimpleStat 2024-09-15T12:24:35.031 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1498: Skipped 2024-09-15T12:24:35.031 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:24:35.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2024-09-15T12:24:35.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.SimpleStatNS 2024-09-15T12:24:35.031 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1532: Skipped 2024-09-15T12:24:35.031 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:24:35.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2024-09-15T12:24:35.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.StatRemove 2024-09-15T12:24:35.031 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1593: Skipped 2024-09-15T12:24:35.032 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:24:35.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2024-09-15T12:24:35.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.ExecuteClass 2024-09-15T12:24:35.032 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1649: Skipped 2024-09-15T12:24:35.032 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:24:35.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2024-09-15T12:24:35.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.MultiWrite 2024-09-15T12:24:35.032 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1681: Skipped 2024-09-15T12:24:35.032 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:24:35.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2024-09-15T12:24:35.032 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 16 tests from LibRadosAioEC (0 ms total) 2024-09-15T12:24:35.032 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:24:35.032 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:24:35.032 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 42 tests from 2 test suites ran. (77938 ms total) 2024-09-15T12:24:35.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 26 tests. 2024-09-15T12:24:35.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-15T12:24:35.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite 2024-09-15T12:24:35.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete 2024-09-15T12:24:35.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip 2024-09-15T12:24:35.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 2024-09-15T12:24:35.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend 2024-09-15T12:24:35.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete 2024-09-15T12:24:35.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe 2024-09-15T12:24:35.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue 2024-09-15T12:24:35.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.Flush 2024-09-15T12:24:35.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync 2024-09-15T12:24:35.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2024-09-15T12:24:35.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat 2024-09-15T12:24:35.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS 2024-09-15T12:24:35.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove 2024-09-15T12:24:35.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass 2024-09-15T12:24:35.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite 2024-09-15T12:24:35.034 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:24:35.034 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:24:35.034 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_aio_pp 2024-09-15T12:24:35.048 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:24:35.048 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 57 tests from 4 test suites. 2024-09-15T12:24:35.048 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:24:35.048 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 32 tests from LibRadosAio 2024-09-15T12:24:35.048 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.TooBigPP 2024-09-15T12:24:37.944 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.TooBigPP (2896 ms) 2024-09-15T12:24:37.944 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.PoolQuotaPP 2024-09-15T12:24:54.979 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.PoolQuotaPP (17036 ms) 2024-09-15T12:24:54.980 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.SimpleWritePP 2024-09-15T12:25:01.004 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.SimpleWritePP (6024 ms) 2024-09-15T12:25:01.004 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.WaitForSafePP 2024-09-15T12:25:04.015 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.WaitForSafePP (3011 ms) 2024-09-15T12:25:04.015 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTripPP 2024-09-15T12:25:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTripPP (3020 ms) 2024-09-15T12:25:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTripPP2 2024-09-15T12:25:10.047 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTripPP2 (3012 ms) 2024-09-15T12:25:10.047 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTripPP3 2024-09-15T12:25:12.949 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTripPP3 (2902 ms) 2024-09-15T12:25:12.949 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-09-15T12:25:15.962 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTripSparseReadPP (3013 ms) 2024-09-15T12:25:15.962 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.IsCompletePP 2024-09-15T12:25:18.974 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.IsCompletePP (3012 ms) 2024-09-15T12:25:18.974 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.IsSafePP 2024-09-15T12:25:21.991 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.IsSafePP (3017 ms) 2024-09-15T12:25:21.991 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.ReturnValuePP 2024-09-15T12:25:25.002 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.ReturnValuePP (3011 ms) 2024-09-15T12:25:25.002 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.FlushPP 2024-09-15T12:25:28.013 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.FlushPP (3011 ms) 2024-09-15T12:25:28.013 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.FlushAsyncPP 2024-09-15T12:25:31.041 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.FlushAsyncPP (3028 ms) 2024-09-15T12:25:31.041 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-09-15T12:25:33.953 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP (2913 ms) 2024-09-15T12:25:33.954 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-09-15T12:25:36.970 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP2 (3016 ms) 2024-09-15T12:25:36.970 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-09-15T12:25:39.980 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP (3010 ms) 2024-09-15T12:25:39.980 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-09-15T12:25:42.955 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP2 (2975 ms) 2024-09-15T12:25:42.955 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.SimpleStatPPNS 2024-09-15T12:25:45.966 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.SimpleStatPPNS (3011 ms) 2024-09-15T12:25:45.966 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.SimpleStatPP 2024-09-15T12:25:48.986 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.SimpleStatPP (3020 ms) 2024-09-15T12:25:48.986 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-15T12:25:51.997 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.OperateMtime (3011 ms) 2024-09-15T12:25:51.997 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.OperateMtime2 2024-09-15T12:25:55.008 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.OperateMtime2 (3011 ms) 2024-09-15T12:25:55.040 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.StatRemovePP 2024-09-15T12:25:58.020 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.StatRemovePP (3012 ms) 2024-09-15T12:25:58.020 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.ExecuteClassPP 2024-09-15T12:26:01.038 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.ExecuteClassPP (3018 ms) 2024-09-15T12:26:01.038 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.OmapPP 2024-09-15T12:26:04.049 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.OmapPP (3011 ms) 2024-09-15T12:26:04.049 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.MultiWritePP 2024-09-15T12:26:07.065 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.MultiWritePP (3016 ms) 2024-09-15T12:26:07.065 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.AioUnlockPP 2024-09-15T12:26:10.089 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.AioUnlockPP (3024 ms) 2024-09-15T12:26:10.089 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTripAppendPP 2024-09-15T12:26:12.961 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTripAppendPP (2872 ms) 2024-09-15T12:26:12.961 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RacingRemovePP 2024-09-15T12:26:15.968 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RacingRemovePP (3008 ms) 2024-09-15T12:26:15.969 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-09-15T12:26:18.993 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP (3024 ms) 2024-09-15T12:26:18.993 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-09-15T12:26:22.000 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP2 (3007 ms) 2024-09-15T12:26:22.000 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.PoolEIOFlag 2024-09-15T12:26:24.463 INFO:tasks.workunit.client.0.smithi122.stdout:setting pool EIO 2024-09-15T12:26:34.123 INFO:tasks.workunit.client.0.smithi122.stdout:waiting for 896 2024-09-15T12:26:35.123 INFO:tasks.workunit.client.0.smithi122.stdout:waiting for 896 2024-09-15T12:26:36.123 INFO:tasks.workunit.client.0.smithi122.stdout:waiting for 896 2024-09-15T12:26:37.124 INFO:tasks.workunit.client.0.smithi122.stdout:max_success 104, min_failed 105 2024-09-15T12:26:37.501 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAio.PoolEIOFlag (15500 ms) 2024-09-15T12:26:37.501 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAio.MultiReads 2024-09-15T12:26:37.501 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2427: Skipped 2024-09-15T12:26:37.501 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:26:37.501 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAio.MultiReads (0 ms) 2024-09-15T12:26:37.501 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 32 tests from LibRadosAio (122453 ms total) 2024-09-15T12:26:37.501 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:26:37.501 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosAioPP 2024-09-15T12:26:37.501 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-09-15T12:26:39.981 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAioPP.ReadIntoBufferlist (2481 ms) 2024-09-15T12:26:39.982 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-09-15T12:26:48.970 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAioPP.XattrsRoundTripPP (8988 ms) 2024-09-15T12:26:48.970 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioPP.RmXattrPP 2024-09-15T12:27:03.994 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAioPP.RmXattrPP (15025 ms) 2024-09-15T12:27:03.994 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioPP.RemoveTestPP 2024-09-15T12:27:07.010 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosAioPP.RemoveTestPP (3015 ms) 2024-09-15T12:27:07.010 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosAioPP (29509 ms total) 2024-09-15T12:27:07.010 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:07.010 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibRadosIoPP 2024-09-15T12:27:07.010 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-15T12:27:10.014 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.XattrListPP (3002 ms) 2024-09-15T12:27:10.015 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibRadosIoPP (3002 ms total) 2024-09-15T12:27:10.015 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:10.015 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 20 tests from LibRadosAioEC 2024-09-15T12:27:10.015 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.SimpleWritePP 2024-09-15T12:27:10.015 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1384: Skipped 2024-09-15T12:27:10.015 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.015 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP (0 ms) 2024-09-15T12:27:10.015 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.WaitForSafePP 2024-09-15T12:27:10.015 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1419: Skipped 2024-09-15T12:27:10.015 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP (0 ms) 2024-09-15T12:27:10.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.RoundTripPP 2024-09-15T12:27:10.016 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1436: Skipped 2024-09-15T12:27:10.016 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP (0 ms) 2024-09-15T12:27:10.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.RoundTripPP2 2024-09-15T12:27:10.016 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1467: Skipped 2024-09-15T12:27:10.016 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 (0 ms) 2024-09-15T12:27:10.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.RoundTripPP3 2024-09-15T12:27:10.016 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1500: Skipped 2024-09-15T12:27:10.016 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 (0 ms) 2024-09-15T12:27:10.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-15T12:27:10.017 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1605: Skipped 2024-09-15T12:27:10.017 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP (0 ms) 2024-09-15T12:27:10.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-09-15T12:27:10.017 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1637: Skipped 2024-09-15T12:27:10.017 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP (0 ms) 2024-09-15T12:27:10.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.IsCompletePP 2024-09-15T12:27:10.017 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1705: Skipped 2024-09-15T12:27:10.017 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.018 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP (0 ms) 2024-09-15T12:27:10.018 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.IsSafePP 2024-09-15T12:27:10.018 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1742: Skipped 2024-09-15T12:27:10.018 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.018 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP (0 ms) 2024-09-15T12:27:10.018 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.ReturnValuePP 2024-09-15T12:27:10.018 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1780: Skipped 2024-09-15T12:27:10.018 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.018 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP (0 ms) 2024-09-15T12:27:10.018 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.FlushPP 2024-09-15T12:27:10.018 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1796: Skipped 2024-09-15T12:27:10.018 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.018 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP (0 ms) 2024-09-15T12:27:10.019 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.FlushAsyncPP 2024-09-15T12:27:10.019 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1824: Skipped 2024-09-15T12:27:10.019 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.019 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP (0 ms) 2024-09-15T12:27:10.019 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-15T12:27:10.019 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1859: Skipped 2024-09-15T12:27:10.019 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.019 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP (0 ms) 2024-09-15T12:27:10.019 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-15T12:27:10.019 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1904: Skipped 2024-09-15T12:27:10.019 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.020 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 (0 ms) 2024-09-15T12:27:10.020 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.SimpleStatPP 2024-09-15T12:27:10.020 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1946: Skipped 2024-09-15T12:27:10.020 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.020 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP (0 ms) 2024-09-15T12:27:10.020 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-09-15T12:27:10.020 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1977: Skipped 2024-09-15T12:27:10.020 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.020 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS (0 ms) 2024-09-15T12:27:10.020 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.StatRemovePP 2024-09-15T12:27:10.020 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2008: Skipped 2024-09-15T12:27:10.020 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.021 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP (0 ms) 2024-09-15T12:27:10.021 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.ExecuteClassPP 2024-09-15T12:27:10.021 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2059: Skipped 2024-09-15T12:27:10.021 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.021 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP (0 ms) 2024-09-15T12:27:10.021 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.OmapPP 2024-09-15T12:27:10.021 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2089: Skipped 2024-09-15T12:27:10.021 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.021 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP (0 ms) 2024-09-15T12:27:10.021 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosAioEC.MultiWritePP 2024-09-15T12:27:10.021 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2124: Skipped 2024-09-15T12:27:10.021 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:10.022 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP (0 ms) 2024-09-15T12:27:10.022 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 20 tests from LibRadosAioEC (0 ms total) 2024-09-15T12:27:10.022 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:10.022 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:10.022 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 57 tests from 4 test suites ran. (154964 ms total) 2024-09-15T12:27:10.022 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 36 tests. 2024-09-15T12:27:10.022 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 21 tests, listed below: 2024-09-15T12:27:10.022 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAio.MultiReads 2024-09-15T12:27:10.022 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP 2024-09-15T12:27:10.022 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP 2024-09-15T12:27:10.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP 2024-09-15T12:27:10.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 2024-09-15T12:27:10.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 2024-09-15T12:27:10.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-15T12:27:10.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP 2024-09-15T12:27:10.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP 2024-09-15T12:27:10.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP 2024-09-15T12:27:10.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP 2024-09-15T12:27:10.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP 2024-09-15T12:27:10.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP 2024-09-15T12:27:10.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-15T12:27:10.024 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-15T12:27:10.024 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP 2024-09-15T12:27:10.024 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS 2024-09-15T12:27:10.024 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP 2024-09-15T12:27:10.024 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP 2024-09-15T12:27:10.024 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP 2024-09-15T12:27:10.024 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP 2024-09-15T12:27:10.025 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:27:10.025 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:27:10.025 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_io 2024-09-15T12:27:10.037 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:27:10.037 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 24 tests from 2 test suites. 2024-09-15T12:27:10.037 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:10.037 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 14 tests from LibRadosIo 2024-09-15T12:27:12.019 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIo.SimpleWrite 2024-09-15T12:27:12.334 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIo.SimpleWrite (316 ms) 2024-09-15T12:27:12.334 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIo.TooBig 2024-09-15T12:27:12.334 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIo.TooBig (0 ms) 2024-09-15T12:27:12.334 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIo.ReadTimeout 2024-09-15T12:27:12.403 INFO:tasks.workunit.client.0.smithi122.stdout:no timeout :/ 2024-09-15T12:27:12.404 INFO:tasks.workunit.client.0.smithi122.stdout:no timeout :/ 2024-09-15T12:27:12.404 INFO:tasks.workunit.client.0.smithi122.stdout:no timeout :/ 2024-09-15T12:27:12.404 INFO:tasks.workunit.client.0.smithi122.stdout:no timeout :/ 2024-09-15T12:27:12.404 INFO:tasks.workunit.client.0.smithi122.stdout:no timeout :/ 2024-09-15T12:27:12.404 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIo.ReadTimeout (70 ms) 2024-09-15T12:27:12.404 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIo.RoundTrip 2024-09-15T12:27:12.445 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIo.RoundTrip (41 ms) 2024-09-15T12:27:12.445 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIo.Checksum 2024-09-15T12:27:12.465 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIo.Checksum (20 ms) 2024-09-15T12:27:12.465 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-09-15T12:27:12.496 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIo.OverlappingWriteRoundTrip (32 ms) 2024-09-15T12:27:12.496 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIo.WriteFullRoundTrip 2024-09-15T12:27:12.526 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIo.WriteFullRoundTrip (29 ms) 2024-09-15T12:27:12.526 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIo.AppendRoundTrip 2024-09-15T12:27:12.557 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIo.AppendRoundTrip (31 ms) 2024-09-15T12:27:12.557 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIo.ZeroLenZero 2024-09-15T12:27:12.562 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIo.ZeroLenZero (6 ms) 2024-09-15T12:27:12.562 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIo.TruncTest 2024-09-15T12:27:12.594 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIo.TruncTest (31 ms) 2024-09-15T12:27:12.594 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIo.RemoveTest 2024-09-15T12:27:12.625 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIo.RemoveTest (31 ms) 2024-09-15T12:27:12.625 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIo.XattrsRoundTrip 2024-09-15T12:27:12.660 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIo.XattrsRoundTrip (36 ms) 2024-09-15T12:27:12.661 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIo.RmXattr 2024-09-15T12:27:12.745 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIo.RmXattr (85 ms) 2024-09-15T12:27:12.746 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIo.XattrIter 2024-09-15T12:27:12.790 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIo.XattrIter (45 ms) 2024-09-15T12:27:13.034 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 14 tests from LibRadosIo (773 ms total) 2024-09-15T12:27:13.034 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:13.035 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 10 tests from LibRadosIoEC 2024-09-15T12:27:13.035 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-15T12:27:13.035 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.035 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoEC.SimpleWrite 2024-09-15T12:27:13.035 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:13.035 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.035 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:13.035 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.035 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2024-09-15T12:27:13.035 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoEC.RoundTrip 2024-09-15T12:27:13.035 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:13.035 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.035 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:13.035 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.036 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2024-09-15T12:27:13.036 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-15T12:27:13.036 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:13.036 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.036 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:13.036 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.036 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2024-09-15T12:27:13.036 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-09-15T12:27:13.036 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:13.036 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.036 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:13.036 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.036 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2024-09-15T12:27:13.036 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoEC.AppendRoundTrip 2024-09-15T12:27:13.037 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:13.037 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.037 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:13.037 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.037 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2024-09-15T12:27:13.037 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoEC.TruncTest 2024-09-15T12:27:13.038 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:13.038 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.038 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:13.038 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.038 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2024-09-15T12:27:13.038 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoEC.RemoveTest 2024-09-15T12:27:13.038 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:13.038 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.038 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:13.038 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.038 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2024-09-15T12:27:13.039 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-09-15T12:27:13.039 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:13.039 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.039 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:13.039 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.039 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2024-09-15T12:27:13.039 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoEC.RmXattr 2024-09-15T12:27:13.039 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:13.040 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.040 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:13.040 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.040 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2024-09-15T12:27:13.040 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoEC.XattrIter 2024-09-15T12:27:13.040 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:13.040 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.040 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:13.040 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.041 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2024-09-15T12:27:13.041 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-15T12:27:13.041 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:13.041 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 10 tests from LibRadosIoEC (0 ms total) 2024-09-15T12:27:13.041 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:13.041 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:13.041 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 24 tests from 2 test suites ran. (2994 ms total) 2024-09-15T12:27:13.041 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 14 tests. 2024-09-15T12:27:13.041 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 10 tests, listed below: 2024-09-15T12:27:13.041 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite 2024-09-15T12:27:13.041 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip 2024-09-15T12:27:13.041 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-15T12:27:13.042 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2024-09-15T12:27:13.042 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2024-09-15T12:27:13.042 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest 2024-09-15T12:27:13.042 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest 2024-09-15T12:27:13.042 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2024-09-15T12:27:13.042 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr 2024-09-15T12:27:13.042 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter 2024-09-15T12:27:13.042 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:27:13.043 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:27:13.043 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_io_pp 2024-09-15T12:27:13.053 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:27:13.053 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 40 tests from 2 test suites. 2024-09-15T12:27:13.053 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:13.053 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 22 tests from LibRadosIoPP 2024-09-15T12:27:13.053 INFO:tasks.workunit.client.0.smithi122.stdout:seed 31437 2024-09-15T12:27:15.040 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.TooBigPP 2024-09-15T12:27:15.040 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-09-15T12:27:15.040 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.SimpleWritePP 2024-09-15T12:27:15.383 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.SimpleWritePP (344 ms) 2024-09-15T12:27:15.384 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.ReadOpPP 2024-09-15T12:27:15.467 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.ReadOpPP (83 ms) 2024-09-15T12:27:15.467 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.SparseReadOpPP 2024-09-15T12:27:15.496 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.SparseReadOpPP (29 ms) 2024-09-15T12:27:15.496 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-09-15T12:27:18.254 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (2758 ms) 2024-09-15T12:27:18.254 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.RoundTripPP 2024-09-15T12:27:18.272 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.RoundTripPP (19 ms) 2024-09-15T12:27:18.272 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.RoundTripPP2 2024-09-15T12:27:18.293 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.RoundTripPP2 (20 ms) 2024-09-15T12:27:18.293 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.Checksum 2024-09-15T12:27:18.311 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.Checksum (18 ms) 2024-09-15T12:27:18.311 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-09-15T12:27:18.329 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.ReadIntoBufferlist (18 ms) 2024-09-15T12:27:18.329 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-09-15T12:27:18.361 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (32 ms) 2024-09-15T12:27:18.361 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-09-15T12:27:18.391 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP (30 ms) 2024-09-15T12:27:18.391 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-09-15T12:27:18.411 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (20 ms) 2024-09-15T12:27:18.411 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-09-15T12:27:18.440 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.AppendRoundTripPP (30 ms) 2024-09-15T12:27:18.440 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.TruncTestPP 2024-09-15T12:27:18.469 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.TruncTestPP (28 ms) 2024-09-15T12:27:18.469 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.RemoveTestPP 2024-09-15T12:27:18.497 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.RemoveTestPP (28 ms) 2024-09-15T12:27:18.497 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-09-15T12:27:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.XattrsRoundTripPP (34 ms) 2024-09-15T12:27:18.530 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.RmXattrPP 2024-09-15T12:27:18.615 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.RmXattrPP (84 ms) 2024-09-15T12:27:18.615 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-15T12:27:18.656 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.XattrListPP (41 ms) 2024-09-15T12:27:18.656 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.CrcZeroWrite 2024-09-15T12:27:18.685 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.CrcZeroWrite (29 ms) 2024-09-15T12:27:18.685 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.CmpExtPP 2024-09-15T12:27:18.721 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.CmpExtPP (36 ms) 2024-09-15T12:27:18.721 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-09-15T12:27:18.738 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.CmpExtDNEPP (18 ms) 2024-09-15T12:27:18.738 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-09-15T12:27:18.766 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosIoPP.CmpExtMismatchPP (28 ms) 2024-09-15T12:27:19.049 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 22 tests from LibRadosIoPP (3727 ms total) 2024-09-15T12:27:19.050 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:19.050 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 18 tests from LibRadosIoECPP 2024-09-15T12:27:19.050 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-15T12:27:19.050 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.050 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.SimpleWritePP 2024-09-15T12:27:19.050 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.050 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.050 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.050 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.050 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2024-09-15T12:27:19.050 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.ReadOpPP 2024-09-15T12:27:19.050 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.051 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.051 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.051 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.051 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP (0 ms) 2024-09-15T12:27:19.051 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-09-15T12:27:19.051 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.051 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.051 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.051 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.051 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2024-09-15T12:27:19.051 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP 2024-09-15T12:27:19.051 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.051 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.052 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.052 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.052 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2024-09-15T12:27:19.052 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP2 2024-09-15T12:27:19.052 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.052 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.052 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.052 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.052 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2024-09-15T12:27:19.052 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-15T12:27:19.052 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.052 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.052 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.052 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.053 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2024-09-15T12:27:19.053 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-15T12:27:19.053 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.053 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.053 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.053 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.053 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2024-09-15T12:27:19.053 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-15T12:27:19.053 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.053 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.053 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.053 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.053 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2024-09-15T12:27:19.053 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-09-15T12:27:19.053 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.054 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.054 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.054 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.054 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2024-09-15T12:27:19.054 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.TruncTestPP 2024-09-15T12:27:19.054 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.054 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.054 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.054 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.054 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2024-09-15T12:27:19.054 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.RemoveTestPP 2024-09-15T12:27:19.054 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.054 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.054 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.054 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.055 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2024-09-15T12:27:19.055 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-15T12:27:19.055 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.055 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.055 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.055 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.055 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2024-09-15T12:27:19.055 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.RmXattrPP 2024-09-15T12:27:19.055 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.055 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.055 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.055 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.055 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2024-09-15T12:27:19.056 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.CrcZeroWrite 2024-09-15T12:27:19.056 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.056 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.056 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.056 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.056 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite (0 ms) 2024-09-15T12:27:19.056 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.XattrListPP 2024-09-15T12:27:19.056 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.056 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.056 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.056 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.056 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2024-09-15T12:27:19.056 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.CmpExtPP 2024-09-15T12:27:19.056 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.057 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.057 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.057 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.057 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2024-09-15T12:27:19.057 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-09-15T12:27:19.057 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.057 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.057 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.057 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.057 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2024-09-15T12:27:19.057 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-15T12:27:19.057 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:19.057 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.057 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:19.058 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.058 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2024-09-15T12:27:19.058 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-15T12:27:19.058 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:19.058 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 18 tests from LibRadosIoECPP (0 ms total) 2024-09-15T12:27:19.058 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:19.058 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:19.058 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 40 tests from 2 test suites ran. (5995 ms total) 2024-09-15T12:27:19.058 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 22 tests. 2024-09-15T12:27:19.058 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 18 tests, listed below: 2024-09-15T12:27:19.058 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2024-09-15T12:27:19.058 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP 2024-09-15T12:27:19.058 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2024-09-15T12:27:19.058 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP 2024-09-15T12:27:19.058 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2024-09-15T12:27:19.059 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-15T12:27:19.059 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-15T12:27:19.059 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-15T12:27:19.059 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2024-09-15T12:27:19.059 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP 2024-09-15T12:27:19.059 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2024-09-15T12:27:19.059 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-15T12:27:19.059 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP 2024-09-15T12:27:19.059 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite 2024-09-15T12:27:19.059 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP 2024-09-15T12:27:19.059 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP 2024-09-15T12:27:19.059 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2024-09-15T12:27:19.059 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-15T12:27:19.060 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:27:19.060 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:27:19.060 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_asio 2024-09-15T12:27:19.094 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.093+0000 7f627292d6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:19.113 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.111+0000 7f627292d6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:19.113 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.111+0000 7f627292d6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:19.113 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-15T12:27:19.113 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:19.113 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 12 tests from AsioRados 2024-09-15T12:27:19.114 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.113+0000 7f627292d6c0 1 Processor -- start 2024-09-15T12:27:19.114 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.113+0000 7f627292d6c0 1 -- start start 2024-09-15T12:27:19.116 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.114+0000 7f627292d6c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xec7660 0xec2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:27:19.117 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.115+0000 7f627292d6c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0xe2b520 con 0xec7660 2024-09-15T12:27:19.117 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.115+0000 7f626b23f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xec7660 0xec2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:27:19.117 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.115+0000 7f626b23f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xec7660 0xec2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54848/0 (socket says 172.21.15.122:54848) 2024-09-15T12:27:19.117 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.115+0000 7f626b23f640 1 -- 172.21.15.122:0/2397425750 learned_addr learned my addr 172.21.15.122:0/2397425750 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:27:19.118 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.116+0000 7f626b23f640 1 -- 172.21.15.122:0/2397425750 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xdc7e10 con 0xec7660 2024-09-15T12:27:19.118 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.116+0000 7f626b23f640 1 --2- 172.21.15.122:0/2397425750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xec7660 0xec2d80 crc :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de96532844053804 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:27:19.118 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.116+0000 7f6269a3c640 1 -- 172.21.15.122:0/2397425750 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f625802dae0 con 0xec7660 2024-09-15T12:27:19.118 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.116+0000 7f6269a3c640 1 -- 172.21.15.122:0/2397425750 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f625802dc40 con 0xec7660 2024-09-15T12:27:19.118 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.116+0000 7f6269a3c640 1 -- 172.21.15.122:0/2397425750 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6258037370 con 0xec7660 2024-09-15T12:27:19.119 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.118+0000 7f627292d6c0 1 -- 172.21.15.122:0/2397425750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xec7660 msgr2=0xec2d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:27:19.119 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.118+0000 7f627292d6c0 1 --2- 172.21.15.122:0/2397425750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xec7660 0xec2d80 crc :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:27:19.121 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.119+0000 7f627292d6c0 1 -- 172.21.15.122:0/2397425750 shutdown_connections 2024-09-15T12:27:19.121 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.119+0000 7f627292d6c0 1 --2- 172.21.15.122:0/2397425750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xec7660 0xec2d80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:27:19.121 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.119+0000 7f627292d6c0 1 -- 172.21.15.122:0/2397425750 >> 172.21.15.122:0/2397425750 conn(0xdeb770 msgr2=0xecc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:27:19.121 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.119+0000 7f627292d6c0 1 -- 172.21.15.122:0/2397425750 shutdown_connections 2024-09-15T12:27:19.121 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.119+0000 7f627292d6c0 1 -- 172.21.15.122:0/2397425750 wait complete. 2024-09-15T12:27:19.122 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.121+0000 7f627292d6c0 1 Processor -- start 2024-09-15T12:27:19.122 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.121+0000 7f627292d6c0 1 -- start start 2024-09-15T12:27:19.124 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.123+0000 7f627292d6c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xec7660 0xfef370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:27:19.124 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.123+0000 7f627292d6c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0xe29280 con 0xec7660 2024-09-15T12:27:19.125 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.123+0000 7f626b23f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xec7660 0xfef370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:27:19.125 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.123+0000 7f626b23f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xec7660 0xfef370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54852/0 (socket says 172.21.15.122:54852) 2024-09-15T12:27:19.126 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.123+0000 7f626b23f640 1 -- 172.21.15.122:0/1575796118 learned_addr learned my addr 172.21.15.122:0/1575796118 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:27:19.126 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.124+0000 7f626b23f640 1 -- 172.21.15.122:0/1575796118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xdb9920 con 0xec7660 2024-09-15T12:27:19.126 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.124+0000 7f626b23f640 1 --2- 172.21.15.122:0/1575796118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xec7660 0xfef370 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:27:19.127 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.124+0000 7f6268a3a640 1 -- 172.21.15.122:0/1575796118 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f625802dae0 con 0xec7660 2024-09-15T12:27:19.127 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.125+0000 7f6268a3a640 1 -- 172.21.15.122:0/1575796118 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6258037520 con 0xec7660 2024-09-15T12:27:19.127 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.125+0000 7f6268a3a640 1 -- 172.21.15.122:0/1575796118 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62580377c0 con 0xec7660 2024-09-15T12:27:19.127 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.125+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xdb9380 con 0xec7660 2024-09-15T12:27:19.127 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.125+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0xfece90 con 0xec7660 2024-09-15T12:27:19.128 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.126+0000 7f6268a3a640 1 -- 172.21.15.122:0/1575796118 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6258037970 con 0xec7660 2024-09-15T12:27:19.128 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.126+0000 7f6268a3a640 1 --2- 172.21.15.122:0/1575796118 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f62500415d0 0x7f6250043ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:27:19.129 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.126+0000 7f6268a3a640 1 -- 172.21.15.122:0/1575796118 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 2700+0+0 (crc 0 0 0) 0x7f6258032040 con 0xec7660 2024-09-15T12:27:19.129 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.127+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0xe21df0 con 0xec7660 2024-09-15T12:27:19.129 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.127+0000 7f626aa3e640 1 --2- 172.21.15.122:0/1575796118 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f62500415d0 0x7f6250043ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:27:19.129 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.127+0000 7f6268a3a640 1 -- 172.21.15.122:0/1575796118 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (crc 0 0 0) 0x7f625803f040 con 0xec7660 2024-09-15T12:27:19.130 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.128+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0xe34bf0 con 0xec7660 2024-09-15T12:27:19.130 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:19.128+0000 7f626aa3e640 1 --2- 172.21.15.122:0/1575796118 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f62500415d0 0x7f6250043ae0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:27:20.049 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:20.048+0000 7f6268a3a640 1 -- 172.21.15.122:0/1575796118 <== mon.0 v2:172.21.15.122:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v236) ==== 43+0+0 (crc 0 0 0) 0x7f62580354c0 con 0xec7660 2024-09-15T12:27:20.050 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:20.048+0000 7f6268a3a640 1 -- 172.21.15.122:0/1575796118 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=236}) -- 0x7f6250045f50 con 0xec7660 2024-09-15T12:27:20.050 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:20.048+0000 7f6268a3a640 1 -- 172.21.15.122:0/1575796118 <== mon.0 v2:172.21.15.122:3300/0 8 ==== osd_map(236..236 src has 1..236) ==== 651+0+0 (crc 0 0 0) 0x7f6258006e20 con 0xec7660 2024-09-15T12:27:20.050 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:20.049+0000 7f627292d6c0 1 --2- 172.21.15.122:0/1575796118 >> v2:172.21.15.122:6803/3904627990 conn(0xec94e0 0xff4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:27:20.050 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:20.049+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:2 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xff4750 con 0xec94e0 2024-09-15T12:27:20.055 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:20.054+0000 7f626ba40640 1 --2- 172.21.15.122:0/1575796118 >> v2:172.21.15.122:6803/3904627990 conn(0xec94e0 0xff4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:27:20.092 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:20.091+0000 7f626ba40640 1 --2- 172.21.15.122:0/1575796118 >> v2:172.21.15.122:6803/3904627990 conn(0xec94e0 0xff4210 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:27:21.237 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.235+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 1 ==== osd_op_reply(2 exist [writefull 0~5] v237'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.237 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] AsioRados.AsyncReadCallback 2024-09-15T12:27:21.237 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.235+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:3 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xfcea10 con 0xec94e0 2024-09-15T12:27:21.237 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.235+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:4 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xfcf2b0 con 0xec94e0 2024-09-15T12:27:21.248 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.246+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 2 ==== osd_op_reply(3 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.248 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.246+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.248 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] AsioRados.AsyncReadCallback (11 ms) 2024-09-15T12:27:21.248 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] AsioRados.AsyncReadFuture 2024-09-15T12:27:21.248 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.246+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:5 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xfd2280 con 0xec94e0 2024-09-15T12:27:21.248 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.246+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:6 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xff4ab0 con 0xec94e0 2024-09-15T12:27:21.261 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.259+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 4 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.261 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.259+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 5 ==== osd_op_reply(5 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.261 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] AsioRados.AsyncReadFuture (13 ms) 2024-09-15T12:27:21.261 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] AsioRados.AsyncReadYield 2024-09-15T12:27:21.262 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.259+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:7 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xfcf660 con 0xec94e0 2024-09-15T12:27:21.262 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.259+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:8 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x10352e0 con 0xec94e0 2024-09-15T12:27:21.296 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.295+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 6 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.296 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.295+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.297 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] AsioRados.AsyncReadYield (36 ms) 2024-09-15T12:27:21.297 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] AsioRados.AsyncWriteCallback 2024-09-15T12:27:21.297 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.295+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:9 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xff5e20 con 0xec94e0 2024-09-15T12:27:21.311 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.309+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 8 ==== osd_op_reply(9 exist [write 0~5] v237'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.311 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] AsioRados.AsyncWriteCallback (14 ms) 2024-09-15T12:27:21.311 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] AsioRados.AsyncWriteFuture 2024-09-15T12:27:21.311 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.309+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:10 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xff5e20 con 0xec94e0 2024-09-15T12:27:21.325 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.324+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 9 ==== osd_op_reply(10 exist [write 0~5] v237'3 uv3 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.325 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] AsioRados.AsyncWriteFuture (15 ms) 2024-09-15T12:27:21.326 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] AsioRados.AsyncWriteYield 2024-09-15T12:27:21.326 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.324+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:11 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x1017e70 con 0xec94e0 2024-09-15T12:27:21.341 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.340+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 10 ==== osd_op_reply(11 exist [write 0~5] v237'4 uv4 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.341 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] AsioRados.AsyncWriteYield (16 ms) 2024-09-15T12:27:21.342 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] AsioRados.AsyncReadOperationCallback 2024-09-15T12:27:21.342 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.340+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:12 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xff4e10 con 0xec94e0 2024-09-15T12:27:21.342 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.340+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:13 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xff5770 con 0xec94e0 2024-09-15T12:27:21.352 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.351+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 11 ==== osd_op_reply(12 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.352 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.351+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 12 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.353 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] AsioRados.AsyncReadOperationCallback (11 ms) 2024-09-15T12:27:21.353 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] AsioRados.AsyncReadOperationFuture 2024-09-15T12:27:21.353 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.351+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:14 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0xff4e10 con 0xec94e0 2024-09-15T12:27:21.353 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.351+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:15 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1018410 con 0xec94e0 2024-09-15T12:27:21.363 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.361+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 13 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.363 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.361+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 14 ==== osd_op_reply(14 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.363 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] AsioRados.AsyncReadOperationFuture (10 ms) 2024-09-15T12:27:21.363 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] AsioRados.AsyncReadOperationYield 2024-09-15T12:27:21.364 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.361+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:16 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1018410 con 0xec94e0 2024-09-15T12:27:21.364 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.361+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:17 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1017e70 con 0xec94e0 2024-09-15T12:27:21.374 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.372+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 15 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.374 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.373+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 16 ==== osd_op_reply(16 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.375 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] AsioRados.AsyncReadOperationYield (12 ms) 2024-09-15T12:27:21.375 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] AsioRados.AsyncWriteOperationCallback 2024-09-15T12:27:21.375 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.373+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:18 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x1018410 con 0xec94e0 2024-09-15T12:27:21.390 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.389+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 17 ==== osd_op_reply(18 exist [writefull 0~5] v237'5 uv5 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.390 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] AsioRados.AsyncWriteOperationCallback (16 ms) 2024-09-15T12:27:21.391 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] AsioRados.AsyncWriteOperationFuture 2024-09-15T12:27:21.391 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.389+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:19 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x1018410 con 0xec94e0 2024-09-15T12:27:21.404 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.403+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 18 ==== osd_op_reply(19 exist [writefull 0~5] v237'6 uv6 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.405 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] AsioRados.AsyncWriteOperationFuture (14 ms) 2024-09-15T12:27:21.405 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] AsioRados.AsyncWriteOperationYield 2024-09-15T12:27:21.405 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.403+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:20 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x1018410 con 0xec94e0 2024-09-15T12:27:21.416 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.414+0000 7f626ba40640 1 -- 172.21.15.122:0/1575796118 <== osd.1 v2:172.21.15.122:6803/3904627990 19 ==== osd_op_reply(20 exist [writefull 0~5] v237'7 uv7 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f625c00a430 con 0xec94e0 2024-09-15T12:27:21.416 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] AsioRados.AsyncWriteOperationYield (11 ms) 2024-09-15T12:27:21.417 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.415+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 >> v2:172.21.15.122:6803/3904627990 conn(0xec94e0 msgr2=0xff4210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:27:21.418 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.415+0000 7f627292d6c0 1 --2- 172.21.15.122:0/1575796118 >> v2:172.21.15.122:6803/3904627990 conn(0xec94e0 0xff4210 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:27:21.418 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.415+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f62500415d0 msgr2=0x7f6250043ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:27:21.418 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.415+0000 7f627292d6c0 1 --2- 172.21.15.122:0/1575796118 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f62500415d0 0x7f6250043ae0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:27:21.418 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.415+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xec7660 msgr2=0xfef370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:27:21.418 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.415+0000 7f627292d6c0 1 --2- 172.21.15.122:0/1575796118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xec7660 0xfef370 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:27:21.418 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.415+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 shutdown_connections 2024-09-15T12:27:21.418 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.415+0000 7f627292d6c0 1 --2- 172.21.15.122:0/1575796118 >> v2:172.21.15.122:6803/3904627990 conn(0xec94e0 0xff4210 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:27:21.418 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.415+0000 7f627292d6c0 1 --2- 172.21.15.122:0/1575796118 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f62500415d0 0x7f6250043ae0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:27:21.418 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.415+0000 7f627292d6c0 1 --2- 172.21.15.122:0/1575796118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xec7660 0xfef370 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:27:21.418 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.415+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 >> 172.21.15.122:0/1575796118 conn(0xdeb770 msgr2=0xecc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:27:21.418 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.415+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 shutdown_connections 2024-09-15T12:27:21.418 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.415+0000 7f627292d6c0 1 -- 172.21.15.122:0/1575796118 wait complete. 2024-09-15T12:27:21.418 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 12 tests from AsioRados (179 ms total) 2024-09-15T12:27:21.419 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:21.419 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:21.419 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 12 tests from 1 test suite ran. (2304 ms total) 2024-09-15T12:27:21.419 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 12 tests. 2024-09-15T12:27:21.419 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:27:21.419 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:27:21.420 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_list 2024-09-15T12:27:21.449 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.447+0000 7fb5884da9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:21.449 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.447+0000 7fb5884da9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:21.449 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:21.448+0000 7fb5884da9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:21.449 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 11 tests from 3 test suites. 2024-09-15T12:27:21.450 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:21.450 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from LibRadosList 2024-09-15T12:27:23.057 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosList.ListObjects 2024-09-15T12:27:23.607 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosList.ListObjects (550 ms) 2024-09-15T12:27:23.607 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosList.ListObjectsZeroInName 2024-09-15T12:27:23.822 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosList.ListObjectsZeroInName (216 ms) 2024-09-15T12:27:23.823 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosList.ListObjectsNS 2024-09-15T12:27:23.927 INFO:tasks.workunit.client.0.smithi122.stdout:myset foo1,foo2,foo3 2024-09-15T12:27:24.025 INFO:tasks.workunit.client.0.smithi122.stdout:foo1 2024-09-15T12:27:24.025 INFO:tasks.workunit.client.0.smithi122.stdout:foo2 2024-09-15T12:27:24.025 INFO:tasks.workunit.client.0.smithi122.stdout:foo3 2024-09-15T12:27:24.025 INFO:tasks.workunit.client.0.smithi122.stdout:myset foo1,foo4,foo5 2024-09-15T12:27:24.147 INFO:tasks.workunit.client.0.smithi122.stdout:foo4 2024-09-15T12:27:24.147 INFO:tasks.workunit.client.0.smithi122.stdout:foo5 2024-09-15T12:27:24.147 INFO:tasks.workunit.client.0.smithi122.stdout:foo1 2024-09-15T12:27:24.147 INFO:tasks.workunit.client.0.smithi122.stdout:myset foo6,foo7 2024-09-15T12:27:24.245 INFO:tasks.workunit.client.0.smithi122.stdout:foo7 2024-09-15T12:27:24.245 INFO:tasks.workunit.client.0.smithi122.stdout:foo6 2024-09-15T12:27:24.245 INFO:tasks.workunit.client.0.smithi122.stdout:myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-15T12:27:24.344 INFO:tasks.workunit.client.0.smithi122.stdout:ns1:foo4 2024-09-15T12:27:24.344 INFO:tasks.workunit.client.0.smithi122.stdout:ns1:foo5 2024-09-15T12:27:24.344 INFO:tasks.workunit.client.0.smithi122.stdout:ns2:foo7 2024-09-15T12:27:24.344 INFO:tasks.workunit.client.0.smithi122.stdout:ns2:foo6 2024-09-15T12:27:24.344 INFO:tasks.workunit.client.0.smithi122.stdout:ns1:foo1 2024-09-15T12:27:24.344 INFO:tasks.workunit.client.0.smithi122.stdout::foo1 2024-09-15T12:27:24.344 INFO:tasks.workunit.client.0.smithi122.stdout::foo2 2024-09-15T12:27:24.344 INFO:tasks.workunit.client.0.smithi122.stdout::foo3 2024-09-15T12:27:24.533 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosList.ListObjectsNS (711 ms) 2024-09-15T12:27:24.534 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosList.ListObjectsStart 2024-09-15T12:27:24.845 INFO:tasks.workunit.client.0.smithi122.stdout:1 0 2024-09-15T12:27:24.846 INFO:tasks.workunit.client.0.smithi122.stdout:10 0 2024-09-15T12:27:24.846 INFO:tasks.workunit.client.0.smithi122.stdout:13 0 2024-09-15T12:27:24.846 INFO:tasks.workunit.client.0.smithi122.stdout:7 0 2024-09-15T12:27:24.846 INFO:tasks.workunit.client.0.smithi122.stdout:14 0 2024-09-15T12:27:24.846 INFO:tasks.workunit.client.0.smithi122.stdout:0 0 2024-09-15T12:27:24.846 INFO:tasks.workunit.client.0.smithi122.stdout:15 0 2024-09-15T12:27:24.846 INFO:tasks.workunit.client.0.smithi122.stdout:11 0 2024-09-15T12:27:24.846 INFO:tasks.workunit.client.0.smithi122.stdout:5 0 2024-09-15T12:27:24.846 INFO:tasks.workunit.client.0.smithi122.stdout:8 0 2024-09-15T12:27:24.846 INFO:tasks.workunit.client.0.smithi122.stdout:6 0 2024-09-15T12:27:24.846 INFO:tasks.workunit.client.0.smithi122.stdout:3 0 2024-09-15T12:27:24.846 INFO:tasks.workunit.client.0.smithi122.stdout:4 0 2024-09-15T12:27:24.846 INFO:tasks.workunit.client.0.smithi122.stdout:12 0 2024-09-15T12:27:24.847 INFO:tasks.workunit.client.0.smithi122.stdout:9 0 2024-09-15T12:27:24.847 INFO:tasks.workunit.client.0.smithi122.stdout:2 0 2024-09-15T12:27:24.946 INFO:tasks.workunit.client.0.smithi122.stdout:have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-15T12:27:25.229 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosList.ListObjectsStart (695 ms) 2024-09-15T12:27:25.229 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosList.ListObjectsCursor 2024-09-15T12:27:25.425 INFO:tasks.workunit.client.0.smithi122.stdout:x cursor=MIN 2024-09-15T12:27:25.527 INFO:tasks.workunit.client.0.smithi122.stdout:> oid=1 cursor=76:02547ec2:::1:head 2024-09-15T12:27:25.527 INFO:tasks.workunit.client.0.smithi122.stdout:> oid=10 cursor=76:52ea6a34:::10:head 2024-09-15T12:27:25.527 INFO:tasks.workunit.client.0.smithi122.stdout:> oid=13 cursor=76:566253c9:::13:head 2024-09-15T12:27:25.527 INFO:tasks.workunit.client.0.smithi122.stdout:> oid=7 cursor=76:5c6b0b28:::7:head 2024-09-15T12:27:25.527 INFO:tasks.workunit.client.0.smithi122.stdout:> oid=14 cursor=76:62a1935d:::14:head 2024-09-15T12:27:25.527 INFO:tasks.workunit.client.0.smithi122.stdout:> oid=0 cursor=76:6cac518f:::0:head 2024-09-15T12:27:25.527 INFO:tasks.workunit.client.0.smithi122.stdout:> oid=15 cursor=76:863748b0:::15:head 2024-09-15T12:27:25.527 INFO:tasks.workunit.client.0.smithi122.stdout:> oid=11 cursor=76:89d3ae78:::11:head 2024-09-15T12:27:25.528 INFO:tasks.workunit.client.0.smithi122.stdout:> oid=5 cursor=76:b29083e3:::5:head 2024-09-15T12:27:25.528 INFO:tasks.workunit.client.0.smithi122.stdout:> oid=8 cursor=76:bd63b0f1:::8:head 2024-09-15T12:27:25.528 INFO:tasks.workunit.client.0.smithi122.stdout:> oid=6 cursor=76:c4fdafeb:::6:head 2024-09-15T12:27:25.528 INFO:tasks.workunit.client.0.smithi122.stdout:> oid=3 cursor=76:cfc208b3:::3:head 2024-09-15T12:27:25.528 INFO:tasks.workunit.client.0.smithi122.stdout:> oid=4 cursor=76:d83876eb:::4:head 2024-09-15T12:27:25.528 INFO:tasks.workunit.client.0.smithi122.stdout:> oid=12 cursor=76:de5d7c5f:::12:head 2024-09-15T12:27:25.528 INFO:tasks.workunit.client.0.smithi122.stdout:> oid=9 cursor=76:e960b815:::9:head 2024-09-15T12:27:25.528 INFO:tasks.workunit.client.0.smithi122.stdout:> oid=2 cursor=76:f905c69b:::2:head 2024-09-15T12:27:25.625 INFO:tasks.workunit.client.0.smithi122.stdout:FIRST> seek to MIN oid=1 2024-09-15T12:27:25.724 INFO:tasks.workunit.client.0.smithi122.stdout:: oid=1 cursor=76:02547ec2:::1:head 2024-09-15T12:27:25.724 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:02547ec2:::1:head 2024-09-15T12:27:25.823 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:02547ec2:::1:head -> 1 2024-09-15T12:27:25.823 INFO:tasks.workunit.client.0.smithi122.stdout:: oid=10 cursor=76:52ea6a34:::10:head 2024-09-15T12:27:25.823 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:52ea6a34:::10:head 2024-09-15T12:27:25.895 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-15T12:27:25.895 INFO:tasks.workunit.client.0.smithi122.stdout:: oid=13 cursor=76:566253c9:::13:head 2024-09-15T12:27:25.895 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:566253c9:::13:head 2024-09-15T12:27:25.962 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:566253c9:::13:head -> 13 2024-09-15T12:27:25.962 INFO:tasks.workunit.client.0.smithi122.stdout:: oid=7 cursor=76:5c6b0b28:::7:head 2024-09-15T12:27:25.962 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-15T12:27:26.026 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-15T12:27:26.026 INFO:tasks.workunit.client.0.smithi122.stdout:: oid=14 cursor=76:62a1935d:::14:head 2024-09-15T12:27:26.026 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:62a1935d:::14:head 2024-09-15T12:27:26.086 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:62a1935d:::14:head -> 14 2024-09-15T12:27:26.086 INFO:tasks.workunit.client.0.smithi122.stdout:: oid=0 cursor=76:6cac518f:::0:head 2024-09-15T12:27:26.086 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:6cac518f:::0:head 2024-09-15T12:27:26.144 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:6cac518f:::0:head -> 0 2024-09-15T12:27:26.144 INFO:tasks.workunit.client.0.smithi122.stdout:: oid=15 cursor=76:863748b0:::15:head 2024-09-15T12:27:26.144 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:863748b0:::15:head 2024-09-15T12:27:26.192 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:863748b0:::15:head -> 15 2024-09-15T12:27:26.192 INFO:tasks.workunit.client.0.smithi122.stdout:: oid=11 cursor=76:89d3ae78:::11:head 2024-09-15T12:27:26.192 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:89d3ae78:::11:head 2024-09-15T12:27:26.237 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-15T12:27:26.237 INFO:tasks.workunit.client.0.smithi122.stdout:: oid=5 cursor=76:b29083e3:::5:head 2024-09-15T12:27:26.237 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:b29083e3:::5:head 2024-09-15T12:27:26.267 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:b29083e3:::5:head -> 5 2024-09-15T12:27:26.267 INFO:tasks.workunit.client.0.smithi122.stdout:: oid=8 cursor=76:bd63b0f1:::8:head 2024-09-15T12:27:26.267 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-15T12:27:26.294 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-15T12:27:26.294 INFO:tasks.workunit.client.0.smithi122.stdout:: oid=6 cursor=76:c4fdafeb:::6:head 2024-09-15T12:27:26.294 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-15T12:27:26.318 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-15T12:27:26.318 INFO:tasks.workunit.client.0.smithi122.stdout:: oid=3 cursor=76:cfc208b3:::3:head 2024-09-15T12:27:26.318 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:cfc208b3:::3:head 2024-09-15T12:27:26.339 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-15T12:27:26.339 INFO:tasks.workunit.client.0.smithi122.stdout:: oid=4 cursor=76:d83876eb:::4:head 2024-09-15T12:27:26.339 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:d83876eb:::4:head 2024-09-15T12:27:26.354 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:d83876eb:::4:head -> 4 2024-09-15T12:27:26.354 INFO:tasks.workunit.client.0.smithi122.stdout:: oid=12 cursor=76:de5d7c5f:::12:head 2024-09-15T12:27:26.354 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-15T12:27:26.369 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-15T12:27:26.369 INFO:tasks.workunit.client.0.smithi122.stdout:: oid=9 cursor=76:e960b815:::9:head 2024-09-15T12:27:26.369 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:e960b815:::9:head 2024-09-15T12:27:26.378 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:e960b815:::9:head -> 9 2024-09-15T12:27:26.378 INFO:tasks.workunit.client.0.smithi122.stdout:: oid=2 cursor=76:f905c69b:::2:head 2024-09-15T12:27:26.378 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:f905c69b:::2:head 2024-09-15T12:27:26.381 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:f905c69b:::2:head -> 2 2024-09-15T12:27:26.381 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:52ea6a34:::10:head 2024-09-15T12:27:26.381 INFO:tasks.workunit.client.0.smithi122.stdout:: cursor()=76:52ea6a34:::10:head expected=76:52ea6a34:::10:head 2024-09-15T12:27:26.450 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-15T12:27:26.450 INFO:tasks.workunit.client.0.smithi122.stdout:: entry=10 expected=10 2024-09-15T12:27:26.450 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-15T12:27:26.450 INFO:tasks.workunit.client.0.smithi122.stdout:: cursor()=76:5c6b0b28:::7:head expected=76:5c6b0b28:::7:head 2024-09-15T12:27:26.514 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-15T12:27:26.514 INFO:tasks.workunit.client.0.smithi122.stdout:: entry=7 expected=7 2024-09-15T12:27:26.514 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:566253c9:::13:head 2024-09-15T12:27:26.514 INFO:tasks.workunit.client.0.smithi122.stdout:: cursor()=76:566253c9:::13:head expected=76:566253c9:::13:head 2024-09-15T12:27:26.582 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:566253c9:::13:head -> 13 2024-09-15T12:27:26.583 INFO:tasks.workunit.client.0.smithi122.stdout:: entry=13 expected=13 2024-09-15T12:27:26.583 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:f905c69b:::2:head 2024-09-15T12:27:26.583 INFO:tasks.workunit.client.0.smithi122.stdout:: cursor()=76:f905c69b:::2:head expected=76:f905c69b:::2:head 2024-09-15T12:27:26.586 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:f905c69b:::2:head -> 2 2024-09-15T12:27:26.586 INFO:tasks.workunit.client.0.smithi122.stdout:: entry=2 expected=2 2024-09-15T12:27:26.586 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:e960b815:::9:head 2024-09-15T12:27:26.586 INFO:tasks.workunit.client.0.smithi122.stdout:: cursor()=76:e960b815:::9:head expected=76:e960b815:::9:head 2024-09-15T12:27:26.595 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:e960b815:::9:head -> 9 2024-09-15T12:27:26.595 INFO:tasks.workunit.client.0.smithi122.stdout:: entry=9 expected=9 2024-09-15T12:27:26.595 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-15T12:27:26.595 INFO:tasks.workunit.client.0.smithi122.stdout:: cursor()=76:de5d7c5f:::12:head expected=76:de5d7c5f:::12:head 2024-09-15T12:27:26.610 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-15T12:27:26.610 INFO:tasks.workunit.client.0.smithi122.stdout:: entry=12 expected=12 2024-09-15T12:27:26.610 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:863748b0:::15:head 2024-09-15T12:27:26.610 INFO:tasks.workunit.client.0.smithi122.stdout:: cursor()=76:863748b0:::15:head expected=76:863748b0:::15:head 2024-09-15T12:27:26.658 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:863748b0:::15:head -> 15 2024-09-15T12:27:26.659 INFO:tasks.workunit.client.0.smithi122.stdout:: entry=15 expected=15 2024-09-15T12:27:26.659 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:02547ec2:::1:head 2024-09-15T12:27:26.659 INFO:tasks.workunit.client.0.smithi122.stdout:: cursor()=76:02547ec2:::1:head expected=76:02547ec2:::1:head 2024-09-15T12:27:26.759 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:02547ec2:::1:head -> 1 2024-09-15T12:27:26.759 INFO:tasks.workunit.client.0.smithi122.stdout:: entry=1 expected=1 2024-09-15T12:27:26.759 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:d83876eb:::4:head 2024-09-15T12:27:26.759 INFO:tasks.workunit.client.0.smithi122.stdout:: cursor()=76:d83876eb:::4:head expected=76:d83876eb:::4:head 2024-09-15T12:27:26.774 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:d83876eb:::4:head -> 4 2024-09-15T12:27:26.774 INFO:tasks.workunit.client.0.smithi122.stdout:: entry=4 expected=4 2024-09-15T12:27:26.774 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:6cac518f:::0:head 2024-09-15T12:27:26.774 INFO:tasks.workunit.client.0.smithi122.stdout:: cursor()=76:6cac518f:::0:head expected=76:6cac518f:::0:head 2024-09-15T12:27:26.832 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:6cac518f:::0:head -> 0 2024-09-15T12:27:26.832 INFO:tasks.workunit.client.0.smithi122.stdout:: entry=0 expected=0 2024-09-15T12:27:26.832 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:62a1935d:::14:head 2024-09-15T12:27:26.832 INFO:tasks.workunit.client.0.smithi122.stdout:: cursor()=76:62a1935d:::14:head expected=76:62a1935d:::14:head 2024-09-15T12:27:26.893 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:62a1935d:::14:head -> 14 2024-09-15T12:27:26.893 INFO:tasks.workunit.client.0.smithi122.stdout:: entry=14 expected=14 2024-09-15T12:27:26.893 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:cfc208b3:::3:head 2024-09-15T12:27:26.893 INFO:tasks.workunit.client.0.smithi122.stdout:: cursor()=76:cfc208b3:::3:head expected=76:cfc208b3:::3:head 2024-09-15T12:27:26.914 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-15T12:27:26.914 INFO:tasks.workunit.client.0.smithi122.stdout:: entry=3 expected=3 2024-09-15T12:27:26.914 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-15T12:27:26.914 INFO:tasks.workunit.client.0.smithi122.stdout:: cursor()=76:c4fdafeb:::6:head expected=76:c4fdafeb:::6:head 2024-09-15T12:27:26.939 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-15T12:27:26.939 INFO:tasks.workunit.client.0.smithi122.stdout:: entry=6 expected=6 2024-09-15T12:27:26.939 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-15T12:27:26.939 INFO:tasks.workunit.client.0.smithi122.stdout:: cursor()=76:bd63b0f1:::8:head expected=76:bd63b0f1:::8:head 2024-09-15T12:27:26.966 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-15T12:27:26.966 INFO:tasks.workunit.client.0.smithi122.stdout:: entry=8 expected=8 2024-09-15T12:27:26.966 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:b29083e3:::5:head 2024-09-15T12:27:26.966 INFO:tasks.workunit.client.0.smithi122.stdout:: cursor()=76:b29083e3:::5:head expected=76:b29083e3:::5:head 2024-09-15T12:27:27.002 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:b29083e3:::5:head -> 5 2024-09-15T12:27:27.002 INFO:tasks.workunit.client.0.smithi122.stdout:: entry=5 expected=5 2024-09-15T12:27:27.002 INFO:tasks.workunit.client.0.smithi122.stdout:: seek to 76:89d3ae78:::11:head 2024-09-15T12:27:27.002 INFO:tasks.workunit.client.0.smithi122.stdout:: cursor()=76:89d3ae78:::11:head expected=76:89d3ae78:::11:head 2024-09-15T12:27:27.048 INFO:tasks.workunit.client.0.smithi122.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-15T12:27:27.048 INFO:tasks.workunit.client.0.smithi122.stdout:: entry=11 expected=11 2024-09-15T12:27:27.329 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosList.ListObjectsCursor (2100 ms) 2024-09-15T12:27:27.329 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosList.EnumerateObjects 2024-09-15T12:27:27.909 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosList.EnumerateObjects (580 ms) 2024-09-15T12:27:27.909 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosList.EnumerateObjectsSplit 2024-09-15T12:27:28.108 INFO:tasks.workunit.client.0.smithi122.stdout:split 0/5 -> MIN 76:33333333::::head 2024-09-15T12:27:28.131 INFO:tasks.workunit.client.0.smithi122.stdout:split 1/5 -> 76:33333333::::head 76:66666666::::head 2024-09-15T12:27:28.153 INFO:tasks.workunit.client.0.smithi122.stdout:split 2/5 -> 76:66666666::::head 76:99999999::::head 2024-09-15T12:27:28.178 INFO:tasks.workunit.client.0.smithi122.stdout:split 3/5 -> 76:99999999::::head 76:cccccccc::::head 2024-09-15T12:27:28.199 INFO:tasks.workunit.client.0.smithi122.stdout:split 4/5 -> 76:cccccccc::::head MAX 2024-09-15T12:27:28.503 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosList.EnumerateObjectsSplit (595 ms) 2024-09-15T12:27:29.510 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from LibRadosList (5447 ms total) 2024-09-15T12:27:29.510 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:29.510 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 3 tests from LibRadosListEC 2024-09-15T12:27:29.511 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:70: Skipped 2024-09-15T12:27:29.511 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:29.511 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosListEC.ListObjects 2024-09-15T12:27:29.511 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:84: Skipped 2024-09-15T12:27:29.511 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:29.511 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:96: Skipped 2024-09-15T12:27:29.511 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:29.511 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosListEC.ListObjects (0 ms) 2024-09-15T12:27:29.511 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosListEC.ListObjectsNS 2024-09-15T12:27:29.511 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:84: Skipped 2024-09-15T12:27:29.511 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:29.511 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:96: Skipped 2024-09-15T12:27:29.511 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:29.512 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS (0 ms) 2024-09-15T12:27:29.512 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosListEC.ListObjectsStart 2024-09-15T12:27:29.512 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:84: Skipped 2024-09-15T12:27:29.512 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:29.512 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:96: Skipped 2024-09-15T12:27:29.512 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:29.512 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart (0 ms) 2024-09-15T12:27:29.512 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:78: Skipped 2024-09-15T12:27:29.512 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:29.512 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 3 tests from LibRadosListEC (1 ms total) 2024-09-15T12:27:29.512 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:29.512 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibRadosListNP 2024-09-15T12:27:29.512 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosListNP.ListObjectsError 2024-09-15T12:27:32.537 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosListNP.ListObjectsError (3027 ms) 2024-09-15T12:27:32.537 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibRadosListNP (3027 ms total) 2024-09-15T12:27:32.537 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:32.537 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:32.537 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 11 tests from 3 test suites ran. (11087 ms total) 2024-09-15T12:27:32.537 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 8 tests. 2024-09-15T12:27:32.537 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 3 tests, listed below: 2024-09-15T12:27:32.538 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosListEC.ListObjects 2024-09-15T12:27:32.538 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS 2024-09-15T12:27:32.538 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart 2024-09-15T12:27:32.541 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:27:32.541 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:27:32.541 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_lock 2024-09-15T12:27:32.562 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:27:32.562 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-15T12:27:32.562 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:32.562 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 8 tests from LibRadosLock 2024-09-15T12:27:34.534 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLock.LockExclusive 2024-09-15T12:27:34.847 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosLock.LockExclusive (314 ms) 2024-09-15T12:27:34.848 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLock.LockShared 2024-09-15T12:27:34.873 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosLock.LockShared (25 ms) 2024-09-15T12:27:34.873 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLock.LockExclusiveDur 2024-09-15T12:27:35.913 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosLock.LockExclusiveDur (1041 ms) 2024-09-15T12:27:35.913 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLock.LockSharedDur 2024-09-15T12:27:36.963 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosLock.LockSharedDur (1049 ms) 2024-09-15T12:27:36.963 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLock.LockMayRenew 2024-09-15T12:27:37.008 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosLock.LockMayRenew (45 ms) 2024-09-15T12:27:37.008 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLock.Unlock 2024-09-15T12:27:37.054 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosLock.Unlock (46 ms) 2024-09-15T12:27:37.054 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLock.ListLockers 2024-09-15T12:27:37.115 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosLock.ListLockers (61 ms) 2024-09-15T12:27:37.115 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLock.BreakLock 2024-09-15T12:27:37.152 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosLock.BreakLock (38 ms) 2024-09-15T12:27:37.558 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 8 tests from LibRadosLock (2619 ms total) 2024-09-15T12:27:37.558 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:37.558 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 8 tests from LibRadosLockEC 2024-09-15T12:27:37.558 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-15T12:27:37.559 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.559 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockEC.LockExclusive 2024-09-15T12:27:37.559 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:37.559 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.559 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:37.559 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.559 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive (0 ms) 2024-09-15T12:27:37.559 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockEC.LockShared 2024-09-15T12:27:37.559 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:37.560 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.560 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:37.560 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.560 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2024-09-15T12:27:37.560 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockEC.LockExclusiveDur 2024-09-15T12:27:37.560 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:37.560 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.560 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:37.561 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.561 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2024-09-15T12:27:37.561 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockEC.LockSharedDur 2024-09-15T12:27:37.561 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:37.561 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.561 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:37.561 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.561 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2024-09-15T12:27:37.561 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockEC.LockMayRenew 2024-09-15T12:27:37.562 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:37.562 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.562 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:37.562 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.562 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2024-09-15T12:27:37.562 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockEC.Unlock 2024-09-15T12:27:37.562 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:37.562 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.562 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:37.563 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.563 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2024-09-15T12:27:37.563 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockEC.ListLockers 2024-09-15T12:27:37.563 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:37.563 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.563 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:37.563 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.563 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2024-09-15T12:27:37.563 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockEC.BreakLock 2024-09-15T12:27:37.563 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:27:37.564 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.564 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:27:37.564 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.564 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2024-09-15T12:27:37.564 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-15T12:27:37.564 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:37.564 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 8 tests from LibRadosLockEC (0 ms total) 2024-09-15T12:27:37.564 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:37.564 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:37.564 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 16 tests from 2 test suites ran. (4996 ms total) 2024-09-15T12:27:37.564 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 8 tests. 2024-09-15T12:27:37.565 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-15T12:27:37.565 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive 2024-09-15T12:27:37.565 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockEC.LockShared 2024-09-15T12:27:37.565 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2024-09-15T12:27:37.565 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur 2024-09-15T12:27:37.565 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew 2024-09-15T12:27:37.565 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockEC.Unlock 2024-09-15T12:27:37.565 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers 2024-09-15T12:27:37.565 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock 2024-09-15T12:27:37.566 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:27:37.566 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:27:37.566 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_lock_pp 2024-09-15T12:27:37.581 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:27:37.581 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-15T12:27:37.581 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:37.582 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 8 tests from LibRadosLockPP 2024-09-15T12:27:37.582 INFO:tasks.workunit.client.0.smithi122.stdout:seed 31552 2024-09-15T12:27:39.568 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockPP.LockExclusivePP 2024-09-15T12:27:39.829 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosLockPP.LockExclusivePP (261 ms) 2024-09-15T12:27:39.829 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockPP.LockSharedPP 2024-09-15T12:27:39.861 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosLockPP.LockSharedPP (33 ms) 2024-09-15T12:27:39.862 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-09-15T12:27:40.904 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosLockPP.LockExclusiveDurPP (1042 ms) 2024-09-15T12:27:40.904 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockPP.LockSharedDurPP 2024-09-15T12:27:41.947 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosLockPP.LockSharedDurPP (1043 ms) 2024-09-15T12:27:41.947 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockPP.LockMayRenewPP 2024-09-15T12:27:41.988 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosLockPP.LockMayRenewPP (42 ms) 2024-09-15T12:27:41.988 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockPP.UnlockPP 2024-09-15T12:27:42.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosLockPP.UnlockPP (46 ms) 2024-09-15T12:27:42.035 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockPP.ListLockersPP 2024-09-15T12:27:42.090 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosLockPP.ListLockersPP (56 ms) 2024-09-15T12:27:42.091 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockPP.BreakLockPP 2024-09-15T12:27:42.125 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosLockPP.BreakLockPP (35 ms) 2024-09-15T12:27:42.586 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 8 tests from LibRadosLockPP (2558 ms total) 2024-09-15T12:27:42.586 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:42.586 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 8 tests from LibRadosLockECPP 2024-09-15T12:27:42.586 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-15T12:27:42.586 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.587 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockECPP.LockExclusivePP 2024-09-15T12:27:42.587 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:42.587 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.587 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:42.587 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.587 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2024-09-15T12:27:42.587 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockECPP.LockSharedPP 2024-09-15T12:27:42.587 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:42.587 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.587 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:42.587 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.588 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2024-09-15T12:27:42.588 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-15T12:27:42.588 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:42.588 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.588 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:42.588 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.588 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2024-09-15T12:27:42.588 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-09-15T12:27:42.588 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:42.588 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.589 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:42.589 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.589 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2024-09-15T12:27:42.589 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-09-15T12:27:42.589 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:42.589 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.589 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:42.589 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.589 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2024-09-15T12:27:42.589 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockECPP.UnlockPP 2024-09-15T12:27:42.589 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:42.589 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.590 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:42.590 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.590 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2024-09-15T12:27:42.590 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockECPP.ListLockersPP 2024-09-15T12:27:42.590 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:42.590 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.590 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:42.590 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.590 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2024-09-15T12:27:42.590 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosLockECPP.BreakLockPP 2024-09-15T12:27:42.591 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:27:42.591 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.591 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:27:42.591 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.591 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2024-09-15T12:27:42.591 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-15T12:27:42.591 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:27:42.591 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 8 tests from LibRadosLockECPP (0 ms total) 2024-09-15T12:27:42.591 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:42.591 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:27:42.592 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 16 tests from 2 test suites ran. (5004 ms total) 2024-09-15T12:27:42.592 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 8 tests. 2024-09-15T12:27:42.592 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-15T12:27:42.592 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2024-09-15T12:27:42.592 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP 2024-09-15T12:27:42.592 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-15T12:27:42.592 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2024-09-15T12:27:42.592 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2024-09-15T12:27:42.592 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP 2024-09-15T12:27:42.592 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP 2024-09-15T12:27:42.592 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP 2024-09-15T12:27:42.593 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:27:42.593 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:27:42.593 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_misc 2024-09-15T12:27:42.630 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 12 tests from 4 test suites. 2024-09-15T12:27:42.631 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:27:42.631 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-15T12:27:42.631 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscVersion.Version 2024-09-15T12:27:42.631 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscVersion.Version (0 ms) 2024-09-15T12:27:42.631 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-15T12:27:42.631 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:42.631 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from LibRadosMiscConnectFailure 2024-09-15T12:27:42.631 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-09-15T12:27:42.636 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:42.627+0000 7fb3744dd6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:42.636 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:42.627+0000 7fb3744dd6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:42.636 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:42.628+0000 7fb3744dd6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:42.699 INFO:tasks.workunit.client.0.smithi122.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2024-09-15T12:27:42.699 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:42.697+0000 7fb3744dd6c0 -1 failed for service _ceph-mon._tcp 2024-09-15T12:27:42.699 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:27:42.697+0000 7fb3744dd6c0 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-09-15T12:27:42.699 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectFailure (69 ms) 2024-09-15T12:27:42.700 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-09-15T12:27:47.707 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5008 ms) 2024-09-15T12:27:47.707 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from LibRadosMiscConnectFailure (5077 ms total) 2024-09-15T12:27:47.707 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:47.707 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibRadosMiscPool 2024-09-15T12:27:47.708 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPool.PoolCreationRace 2024-09-15T12:27:50.591 INFO:tasks.workunit.client.0.smithi122.stdout:started 0x7fb33c005de0 2024-09-15T12:27:51.591 INFO:tasks.workunit.client.0.smithi122.stdout:started 0x7fb354005d20 2024-09-15T12:27:51.591 INFO:tasks.workunit.client.0.smithi122.stdout: started 2 aios 2024-09-15T12:27:51.591 INFO:tasks.workunit.client.0.smithi122.stdout:waiting 0x7fb33c005de0 2024-09-15T12:27:51.591 INFO:tasks.workunit.client.0.smithi122.stdout:waiting 0x7fb354005d20 2024-09-15T12:27:51.594 INFO:tasks.workunit.client.0.smithi122.stdout:done. 2024-09-15T12:27:52.611 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPool.PoolCreationRace (4904 ms) 2024-09-15T12:27:52.611 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibRadosMiscPool (4904 ms total) 2024-09-15T12:27:52.611 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:27:52.611 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 8 tests from LibRadosMisc 2024-09-15T12:27:53.980 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMisc.ClusterFSID 2024-09-15T12:27:53.980 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-09-15T12:27:53.980 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMisc.Exec 2024-09-15T12:27:54.279 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMisc.Exec (299 ms) 2024-09-15T12:27:54.279 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMisc.WriteSame 2024-09-15T12:27:54.325 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMisc.WriteSame (46 ms) 2024-09-15T12:27:54.325 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMisc.CmpExt 2024-09-15T12:27:54.350 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMisc.CmpExt (26 ms) 2024-09-15T12:27:54.351 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMisc.Applications 2024-09-15T12:27:59.003 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMisc.Applications (4652 ms) 2024-09-15T12:27:59.003 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMisc.MinCompatOSD 2024-09-15T12:27:59.003 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-09-15T12:27:59.003 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMisc.MinCompatClient 2024-09-15T12:27:59.003 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-09-15T12:27:59.004 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMisc.ShutdownRace 2024-09-15T12:28:25.428 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMisc.ShutdownRace (26425 ms) 2024-09-15T12:28:25.528 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 8 tests from LibRadosMisc (31448 ms total) 2024-09-15T12:28:25.528 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:28:25.529 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:28:25.529 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 12 tests from 4 test suites ran. (42899 ms total) 2024-09-15T12:28:25.529 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 12 tests. 2024-09-15T12:28:25.543 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:28:25.544 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:28:25.544 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_misc_pp 2024-09-15T12:28:25.595 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:28:25.594+0000 7f51d182e840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:25.596 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:28:25.594+0000 7f51d182e840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:25.596 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:28:25.594+0000 7f51d182e840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:25.596 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 31 tests from 7 test suites. 2024-09-15T12:28:25.597 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:28:25.597 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-15T12:28:25.597 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscVersion.VersionPP 2024-09-15T12:28:25.597 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-09-15T12:28:25.597 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-15T12:28:25.597 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:28:25.597 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 22 tests from LibRadosMiscPP 2024-09-15T12:28:25.597 INFO:tasks.workunit.client.0.smithi122.stdout:seed 93218 2024-09-15T12:28:27.533 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-09-15T12:28:27.533 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2024-09-15T12:28:27.533 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.LongNamePP 2024-09-15T12:28:27.957 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.LongNamePP (424 ms) 2024-09-15T12:28:27.957 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.LongLocatorPP 2024-09-15T12:28:27.957 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:53: Skipped 2024-09-15T12:28:27.957 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:28:27.958 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP (0 ms) 2024-09-15T12:28:27.958 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.LongNSpacePP 2024-09-15T12:28:28.045 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.LongNSpacePP (88 ms) 2024-09-15T12:28:28.045 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-09-15T12:28:28.099 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.LongAttrNamePP (55 ms) 2024-09-15T12:28:28.099 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.ExecPP 2024-09-15T12:28:28.116 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.ExecPP (16 ms) 2024-09-15T12:28:28.116 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.BadFlagsPP 2024-09-15T12:28:28.132 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.BadFlagsPP (17 ms) 2024-09-15T12:28:28.132 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.Operate1PP 2024-09-15T12:28:28.163 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.Operate1PP (31 ms) 2024-09-15T12:28:28.163 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.Operate2PP 2024-09-15T12:28:28.183 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.Operate2PP (20 ms) 2024-09-15T12:28:28.183 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.BigObjectPP 2024-09-15T12:28:28.232 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.BigObjectPP (48 ms) 2024-09-15T12:28:28.232 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.AioOperatePP 2024-09-15T12:28:28.249 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.AioOperatePP (17 ms) 2024-09-15T12:28:28.249 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.AssertExistsPP 2024-09-15T12:28:28.275 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.AssertExistsPP (26 ms) 2024-09-15T12:28:28.275 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.AssertVersionPP 2024-09-15T12:28:28.327 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.AssertVersionPP (53 ms) 2024-09-15T12:28:28.327 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.BigAttrPP 2024-09-15T12:28:28.339 INFO:tasks.workunit.client.0.smithi122.stdout:osd_max_attr_size = 0 2024-09-15T12:28:28.340 INFO:tasks.workunit.client.0.smithi122.stdout:osd_max_attr_size == 0; skipping test 2024-09-15T12:28:47.118 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.BigAttrPP (18790 ms) 2024-09-15T12:28:47.118 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.CopyPP 2024-09-15T12:28:47.119 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:387: Skipped 2024-09-15T12:28:47.119 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:28:47.119 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP (0 ms) 2024-09-15T12:28:47.119 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.CopyScrubPP 2024-09-15T12:28:47.119 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:550: Skipped 2024-09-15T12:28:47.119 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:28:47.119 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2024-09-15T12:28:47.119 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.WriteSamePP 2024-09-15T12:28:47.158 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.WriteSamePP (40 ms) 2024-09-15T12:28:47.158 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.CmpExtPP 2024-09-15T12:28:47.185 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.CmpExtPP (27 ms) 2024-09-15T12:28:47.185 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.Applications 2024-09-15T12:28:52.002 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.Applications (4817 ms) 2024-09-15T12:28:52.003 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.MinCompatOSD 2024-09-15T12:28:52.003 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.MinCompatOSD (1 ms) 2024-09-15T12:28:52.003 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.MinCompatClient 2024-09-15T12:28:52.003 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-09-15T12:28:52.003 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscPP.Conf 2024-09-15T12:28:52.003 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosMiscPP.Conf (0 ms) 2024-09-15T12:28:52.994 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 22 tests from LibRadosMiscPP (24470 ms total) 2024-09-15T12:28:52.994 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:28:52.994 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibRadosTwoPoolsECPP 2024-09-15T12:28:52.994 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:477: Skipped 2024-09-15T12:28:52.994 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:28:52.994 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-15T12:28:52.994 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:499: Skipped 2024-09-15T12:28:52.994 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:28:52.994 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:505: Skipped 2024-09-15T12:28:52.994 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:28:52.995 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (0 ms) 2024-09-15T12:28:52.995 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:492: Skipped 2024-09-15T12:28:52.995 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:28:52.995 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibRadosTwoPoolsECPP (0 ms total) 2024-09-15T12:28:52.995 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:28:52.995 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-09-15T12:28:55.026 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosChecksum/0.Subset 2024-09-15T12:28:55.336 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosChecksum/0.Subset (310 ms) 2024-09-15T12:28:55.336 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosChecksum/0.Chunked 2024-09-15T12:28:55.359 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosChecksum/0.Chunked (23 ms) 2024-09-15T12:28:56.026 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from LibRadosChecksum/0 (333 ms total) 2024-09-15T12:28:56.026 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:28:56.026 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-09-15T12:28:58.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosChecksum/1.Subset 2024-09-15T12:28:58.331 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosChecksum/1.Subset (297 ms) 2024-09-15T12:28:58.331 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosChecksum/1.Chunked 2024-09-15T12:28:58.354 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosChecksum/1.Chunked (23 ms) 2024-09-15T12:28:59.044 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from LibRadosChecksum/1 (320 ms total) 2024-09-15T12:28:59.045 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:28:59.045 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-09-15T12:29:01.052 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosChecksum/2.Subset 2024-09-15T12:29:01.326 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosChecksum/2.Subset (275 ms) 2024-09-15T12:29:01.326 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosChecksum/2.Chunked 2024-09-15T12:29:01.378 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosChecksum/2.Chunked (51 ms) 2024-09-15T12:29:02.054 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from LibRadosChecksum/2 (326 ms total) 2024-09-15T12:29:02.054 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:29:02.054 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibRadosMiscECPP 2024-09-15T12:29:02.054 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-15T12:29:02.054 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:02.054 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-09-15T12:29:02.055 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:29:02.055 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:02.055 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:29:02.055 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:02.055 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (0 ms) 2024-09-15T12:29:02.055 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-15T12:29:02.055 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:02.055 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibRadosMiscECPP (0 ms total) 2024-09-15T12:29:02.055 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:29:02.055 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:29:02.055 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 31 tests from 7 test suites ran. (36458 ms total) 2024-09-15T12:29:02.055 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 26 tests. 2024-09-15T12:29:02.055 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 5 tests, listed below: 2024-09-15T12:29:02.056 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP 2024-09-15T12:29:02.056 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP 2024-09-15T12:29:02.056 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2024-09-15T12:29:02.056 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-15T12:29:02.056 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2024-09-15T12:29:02.057 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:29:02.057 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:29:02.057 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_tier_pp 2024-09-15T12:29:02.098 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:29:02.096+0000 7f1889ed89c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:02.101 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 77 tests from 4 test suites. 2024-09-15T12:29:02.101 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:29:02.101 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 3 tests from LibRadosTierPP 2024-09-15T12:29:02.101 INFO:tasks.workunit.client.0.smithi122.stdout:seed 93291 2024-09-15T12:29:02.102 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:29:02.096+0000 7f1889ed89c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:02.102 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:29:02.097+0000 7f1889ed89c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:03.993 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTierPP.Dirty 2024-09-15T12:29:03.994 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:287: Skipped 2024-09-15T12:29:03.994 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:03.994 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2024-09-15T12:29:03.994 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTierPP.FlushWriteRaces 2024-09-15T12:29:03.994 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:2182: Skipped 2024-09-15T12:29:03.994 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:03.994 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2024-09-15T12:29:03.994 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTierPP.HitSetNone 2024-09-15T12:29:03.994 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:2561: Skipped 2024-09-15T12:29:03.994 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:03.994 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2024-09-15T12:29:04.999 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 3 tests from LibRadosTierPP (0 ms total) 2024-09-15T12:29:04.999 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:29:04.999 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 48 tests from LibRadosTwoPoolsPP 2024-09-15T12:29:07.025 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.Overlay 2024-09-15T12:29:07.025 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.025 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.025 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.025 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.025 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2024-09-15T12:29:07.025 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.Promote 2024-09-15T12:29:07.025 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.026 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.026 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.026 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.026 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote (1 ms) 2024-09-15T12:29:07.026 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-15T12:29:07.026 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.026 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.026 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.026 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.026 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2024-09-15T12:29:07.026 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-15T12:29:07.026 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.026 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.026 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.026 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.027 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2024-09-15T12:29:07.027 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-15T12:29:07.027 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.027 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.027 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.027 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.027 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2024-09-15T12:29:07.027 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-09-15T12:29:07.027 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.027 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.027 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.027 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.027 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2024-09-15T12:29:07.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-15T12:29:07.028 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.028 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.028 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.028 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2024-09-15T12:29:07.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.Evict 2024-09-15T12:29:07.028 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.028 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.028 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.028 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2024-09-15T12:29:07.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-09-15T12:29:07.029 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.029 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.029 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.029 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2024-09-15T12:29:07.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-15T12:29:07.029 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.029 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.029 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.029 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2024-09-15T12:29:07.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-09-15T12:29:07.029 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.029 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.029 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.030 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2024-09-15T12:29:07.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-15T12:29:07.030 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.030 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.030 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.030 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2024-09-15T12:29:07.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-09-15T12:29:07.030 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.030 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.030 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.030 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2024-09-15T12:29:07.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.Flush 2024-09-15T12:29:07.031 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.031 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.031 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.031 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2024-09-15T12:29:07.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-09-15T12:29:07.031 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.031 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.031 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.031 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2024-09-15T12:29:07.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-15T12:29:07.031 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.032 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.032 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.032 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2024-09-15T12:29:07.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-15T12:29:07.032 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.032 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.032 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.032 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2024-09-15T12:29:07.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-09-15T12:29:07.032 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.032 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.032 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.032 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2024-09-15T12:29:07.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-15T12:29:07.033 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.033 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.033 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.033 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2024-09-15T12:29:07.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-15T12:29:07.033 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.033 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.033 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.033 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2024-09-15T12:29:07.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-15T12:29:07.034 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.034 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.034 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.034 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2024-09-15T12:29:07.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-09-15T12:29:07.034 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.034 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.034 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.034 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2024-09-15T12:29:07.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.CachePin 2024-09-15T12:29:07.034 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.034 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.034 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.034 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2024-09-15T12:29:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-15T12:29:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2024-09-15T12:29:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-15T12:29:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2024-09-15T12:29:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-15T12:29:07.035 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.036 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.036 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.036 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.036 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2024-09-15T12:29:07.036 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-15T12:29:07.036 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.036 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.036 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.036 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.036 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2024-09-15T12:29:07.036 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-15T12:29:07.036 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.036 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.036 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.037 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.037 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2024-09-15T12:29:07.037 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-15T12:29:07.037 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.037 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.037 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.037 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.037 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2024-09-15T12:29:07.037 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-15T12:29:07.037 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.037 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.037 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.037 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.038 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2024-09-15T12:29:07.038 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-15T12:29:07.038 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.038 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.038 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.038 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.038 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2024-09-15T12:29:07.038 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-15T12:29:07.038 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.038 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.038 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.038 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.038 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2024-09-15T12:29:07.038 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-15T12:29:07.039 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.039 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.039 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.039 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.039 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2024-09-15T12:29:07.039 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-15T12:29:07.039 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.039 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.039 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.039 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.039 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2024-09-15T12:29:07.039 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-15T12:29:07.039 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.039 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.039 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.040 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.040 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2024-09-15T12:29:07.040 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-15T12:29:07.040 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.040 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.040 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.040 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.040 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2024-09-15T12:29:07.040 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-15T12:29:07.040 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.040 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.040 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.040 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.040 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2024-09-15T12:29:07.041 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-15T12:29:07.041 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.041 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.041 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.041 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.041 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2024-09-15T12:29:07.041 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-15T12:29:07.041 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.041 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.041 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.041 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.041 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2024-09-15T12:29:07.041 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-15T12:29:07.041 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.042 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.042 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.042 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.042 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2024-09-15T12:29:07.042 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-15T12:29:07.042 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.042 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.042 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.042 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.042 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2024-09-15T12:29:07.042 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-15T12:29:07.042 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.042 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.042 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.042 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.043 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2024-09-15T12:29:07.043 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-15T12:29:07.043 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.043 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.043 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.043 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.043 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2024-09-15T12:29:07.043 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-15T12:29:07.043 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.043 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.043 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.043 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.043 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2024-09-15T12:29:07.043 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-15T12:29:07.043 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.044 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.044 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.044 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.044 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2024-09-15T12:29:07.044 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-15T12:29:07.044 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.044 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.044 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.044 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.044 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (1 ms) 2024-09-15T12:29:07.044 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-15T12:29:07.044 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.044 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.044 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.045 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.045 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2024-09-15T12:29:07.045 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-15T12:29:07.045 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-15T12:29:07.045 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.045 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-15T12:29:07.045 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:07.045 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2024-09-15T12:29:08.016 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 48 tests from LibRadosTwoPoolsPP (2 ms total) 2024-09-15T12:29:08.016 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:29:08.016 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosTierECPP 2024-09-15T12:29:08.016 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-15T12:29:08.016 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTierECPP.Dirty 2024-09-15T12:29:08.017 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:29:08.017 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.017 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:29:08.017 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2024-09-15T12:29:08.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-09-15T12:29:08.017 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:29:08.017 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.017 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:29:08.017 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2024-09-15T12:29:08.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTierECPP.CallForcesPromote 2024-09-15T12:29:08.017 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:29:08.018 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.018 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:29:08.018 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.018 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2024-09-15T12:29:08.018 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTierECPP.HitSetNone 2024-09-15T12:29:08.018 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:29:08.018 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.018 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:29:08.018 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.018 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2024-09-15T12:29:08.018 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-15T12:29:08.018 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.018 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosTierECPP (0 ms total) 2024-09-15T12:29:08.018 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:29:08.018 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP 2024-09-15T12:29:08.019 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6267: Skipped 2024-09-15T12:29:08.019 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.019 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-09-15T12:29:08.019 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.019 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.019 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.019 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.019 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2024-09-15T12:29:08.019 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.Promote 2024-09-15T12:29:08.019 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.019 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.019 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.019 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.019 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2024-09-15T12:29:08.020 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-15T12:29:08.020 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.020 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.020 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.020 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.020 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2024-09-15T12:29:08.020 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-15T12:29:08.020 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.020 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.020 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.020 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.020 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2024-09-15T12:29:08.020 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-09-15T12:29:08.020 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.021 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.021 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.021 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.021 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2024-09-15T12:29:08.021 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.Evict 2024-09-15T12:29:08.021 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.021 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.021 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.021 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.021 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2024-09-15T12:29:08.021 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-15T12:29:08.021 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.021 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.022 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.022 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.022 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2024-09-15T12:29:08.022 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-09-15T12:29:08.022 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.022 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.022 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.022 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.022 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2024-09-15T12:29:08.022 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-15T12:29:08.022 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.022 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.022 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.022 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2024-09-15T12:29:08.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.Flush 2024-09-15T12:29:08.023 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.023 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.023 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.023 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2024-09-15T12:29:08.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-15T12:29:08.023 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.023 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.023 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.023 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2024-09-15T12:29:08.023 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-15T12:29:08.023 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.024 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.024 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.024 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.024 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2024-09-15T12:29:08.024 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-15T12:29:08.024 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.024 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.024 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.024 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.024 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2024-09-15T12:29:08.024 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-15T12:29:08.024 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.024 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.024 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.024 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.025 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2024-09-15T12:29:08.025 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-15T12:29:08.025 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.025 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.025 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.025 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.025 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (1 ms) 2024-09-15T12:29:08.025 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-15T12:29:08.025 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.025 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.025 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.025 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.025 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2024-09-15T12:29:08.025 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-15T12:29:08.026 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.026 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.026 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.026 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.026 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2024-09-15T12:29:08.026 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-09-15T12:29:08.026 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.026 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.026 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.026 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.026 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2024-09-15T12:29:08.026 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-15T12:29:08.026 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.027 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.027 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.027 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.027 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2024-09-15T12:29:08.027 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-15T12:29:08.027 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.027 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.027 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.027 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.027 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2024-09-15T12:29:08.027 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-15T12:29:08.027 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.027 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.027 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.028 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2024-09-15T12:29:08.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-15T12:29:08.028 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-15T12:29:08.028 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.028 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-15T12:29:08.028 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2024-09-15T12:29:08.028 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6272: Skipped 2024-09-15T12:29:08.028 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:08.028 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP (1 ms total) 2024-09-15T12:29:08.028 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:29:08.028 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:29:08.028 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 77 tests from 4 test suites ran. (5913 ms total) 2024-09-15T12:29:08.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 0 tests. 2024-09-15T12:29:08.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 77 tests, listed below: 2024-09-15T12:29:08.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTierPP.Dirty 2024-09-15T12:29:08.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2024-09-15T12:29:08.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone 2024-09-15T12:29:08.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2024-09-15T12:29:08.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote 2024-09-15T12:29:08.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-15T12:29:08.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-15T12:29:08.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-15T12:29:08.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2024-09-15T12:29:08.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-15T12:29:08.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict 2024-09-15T12:29:08.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2024-09-15T12:29:08.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-15T12:29:08.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2024-09-15T12:29:08.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-15T12:29:08.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2024-09-15T12:29:08.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush 2024-09-15T12:29:08.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2024-09-15T12:29:08.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-15T12:29:08.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-15T12:29:08.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2024-09-15T12:29:08.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-15T12:29:08.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-15T12:29:08.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-15T12:29:08.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2024-09-15T12:29:08.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2024-09-15T12:29:08.030 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-15T12:29:08.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-15T12:29:08.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-15T12:29:08.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-15T12:29:08.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-15T12:29:08.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-15T12:29:08.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-15T12:29:08.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-15T12:29:08.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-15T12:29:08.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-15T12:29:08.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-15T12:29:08.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-15T12:29:08.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-15T12:29:08.031 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-15T12:29:08.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-15T12:29:08.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-15T12:29:08.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-15T12:29:08.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-15T12:29:08.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-15T12:29:08.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-15T12:29:08.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-15T12:29:08.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-15T12:29:08.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-15T12:29:08.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-15T12:29:08.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-15T12:29:08.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty 2024-09-15T12:29:08.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2024-09-15T12:29:08.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2024-09-15T12:29:08.032 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone 2024-09-15T12:29:08.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2024-09-15T12:29:08.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2024-09-15T12:29:08.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-15T12:29:08.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-15T12:29:08.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2024-09-15T12:29:08.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2024-09-15T12:29:08.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-15T12:29:08.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2024-09-15T12:29:08.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-15T12:29:08.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2024-09-15T12:29:08.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-15T12:29:08.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-15T12:29:08.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-15T12:29:08.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-15T12:29:08.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-15T12:29:08.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-15T12:29:08.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-15T12:29:08.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2024-09-15T12:29:08.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-15T12:29:08.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-15T12:29:08.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-15T12:29:08.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-15T12:29:08.034 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:29:08.034 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:29:08.034 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_pool 2024-09-15T12:29:08.036 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:29:08.036 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-15T12:29:08.036 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:29:08.036 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 9 tests from LibRadosPools 2024-09-15T12:29:08.036 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosPools.PoolList 2024-09-15T12:29:11.033 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosPools.PoolList (2998 ms) 2024-09-15T12:29:11.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosPools.PoolLookup 2024-09-15T12:29:13.994 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosPools.PoolLookup (2961 ms) 2024-09-15T12:29:13.995 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosPools.PoolLookup2 2024-09-15T12:29:17.008 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosPools.PoolLookup2 (3013 ms) 2024-09-15T12:29:17.009 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-09-15T12:29:20.021 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosPools.PoolLookupOtherInstance (3013 ms) 2024-09-15T12:29:20.021 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-09-15T12:29:22.997 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosPools.PoolReverseLookupOtherInstance (2977 ms) 2024-09-15T12:29:22.997 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosPools.PoolDelete 2024-09-15T12:29:28.052 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosPools.PoolDelete (5055 ms) 2024-09-15T12:29:28.053 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosPools.PoolCreateDelete 2024-09-15T12:29:33.002 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosPools.PoolCreateDelete (4949 ms) 2024-09-15T12:29:33.002 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-09-15T12:29:38.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosPools.PoolCreateWithCrushRule (5014 ms) 2024-09-15T12:29:38.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosPools.PoolGetBaseTier 2024-09-15T12:29:38.016 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/pool.cc:139: Skipped 2024-09-15T12:29:38.016 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:29:38.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2024-09-15T12:29:38.017 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 9 tests from LibRadosPools (29980 ms total) 2024-09-15T12:29:38.017 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:29:38.017 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:29:38.017 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 9 tests from 1 test suite ran. (29980 ms total) 2024-09-15T12:29:38.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 8 tests. 2024-09-15T12:29:38.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-15T12:29:38.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier 2024-09-15T12:29:38.019 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:29:38.019 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:29:38.019 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_snapshots 2024-09-15T12:29:38.041 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:29:38.041 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 13 tests from 4 test suites. 2024-09-15T12:29:38.041 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:29:38.041 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosSnapshots 2024-09-15T12:29:40.028 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshots.SnapList 2024-09-15T12:29:42.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshots.SnapList (2006 ms) 2024-09-15T12:29:42.034 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshots.SnapRemove 2024-09-15T12:29:44.002 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshots.SnapRemove (1968 ms) 2024-09-15T12:29:44.002 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshots.Rollback 2024-09-15T12:29:46.010 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshots.Rollback (2008 ms) 2024-09-15T12:29:46.010 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshots.SnapGetName 2024-09-15T12:29:48.018 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshots.SnapGetName (2008 ms) 2024-09-15T12:29:49.018 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosSnapshots (7990 ms total) 2024-09-15T12:29:49.018 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:29:49.018 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-09-15T12:29:51.035 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-09-15T12:29:55.113 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Snap (4078 ms) 2024-09-15T12:29:55.113 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-09-15T12:29:59.135 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Rollback (4022 ms) 2024-09-15T12:29:59.135 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-09-15T12:30:04.062 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (4927 ms) 2024-09-15T12:30:05.012 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged (13027 ms total) 2024-09-15T12:30:05.012 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:30:05.012 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosSnapshotsEC 2024-09-15T12:30:05.012 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-15T12:30:05.012 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:30:05.013 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsEC.SnapList 2024-09-15T12:30:05.013 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:30:05.013 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:30:05.013 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:30:05.013 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:30:05.013 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList (0 ms) 2024-09-15T12:30:05.013 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-09-15T12:30:05.013 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:30:05.013 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:30:05.013 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:30:05.013 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:30:05.013 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2024-09-15T12:30:05.013 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsEC.Rollback 2024-09-15T12:30:05.013 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:30:05.014 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:30:05.014 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:30:05.014 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:30:05.014 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2024-09-15T12:30:05.014 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-09-15T12:30:05.014 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:30:05.014 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:30:05.014 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:30:05.014 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:30:05.014 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2024-09-15T12:30:05.014 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-15T12:30:05.014 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:30:05.014 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosSnapshotsEC (0 ms total) 2024-09-15T12:30:05.015 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:30:05.015 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-09-15T12:30:05.015 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-15T12:30:05.015 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:30:05.015 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-15T12:30:05.015 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:30:05.015 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:30:05.015 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:30:05.015 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:30:05.015 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2024-09-15T12:30:05.015 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-15T12:30:05.015 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:30:05.015 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:30:05.015 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:30:05.015 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:30:05.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2024-09-15T12:30:05.016 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-15T12:30:05.016 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:30:05.016 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2024-09-15T12:30:05.016 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:30:05.016 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:30:05.016 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 13 tests from 4 test suites ran. (26971 ms total) 2024-09-15T12:30:05.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 7 tests. 2024-09-15T12:30:05.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 6 tests, listed below: 2024-09-15T12:30:05.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList 2024-09-15T12:30:05.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2024-09-15T12:30:05.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback 2024-09-15T12:30:05.016 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2024-09-15T12:30:05.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-15T12:30:05.017 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-15T12:30:05.017 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:30:05.017 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:30:05.017 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_snapshots_pp 2024-09-15T12:30:05.039 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:30:05.039 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 21 tests from 5 test suites. 2024-09-15T12:30:05.039 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:30:05.039 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 5 tests from LibRadosSnapshotsPP 2024-09-15T12:30:05.039 INFO:tasks.workunit.client.0.smithi122.stdout:seed 93547 2024-09-15T12:30:07.019 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-09-15T12:30:09.025 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshotsPP.SnapListPP (2006 ms) 2024-09-15T12:30:09.026 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-09-15T12:30:11.043 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshotsPP.SnapRemovePP (2018 ms) 2024-09-15T12:30:11.044 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-09-15T12:30:13.008 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshotsPP.RollbackPP (1964 ms) 2024-09-15T12:30:13.008 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-09-15T12:30:15.068 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2060 ms) 2024-09-15T12:30:15.068 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-09-15T12:30:19.091 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4023 ms) 2024-09-15T12:30:20.093 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 5 tests from LibRadosSnapshotsPP (12072 ms total) 2024-09-15T12:30:20.093 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:30:20.093 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-09-15T12:30:22.102 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-09-15T12:30:26.076 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (3974 ms) 2024-09-15T12:30:26.076 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-09-15T12:30:30.047 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3971 ms) 2024-09-15T12:30:30.047 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-09-15T12:30:36.067 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6020 ms) 2024-09-15T12:30:36.067 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-09-15T12:30:40.086 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4019 ms) 2024-09-15T12:30:40.087 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-09-15T12:30:42.160 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2074 ms) 2024-09-15T12:30:42.161 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-15T12:30:42.161 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/snapshots_cxx.cc:460: Skipped 2024-09-15T12:30:42.161 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:30:42.161 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-09-15T12:30:42.161 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-09-15T12:30:44.015 INFO:tasks.workunit.client.0.smithi122.stdout:deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi122-93547-7 2024-09-15T12:30:45.021 INFO:tasks.workunit.client.0.smithi122.stdout:waiting for snaps to purge 2024-09-15T12:31:00.040 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17880 ms) 2024-09-15T12:31:01.039 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP (37938 ms total) 2024-09-15T12:31:01.039 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:31:01.040 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-09-15T12:31:01.040 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-09-15T12:31:01.050 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (12 ms) 2024-09-15T12:31:01.050 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-09-15T12:31:06.103 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5051 ms) 2024-09-15T12:31:06.103 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5063 ms total) 2024-09-15T12:31:06.103 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:31:06.104 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosSnapshotsECPP 2024-09-15T12:31:06.104 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-15T12:31:06.104 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.104 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-09-15T12:31:06.104 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:31:06.104 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.104 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:31:06.104 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.104 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2024-09-15T12:31:06.104 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-15T12:31:06.104 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:31:06.104 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.104 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:31:06.105 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.105 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2024-09-15T12:31:06.105 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-09-15T12:31:06.105 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:31:06.105 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.105 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:31:06.105 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.105 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2024-09-15T12:31:06.105 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-15T12:31:06.105 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:31:06.105 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.105 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:31:06.105 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.106 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2024-09-15T12:31:06.106 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-15T12:31:06.106 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.106 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2024-09-15T12:31:06.106 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:31:06.106 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-09-15T12:31:06.106 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-15T12:31:06.106 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.106 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-15T12:31:06.106 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:31:06.106 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.106 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:31:06.106 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.106 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2024-09-15T12:31:06.107 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-15T12:31:06.107 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:31:06.107 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.107 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:31:06.107 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.107 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2024-09-15T12:31:06.107 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-15T12:31:06.107 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:31:06.107 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.107 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:31:06.107 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.107 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2024-09-15T12:31:06.107 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-15T12:31:06.107 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:06.108 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2024-09-15T12:31:06.108 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:31:06.108 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:31:06.108 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 21 tests from 5 test suites ran. (61063 ms total) 2024-09-15T12:31:06.108 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 13 tests. 2024-09-15T12:31:06.108 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-15T12:31:06.108 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-15T12:31:06.108 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2024-09-15T12:31:06.108 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-15T12:31:06.108 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2024-09-15T12:31:06.108 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-15T12:31:06.108 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-15T12:31:06.108 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-15T12:31:06.108 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-15T12:31:06.109 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:31:06.109 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:31:06.109 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_stat 2024-09-15T12:31:06.134 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:31:06.134 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-15T12:31:06.134 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:31:06.134 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 5 tests from LibRadosStat 2024-09-15T12:31:08.018 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStat.Stat 2024-09-15T12:31:08.344 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosStat.Stat (326 ms) 2024-09-15T12:31:08.344 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStat.Stat2 2024-09-15T12:31:08.377 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosStat.Stat2 (33 ms) 2024-09-15T12:31:08.377 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStat.StatNS 2024-09-15T12:31:08.443 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosStat.StatNS (66 ms) 2024-09-15T12:31:08.443 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStat.ClusterStat 2024-09-15T12:31:08.443 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosStat.ClusterStat (0 ms) 2024-09-15T12:31:08.443 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStat.PoolStat 2024-09-15T12:31:08.456 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosStat.PoolStat (13 ms) 2024-09-15T12:31:09.074 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 5 tests from LibRadosStat (438 ms total) 2024-09-15T12:31:09.074 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:31:09.075 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosStatEC 2024-09-15T12:31:09.075 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-15T12:31:09.075 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:09.075 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStatEC.Stat 2024-09-15T12:31:09.075 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:31:09.075 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:09.075 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:31:09.075 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:09.075 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2024-09-15T12:31:09.075 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStatEC.StatNS 2024-09-15T12:31:09.075 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:31:09.075 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:09.076 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:31:09.076 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:09.076 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2024-09-15T12:31:09.076 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStatEC.ClusterStat 2024-09-15T12:31:09.076 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:31:09.076 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:09.076 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:31:09.076 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:09.076 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2024-09-15T12:31:09.076 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStatEC.PoolStat 2024-09-15T12:31:09.076 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:31:09.076 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:09.077 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:31:09.077 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:09.077 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2024-09-15T12:31:09.077 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-15T12:31:09.077 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:09.077 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosStatEC (0 ms total) 2024-09-15T12:31:09.077 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:31:09.077 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:31:09.077 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 9 tests from 2 test suites ran. (2940 ms total) 2024-09-15T12:31:09.077 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 5 tests. 2024-09-15T12:31:09.077 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-15T12:31:09.077 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosStatEC.Stat 2024-09-15T12:31:09.077 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosStatEC.StatNS 2024-09-15T12:31:09.078 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat 2024-09-15T12:31:09.078 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat 2024-09-15T12:31:09.078 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:31:09.078 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:31:09.078 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_stat_pp 2024-09-15T12:31:09.096 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:31:09.096 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-15T12:31:09.096 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:31:09.096 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 5 tests from LibRadosStatPP 2024-09-15T12:31:09.097 INFO:tasks.workunit.client.0.smithi122.stdout:seed 93684 2024-09-15T12:31:11.085 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStatPP.StatPP 2024-09-15T12:31:11.387 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosStatPP.StatPP (303 ms) 2024-09-15T12:31:11.388 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-09-15T12:31:11.416 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosStatPP.Stat2Mtime2PP (28 ms) 2024-09-15T12:31:11.416 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStatPP.ClusterStatPP 2024-09-15T12:31:11.417 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosStatPP.ClusterStatPP (1 ms) 2024-09-15T12:31:11.417 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStatPP.PoolStatPP 2024-09-15T12:31:11.430 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosStatPP.PoolStatPP (13 ms) 2024-09-15T12:31:11.430 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStatPP.StatPPNS 2024-09-15T12:31:11.492 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosStatPP.StatPPNS (62 ms) 2024-09-15T12:31:12.087 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 5 tests from LibRadosStatPP (407 ms total) 2024-09-15T12:31:12.087 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:31:12.087 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosStatECPP 2024-09-15T12:31:12.087 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-15T12:31:12.087 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:12.088 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStatECPP.StatPP 2024-09-15T12:31:12.088 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:31:12.088 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:12.088 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:31:12.088 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:12.088 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2024-09-15T12:31:12.088 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStatECPP.ClusterStatPP 2024-09-15T12:31:12.088 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:31:12.088 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:12.088 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:31:12.088 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:12.088 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-09-15T12:31:12.089 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStatECPP.PoolStatPP 2024-09-15T12:31:12.089 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:31:12.089 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:12.089 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:31:12.089 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:12.089 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2024-09-15T12:31:12.089 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosStatECPP.StatPPNS 2024-09-15T12:31:12.089 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:31:12.089 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:12.089 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:31:12.089 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:12.089 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2024-09-15T12:31:12.089 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-15T12:31:12.090 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:12.090 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosStatECPP (0 ms total) 2024-09-15T12:31:12.090 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:31:12.090 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:31:12.090 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 9 tests from 2 test suites ran. (2990 ms total) 2024-09-15T12:31:12.090 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 5 tests. 2024-09-15T12:31:12.090 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-15T12:31:12.090 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP 2024-09-15T12:31:12.090 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2024-09-15T12:31:12.090 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP 2024-09-15T12:31:12.090 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS 2024-09-15T12:31:12.091 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:31:12.091 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:31:12.091 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_watch_notify 2024-09-15T12:31:12.114 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:31:12.114 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-15T12:31:12.114 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:31:12.114 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 10 tests from LibRadosWatchNotify 2024-09-15T12:31:14.097 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify 2024-09-15T12:31:14.348 INFO:tasks.workunit.client.0.smithi122.stdout:watch_notify_test_cb 2024-09-15T12:31:14.423 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotify.WatchNotify (326 ms) 2024-09-15T12:31:14.423 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotify.Watch2Delete 2024-09-15T12:31:14.466 INFO:tasks.workunit.client.0.smithi122.stdout:waiting up to 300 for disconnect notification ... 2024-09-15T12:31:17.170 INFO:tasks.workunit.client.0.smithi122.stdout:watch_notify2_test_errcb cookie 41091088 err -107 2024-09-15T12:31:17.475 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotify.Watch2Delete (3053 ms) 2024-09-15T12:31:17.476 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-09-15T12:31:17.519 INFO:tasks.workunit.client.0.smithi122.stdout:waiting up to 300 for disconnect notification ... 2024-09-15T12:31:22.171 INFO:tasks.workunit.client.0.smithi122.stdout:watch_notify2_test_errcb cookie 41102752 err -107 2024-09-15T12:31:22.527 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete (5051 ms) 2024-09-15T12:31:22.527 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2 2024-09-15T12:31:22.560 INFO:tasks.workunit.client.0.smithi122.stdout:watch_notify2_test_cb from 15456 notify_id 1726576852992 cookie 41120480 2024-09-15T12:31:22.582 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2 (55 ms) 2024-09-15T12:31:22.582 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-09-15T12:31:22.612 INFO:tasks.workunit.client.0.smithi122.stdout:watch_notify2_test_cb from 15456 notify_id 1726576852993 cookie 41129920 2024-09-15T12:31:22.632 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotify.AioWatchNotify2 (50 ms) 2024-09-15T12:31:22.632 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotify.AioNotify 2024-09-15T12:31:22.665 INFO:tasks.workunit.client.0.smithi122.stdout:watch_notify2_test_cb from 15456 notify_id 1726576852992 cookie 41129920 2024-09-15T12:31:22.691 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotify.AioNotify (59 ms) 2024-09-15T12:31:22.691 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-09-15T12:31:22.733 INFO:tasks.workunit.client.0.smithi122.stdout:watch_notify2_test_cb from 15456 notify_id 1726576852993 cookie 41124688 2024-09-15T12:31:22.733 INFO:tasks.workunit.client.0.smithi122.stdout:watch_notify2_test_cb from 15456 notify_id 1726576852993 cookie 41145744 2024-09-15T12:31:22.764 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Multi (73 ms) 2024-09-15T12:31:22.764 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-09-15T12:31:22.792 INFO:tasks.workunit.client.0.smithi122.stdout:watch_notify2_test_cb from 15456 notify_id 1726576852994 cookie 41145744 2024-09-15T12:31:25.792 INFO:tasks.workunit.client.0.smithi122.stdout:watch_notify2_test_cb from 15456 notify_id 1726576852995 cookie 41145744 2024-09-15T12:31:25.818 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3054 ms) 2024-09-15T12:31:25.818 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-09-15T12:31:25.849 INFO:tasks.workunit.client.0.smithi122.stdout:waiting up to 1024 for osd to time us out ... 2024-09-15T12:31:29.859 INFO:tasks.workunit.client.0.smithi122.stdout:watch_notify2_test_errcb cookie 41145744 err -107 2024-09-15T12:31:30.882 INFO:tasks.workunit.client.0.smithi122.stdout:watch_notify2_test_cb from 15456 notify_id 1726576852994 cookie 41145744 2024-09-15T12:31:30.900 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotify.Watch3Timeout (5082 ms) 2024-09-15T12:31:30.900 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-09-15T12:31:30.939 INFO:tasks.workunit.client.0.smithi122.stdout:waiting up to 30 for disconnect notification ... 2024-09-15T12:31:32.172 INFO:tasks.workunit.client.0.smithi122.stdout:watch_notify2_test_errcb cookie 41145744 err -107 2024-09-15T12:31:32.948 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete2 (2048 ms) 2024-09-15T12:31:33.579 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 10 tests from LibRadosWatchNotify (18851 ms total) 2024-09-15T12:31:33.579 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:31:33.579 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibRadosWatchNotifyEC 2024-09-15T12:31:33.579 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-15T12:31:33.580 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:33.580 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-09-15T12:31:33.580 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-15T12:31:33.580 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:33.580 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-15T12:31:33.580 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:33.580 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2024-09-15T12:31:33.580 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-15T12:31:33.580 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:33.580 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2024-09-15T12:31:33.580 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:31:33.580 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:31:33.580 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 11 tests from 2 test suites ran. (21465 ms total) 2024-09-15T12:31:33.580 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 10 tests. 2024-09-15T12:31:33.581 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-15T12:31:33.581 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2024-09-15T12:31:33.582 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:31:33.582 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:31:33.582 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-09-15T12:31:33.605 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:31:33.605 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-15T12:31:33.605 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:31:33.605 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP 2024-09-15T12:31:33.605 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-15T12:31:33.605 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:33.605 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-15T12:31:33.605 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:31:33.605 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:33.605 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:31:33.605 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:33.606 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2024-09-15T12:31:33.606 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-15T12:31:33.606 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-15T12:31:33.606 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:33.606 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-15T12:31:33.606 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:33.606 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (0 ms) 2024-09-15T12:31:33.606 INFO:tasks.workunit.client.0.smithi122.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-15T12:31:33.606 INFO:tasks.workunit.client.0.smithi122.stdout:Not supported by crimson yet. Skipped 2024-09-15T12:31:33.606 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP (0 ms total) 2024-09-15T12:31:33.606 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:31:33.606 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-09-15T12:31:35.586 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-09-15T12:31:35.911 INFO:tasks.workunit.client.0.smithi122.stdout:notify 2024-09-15T12:31:35.926 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (340 ms) 2024-09-15T12:31:35.926 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-09-15T12:31:35.963 INFO:tasks.workunit.client.0.smithi122.stdout:notify 2024-09-15T12:31:35.978 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (53 ms) 2024-09-15T12:31:35.978 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-09-15T12:31:36.020 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (41 ms) 2024-09-15T12:31:36.020 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-09-15T12:31:36.058 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (38 ms) 2024-09-15T12:31:36.058 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-09-15T12:31:36.092 INFO:tasks.workunit.client.0.smithi122.stdout:handle_notify cookie 38079744 notify_id 1739461754884 notifier_gid 15459 2024-09-15T12:31:36.108 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (50 ms) 2024-09-15T12:31:36.108 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-09-15T12:31:36.143 INFO:tasks.workunit.client.0.smithi122.stdout:handle_notify cookie 38079744 notify_id 1739461754884 notifier_gid 15459 2024-09-15T12:31:36.159 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (51 ms) 2024-09-15T12:31:36.159 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-09-15T12:31:36.193 INFO:tasks.workunit.client.0.smithi122.stdout:handle_notify cookie 38085600 notify_id 1739461754881 notifier_gid 15459 2024-09-15T12:31:36.207 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (48 ms) 2024-09-15T12:31:36.207 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-09-15T12:31:36.246 INFO:tasks.workunit.client.0.smithi122.stdout:handle_notify cookie 38085600 notify_id 1739461754882 notifier_gid 15459 2024-09-15T12:31:36.261 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (54 ms) 2024-09-15T12:31:36.261 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-09-15T12:31:36.296 INFO:tasks.workunit.client.0.smithi122.stdout:handle_notify cookie 38085600 notify_id 1739461754885 notifier_gid 15459 2024-09-15T12:31:36.311 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (50 ms) 2024-09-15T12:31:36.311 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-09-15T12:31:36.344 INFO:tasks.workunit.client.0.smithi122.stdout:handle_notify cookie 38085600 notify_id 1739461754885 notifier_gid 15459 2024-09-15T12:31:36.360 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (49 ms) 2024-09-15T12:31:36.360 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-09-15T12:31:36.390 INFO:tasks.workunit.client.0.smithi122.stdout: trying... 2024-09-15T12:31:36.394 INFO:tasks.workunit.client.0.smithi122.stdout:handle_notify cookie 38085600 notify_id 1739461754886 notifier_gid 15459 2024-09-15T12:31:37.393 INFO:tasks.workunit.client.0.smithi122.stdout: timed out 2024-09-15T12:31:37.405 INFO:tasks.workunit.client.0.smithi122.stdout: flushing 2024-09-15T12:31:39.395 INFO:tasks.workunit.client.0.smithi122.stdout: flushed 2024-09-15T12:31:39.395 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3035 ms) 2024-09-15T12:31:39.395 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-09-15T12:31:39.430 INFO:tasks.workunit.client.0.smithi122.stdout: trying... 2024-09-15T12:31:39.434 INFO:tasks.workunit.client.0.smithi122.stdout:handle_notify cookie 38085600 notify_id 1739461754882 notifier_gid 15459 2024-09-15T12:31:40.432 INFO:tasks.workunit.client.0.smithi122.stdout: timed out 2024-09-15T12:31:40.447 INFO:tasks.workunit.client.0.smithi122.stdout: flushing 2024-09-15T12:31:42.435 INFO:tasks.workunit.client.0.smithi122.stdout: flushed 2024-09-15T12:31:42.435 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3039 ms) 2024-09-15T12:31:42.435 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-09-15T12:31:42.484 INFO:tasks.workunit.client.0.smithi122.stdout:List watches 2024-09-15T12:31:42.484 INFO:tasks.workunit.client.0.smithi122.stdout:notify2 2024-09-15T12:31:42.488 INFO:tasks.workunit.client.0.smithi122.stdout:handle_notify cookie 38101872 notify_id 1739461754883 notifier_gid 15459 2024-09-15T12:31:45.493 INFO:tasks.workunit.client.0.smithi122.stdout:notify2 done 2024-09-15T12:31:45.493 INFO:tasks.workunit.client.0.smithi122.stdout:watch_check 2024-09-15T12:31:45.493 INFO:tasks.workunit.client.0.smithi122.stdout:unwatch2 2024-09-15T12:31:45.506 INFO:tasks.workunit.client.0.smithi122.stdout: flushing 2024-09-15T12:31:45.507 INFO:tasks.workunit.client.0.smithi122.stdout:done 2024-09-15T12:31:45.507 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3072 ms) 2024-09-15T12:31:45.507 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-09-15T12:31:45.540 INFO:tasks.workunit.client.0.smithi122.stdout:List watches 2024-09-15T12:31:45.541 INFO:tasks.workunit.client.0.smithi122.stdout:notify2 2024-09-15T12:31:45.544 INFO:tasks.workunit.client.0.smithi122.stdout:handle_notify cookie 38101872 notify_id 1743756722179 notifier_gid 15459 2024-09-15T12:31:48.550 INFO:tasks.workunit.client.0.smithi122.stdout:notify2 done 2024-09-15T12:31:48.550 INFO:tasks.workunit.client.0.smithi122.stdout:watch_check 2024-09-15T12:31:48.550 INFO:tasks.workunit.client.0.smithi122.stdout:unwatch2 2024-09-15T12:31:48.565 INFO:tasks.workunit.client.0.smithi122.stdout: flushing 2024-09-15T12:31:48.565 INFO:tasks.workunit.client.0.smithi122.stdout:done 2024-09-15T12:31:48.565 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3059 ms) 2024-09-15T12:31:49.038 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (12979 ms total) 2024-09-15T12:31:49.038 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:31:49.038 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:31:49.038 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 16 tests from 2 test suites ran. (15433 ms total) 2024-09-15T12:31:49.038 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 14 tests. 2024-09-15T12:31:49.038 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-15T12:31:49.038 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-15T12:31:49.038 INFO:tasks.workunit.client.0.smithi122.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-15T12:31:49.039 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:31:49.040 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:31:49.040 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_cmd 2024-09-15T12:31:49.061 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:31:49.061 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-15T12:31:49.061 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:31:49.061 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosCmd 2024-09-15T12:31:49.061 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosCmd.MonDescribe 2024-09-15T12:31:49.132 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosCmd.MonDescribe (71 ms) 2024-09-15T12:31:49.132 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosCmd.OSDCmd 2024-09-15T12:31:49.190 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosCmd.OSDCmd (59 ms) 2024-09-15T12:31:49.191 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosCmd.PGCmd 2024-09-15T12:31:52.052 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosCmd.PGCmd (2861 ms) 2024-09-15T12:31:52.052 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosCmd.WatchLog 2024-09-15T12:31:52.083 INFO:tasks.workunit.client.0.smithi122.stdout:got: 2024-09-15T12:31:51.040082+0000 mon.a [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T12:31:53.056 INFO:tasks.workunit.client.0.smithi122.stdout:got: 2024-09-15T12:31:52.082294+0000 client.admin [INF] onexx 2024-09-15T12:31:53.057 INFO:tasks.workunit.client.0.smithi122.stdout:got: 2024-09-15T12:31:52.082485+0000 mon.a [INF] from='client.? 172.21.15.122:0/1458764408' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-15T12:31:54.058 INFO:tasks.workunit.client.0.smithi122.stdout:got: 2024-09-15T12:31:53.055329+0000 mon.a [INF] from='client.? 172.21.15.122:0/1458764408' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-15T12:31:57.063 INFO:tasks.workunit.client.0.smithi122.stdout:got: 2024-09-15T12:31:55.060700+0000 mon.a [INF] from='client.? 172.21.15.122:0/1458764408' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-15T12:31:58.067 INFO:tasks.workunit.client.0.smithi122.stdout:got: 2024-09-15T12:31:57.061353+0000 client.admin [INF] threexx 2024-09-15T12:31:58.067 INFO:tasks.workunit.client.0.smithi122.stdout:got: 2024-09-15T12:31:57.064874+0000 mon.a [INF] from='client.? 172.21.15.122:0/1458764408' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-15T12:31:58.067 INFO:tasks.workunit.client.0.smithi122.stdout:got: 2024-09-15T12:31:58.020522+0000 mon.a [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T12:32:02.074 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosCmd.WatchLog (10022 ms) 2024-09-15T12:32:02.074 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosCmd (13013 ms total) 2024-09-15T12:32:02.074 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:32:02.074 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:32:02.074 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 4 tests from 1 test suite ran. (13013 ms total) 2024-09-15T12:32:02.074 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 4 tests. 2024-09-15T12:32:02.076 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:32:02.076 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:32:02.076 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_cmd_pp 2024-09-15T12:32:02.099 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:32:02.100 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-15T12:32:02.100 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:32:02.100 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 3 tests from LibRadosCmd 2024-09-15T12:32:02.100 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosCmd.MonDescribePP 2024-09-15T12:32:02.132 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosCmd.MonDescribePP (32 ms) 2024-09-15T12:32:02.132 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosCmd.OSDCmdPP 2024-09-15T12:32:02.163 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosCmd.OSDCmdPP (31 ms) 2024-09-15T12:32:02.163 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosCmd.PGCmdPP 2024-09-15T12:32:04.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosCmd.PGCmdPP (1866 ms) 2024-09-15T12:32:04.029 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 3 tests from LibRadosCmd (1929 ms total) 2024-09-15T12:32:04.029 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:32:04.029 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:32:04.029 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 3 tests from 1 test suite ran. (1929 ms total) 2024-09-15T12:32:04.029 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 3 tests. 2024-09-15T12:32:04.031 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:32:04.031 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:32:04.031 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_service 2024-09-15T12:32:04.079 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:32:04.076+0000 7f6c4b335840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:04.080 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:32:04.077+0000 7f6c4b335840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:04.080 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-15T12:32:04.080 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:32:04.080 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosService 2024-09-15T12:32:04.080 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosService.RegisterEarly 2024-09-15T12:32:04.083 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:32:04.077+0000 7f6c4b335840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:09.129 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosService.RegisterEarly (5049 ms) 2024-09-15T12:32:09.129 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosService.RegisterLate 2024-09-15T12:32:09.157 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosService.RegisterLate (28 ms) 2024-09-15T12:32:09.157 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosService.StatusFormat 2024-09-15T12:32:09.333 INFO:tasks.workunit.client.0.smithi122.stdout: cluster: 2024-09-15T12:32:09.333 INFO:tasks.workunit.client.0.smithi122.stdout: id: a718c858-230d-4784-bf30-b6c766b34745 2024-09-15T12:32:09.333 INFO:tasks.workunit.client.0.smithi122.stdout: health: HEALTH_WARN 2024-09-15T12:32:09.333 INFO:tasks.workunit.client.0.smithi122.stdout: 1 pool(s) do not have an application enabled 2024-09-15T12:32:09.334 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:32:09.334 INFO:tasks.workunit.client.0.smithi122.stdout: services: 2024-09-15T12:32:09.334 INFO:tasks.workunit.client.0.smithi122.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-15T12:32:09.334 INFO:tasks.workunit.client.0.smithi122.stdout: mgr: x(active, since 9m) 2024-09-15T12:32:09.334 INFO:tasks.workunit.client.0.smithi122.stdout: osd: 4 osds: 4 up (since 9m), 4 in (since 9m) 2024-09-15T12:32:09.334 INFO:tasks.workunit.client.0.smithi122.stdout: laundry: 1 daemon active (1 hosts) 2024-09-15T12:32:09.334 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:32:09.334 INFO:tasks.workunit.client.0.smithi122.stdout: data: 2024-09-15T12:32:09.334 INFO:tasks.workunit.client.0.smithi122.stdout: pools: 3 pools, 41 pgs 2024-09-15T12:32:09.334 INFO:tasks.workunit.client.0.smithi122.stdout: objects: 5 objects, 577 KiB 2024-09-15T12:32:09.334 INFO:tasks.workunit.client.0.smithi122.stdout: usage: 201 MiB used, 360 GiB / 360 GiB avail 2024-09-15T12:32:09.334 INFO:tasks.workunit.client.0.smithi122.stdout: pgs: 41 active+clean 2024-09-15T12:32:09.334 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:32:09.334 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:32:11.360 INFO:tasks.workunit.client.0.smithi122.stdout: cluster: 2024-09-15T12:32:11.361 INFO:tasks.workunit.client.0.smithi122.stdout: id: a718c858-230d-4784-bf30-b6c766b34745 2024-09-15T12:32:11.361 INFO:tasks.workunit.client.0.smithi122.stdout: health: HEALTH_WARN 2024-09-15T12:32:11.361 INFO:tasks.workunit.client.0.smithi122.stdout: 1 pool(s) do not have an application enabled 2024-09-15T12:32:11.361 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:32:11.361 INFO:tasks.workunit.client.0.smithi122.stdout: services: 2024-09-15T12:32:11.361 INFO:tasks.workunit.client.0.smithi122.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-15T12:32:11.361 INFO:tasks.workunit.client.0.smithi122.stdout: mgr: x(active, since 9m) 2024-09-15T12:32:11.361 INFO:tasks.workunit.client.0.smithi122.stdout: osd: 4 osds: 4 up (since 9m), 4 in (since 10m) 2024-09-15T12:32:11.361 INFO:tasks.workunit.client.0.smithi122.stdout: foo: 16 portals active (1 hosts, 3 zones) 2024-09-15T12:32:11.361 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:32:11.361 INFO:tasks.workunit.client.0.smithi122.stdout: data: 2024-09-15T12:32:11.361 INFO:tasks.workunit.client.0.smithi122.stdout: pools: 3 pools, 41 pgs 2024-09-15T12:32:11.361 INFO:tasks.workunit.client.0.smithi122.stdout: objects: 5 objects, 577 KiB 2024-09-15T12:32:11.361 INFO:tasks.workunit.client.0.smithi122.stdout: usage: 201 MiB used, 360 GiB / 360 GiB avail 2024-09-15T12:32:11.361 INFO:tasks.workunit.client.0.smithi122.stdout: pgs: 41 active+clean 2024-09-15T12:32:11.362 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:32:11.362 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:32:11.385 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosService.StatusFormat (2229 ms) 2024-09-15T12:32:11.385 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosService.Status 2024-09-15T12:32:31.414 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosService.Status (20028 ms) 2024-09-15T12:32:31.415 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosService (27334 ms total) 2024-09-15T12:32:31.415 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:32:31.415 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:32:31.415 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 4 tests from 1 test suite ran. (27334 ms total) 2024-09-15T12:32:31.415 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 4 tests. 2024-09-15T12:32:31.420 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:32:31.420 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:32:31.420 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_service_pp 2024-09-15T12:32:31.456 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:32:31.454+0000 7f20d1ad9840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:31.456 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:32:31.454+0000 7f20d1ad9840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:31.456 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:32:31.454+0000 7f20d1ad9840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:31.456 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-15T12:32:31.457 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:32:31.457 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosServicePP 2024-09-15T12:32:31.457 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosServicePP.RegisterEarly 2024-09-15T12:32:36.483 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosServicePP.RegisterEarly (5028 ms) 2024-09-15T12:32:36.484 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosServicePP.RegisterLate 2024-09-15T12:32:36.528 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosServicePP.RegisterLate (44 ms) 2024-09-15T12:32:36.528 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosServicePP.Status 2024-09-15T12:32:56.557 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosServicePP.Status (20029 ms) 2024-09-15T12:32:56.558 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosServicePP.Close 2024-09-15T12:32:56.558 INFO:tasks.workunit.client.0.smithi122.stdout:attempt 0 of 20 2024-09-15T12:33:01.612 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosServicePP.Close (5055 ms) 2024-09-15T12:33:01.612 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 4 tests from LibRadosServicePP (30156 ms total) 2024-09-15T12:33:01.613 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:33:01.613 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:33:01.613 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 4 tests from 1 test suite ran. (30156 ms total) 2024-09-15T12:33:01.613 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 4 tests. 2024-09-15T12:33:01.615 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:33:01.615 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:33:01.615 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_c_write_operations 2024-09-15T12:33:01.636 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:33:01.636 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 8 tests from 2 test suites. 2024-09-15T12:33:01.636 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:33:01.636 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibradosCWriteOps 2024-09-15T12:33:01.636 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibradosCWriteOps.NewDelete 2024-09-15T12:33:01.637 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-09-15T12:33:01.637 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from LibradosCWriteOps (0 ms total) 2024-09-15T12:33:01.637 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:33:01.637 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from LibRadosCWriteOps 2024-09-15T12:33:01.637 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosCWriteOps.assertExists 2024-09-15T12:33:04.063 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosCWriteOps.assertExists (2427 ms) 2024-09-15T12:33:04.063 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-09-15T12:33:07.084 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3021 ms) 2024-09-15T12:33:07.084 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosCWriteOps.Xattrs 2024-09-15T12:33:10.100 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosCWriteOps.Xattrs (3016 ms) 2024-09-15T12:33:10.100 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosCWriteOps.Write 2024-09-15T12:33:13.128 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosCWriteOps.Write (3028 ms) 2024-09-15T12:33:13.128 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosCWriteOps.Exec 2024-09-15T12:33:16.135 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosCWriteOps.Exec (3007 ms) 2024-09-15T12:33:16.135 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosCWriteOps.WriteSame 2024-09-15T12:33:19.051 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosCWriteOps.WriteSame (2917 ms) 2024-09-15T12:33:19.052 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] LibRadosCWriteOps.CmpExt 2024-09-15T12:33:30.075 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] LibRadosCWriteOps.CmpExt (11023 ms) 2024-09-15T12:33:30.076 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from LibRadosCWriteOps (28439 ms total) 2024-09-15T12:33:30.076 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:33:30.076 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:33:30.076 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 8 tests from 2 test suites ran. (28439 ms total) 2024-09-15T12:33:30.076 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 8 tests. 2024-09-15T12:33:30.078 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:33:30.079 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:33:30.079 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_api_c_read_operations 2024-09-15T12:33:30.101 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:33:30.101 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-15T12:33:30.101 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:33:30.102 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 17 tests from CReadOpsTest 2024-09-15T12:33:32.087 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.NewDelete 2024-09-15T12:33:32.087 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.NewDelete (0 ms) 2024-09-15T12:33:32.087 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.SetOpFlags 2024-09-15T12:33:32.369 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.SetOpFlags (282 ms) 2024-09-15T12:33:32.369 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.AssertExists 2024-09-15T12:33:32.411 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.AssertExists (42 ms) 2024-09-15T12:33:32.411 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.AssertVersion 2024-09-15T12:33:32.462 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.AssertVersion (51 ms) 2024-09-15T12:33:32.462 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.CmpXattr 2024-09-15T12:33:32.659 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.CmpXattr (197 ms) 2024-09-15T12:33:32.659 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.Read 2024-09-15T12:33:32.709 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.Read (50 ms) 2024-09-15T12:33:32.709 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.Checksum 2024-09-15T12:33:32.753 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.Checksum (45 ms) 2024-09-15T12:33:32.753 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.RWOrderedRead 2024-09-15T12:33:32.784 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.RWOrderedRead (30 ms) 2024-09-15T12:33:32.785 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.ShortRead 2024-09-15T12:33:32.830 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.ShortRead (46 ms) 2024-09-15T12:33:32.830 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.Exec 2024-09-15T12:33:32.860 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.Exec (29 ms) 2024-09-15T12:33:32.860 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.ExecUserBuf 2024-09-15T12:33:32.900 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.ExecUserBuf (40 ms) 2024-09-15T12:33:32.900 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.Stat 2024-09-15T12:33:32.942 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.Stat (43 ms) 2024-09-15T12:33:32.943 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.Stat2 2024-09-15T12:33:32.982 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.Stat2 (39 ms) 2024-09-15T12:33:32.982 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.Omap 2024-09-15T12:33:33.116 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.Omap (134 ms) 2024-09-15T12:33:33.116 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.OmapNuls 2024-09-15T12:33:33.215 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.OmapNuls (99 ms) 2024-09-15T12:33:33.215 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.GetXattrs 2024-09-15T12:33:33.297 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.GetXattrs (82 ms) 2024-09-15T12:33:33.297 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] CReadOpsTest.CmpExt 2024-09-15T12:33:33.338 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] CReadOpsTest.CmpExt (41 ms) 2024-09-15T12:33:34.091 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 17 tests from CReadOpsTest (1251 ms total) 2024-09-15T12:33:34.091 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:33:34.091 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:33:34.091 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 17 tests from 1 test suite ran. (3990 ms total) 2024-09-15T12:33:34.092 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 17 tests. 2024-09-15T12:33:34.093 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:33:34.093 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:33:34.093 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_list_parallel 2024-09-15T12:33:37.032 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94421]: starting. 2024-09-15T12:33:37.032 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94421]: creating pool ceph_test_rados_list_parallel.smithi122-94420 2024-09-15T12:33:37.032 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94421]: created object 0... 2024-09-15T12:33:37.032 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94421]: created object 25... 2024-09-15T12:33:37.032 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94421]: created object 49... 2024-09-15T12:33:37.032 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94421]: finishing. 2024-09-15T12:33:37.032 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94421]: shutting down. 2024-09-15T12:33:37.171 INFO:tasks.workunit.client.0.smithi122.stdout:process_2_[94422]: starting. 2024-09-15T12:33:37.172 INFO:tasks.workunit.client.0.smithi122.stdout:process_2_[94422]: listing objects. 2024-09-15T12:33:37.172 INFO:tasks.workunit.client.0.smithi122.stdout:process_2_[94422]: listed object 0... 2024-09-15T12:33:37.172 INFO:tasks.workunit.client.0.smithi122.stdout:process_2_[94422]: listed object 25... 2024-09-15T12:33:37.172 INFO:tasks.workunit.client.0.smithi122.stdout:process_2_[94422]: saw 50 objects 2024-09-15T12:33:37.172 INFO:tasks.workunit.client.0.smithi122.stdout:process_2_[94422]: shutting down. 2024-09-15T12:33:37.848 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:37.848 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94457]: starting. 2024-09-15T12:33:37.848 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94457]: creating pool ceph_test_rados_list_parallel.smithi122-94420 2024-09-15T12:33:37.848 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94457]: created object 0... 2024-09-15T12:33:37.848 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94457]: created object 25... 2024-09-15T12:33:37.848 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94457]: created object 49... 2024-09-15T12:33:37.848 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94457]: finishing. 2024-09-15T12:33:37.848 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94457]: shutting down. 2024-09-15T12:33:38.237 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:38.237 INFO:tasks.workunit.client.0.smithi122.stdout:process_4_[94458]: starting. 2024-09-15T12:33:38.237 INFO:tasks.workunit.client.0.smithi122.stdout:process_4_[94458]: listing objects. 2024-09-15T12:33:38.237 INFO:tasks.workunit.client.0.smithi122.stdout:process_4_[94458]: listed object 0... 2024-09-15T12:33:38.238 INFO:tasks.workunit.client.0.smithi122.stdout:process_4_[94458]: listed object 25... 2024-09-15T12:33:38.238 INFO:tasks.workunit.client.0.smithi122.stdout:process_4_[94458]: saw 43 objects 2024-09-15T12:33:38.238 INFO:tasks.workunit.client.0.smithi122.stdout:process_4_[94458]: shutting down. 2024-09-15T12:33:38.525 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:38.525 INFO:tasks.workunit.client.0.smithi122.stdout:process_5_[94459]: starting. 2024-09-15T12:33:38.525 INFO:tasks.workunit.client.0.smithi122.stdout:process_5_[94459]: removed 25 objects... 2024-09-15T12:33:38.525 INFO:tasks.workunit.client.0.smithi122.stdout:process_5_[94459]: removed half of the objects 2024-09-15T12:33:38.525 INFO:tasks.workunit.client.0.smithi122.stdout:process_5_[94459]: removed 50 objects... 2024-09-15T12:33:38.525 INFO:tasks.workunit.client.0.smithi122.stdout:process_5_[94459]: removed 50 objects 2024-09-15T12:33:38.526 INFO:tasks.workunit.client.0.smithi122.stdout:process_5_[94459]: shutting down. 2024-09-15T12:33:39.189 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:39.190 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:39.190 INFO:tasks.workunit.client.0.smithi122.stdout:process_6_[94508]: starting. 2024-09-15T12:33:39.190 INFO:tasks.workunit.client.0.smithi122.stdout:process_6_[94508]: creating pool ceph_test_rados_list_parallel.smithi122-94420 2024-09-15T12:33:39.190 INFO:tasks.workunit.client.0.smithi122.stdout:process_6_[94508]: created object 0... 2024-09-15T12:33:39.190 INFO:tasks.workunit.client.0.smithi122.stdout:process_6_[94508]: created object 25... 2024-09-15T12:33:39.190 INFO:tasks.workunit.client.0.smithi122.stdout:process_6_[94508]: created object 49... 2024-09-15T12:33:39.190 INFO:tasks.workunit.client.0.smithi122.stdout:process_6_[94508]: finishing. 2024-09-15T12:33:39.190 INFO:tasks.workunit.client.0.smithi122.stdout:process_6_[94508]: shutting down. 2024-09-15T12:33:39.549 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:39.549 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:39.549 INFO:tasks.workunit.client.0.smithi122.stdout:process_7_[94509]: starting. 2024-09-15T12:33:39.549 INFO:tasks.workunit.client.0.smithi122.stdout:process_7_[94509]: listing objects. 2024-09-15T12:33:39.549 INFO:tasks.workunit.client.0.smithi122.stdout:process_7_[94509]: listed object 0... 2024-09-15T12:33:39.549 INFO:tasks.workunit.client.0.smithi122.stdout:process_7_[94509]: listed object 25... 2024-09-15T12:33:39.549 INFO:tasks.workunit.client.0.smithi122.stdout:process_7_[94509]: listed object 50... 2024-09-15T12:33:39.550 INFO:tasks.workunit.client.0.smithi122.stdout:process_7_[94509]: saw 56 objects 2024-09-15T12:33:39.550 INFO:tasks.workunit.client.0.smithi122.stdout:process_7_[94509]: shutting down. 2024-09-15T12:33:39.882 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:39.882 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:39.882 INFO:tasks.workunit.client.0.smithi122.stdout:process_8_[94510]: starting. 2024-09-15T12:33:39.882 INFO:tasks.workunit.client.0.smithi122.stdout:process_8_[94510]: added 25 objects... 2024-09-15T12:33:39.882 INFO:tasks.workunit.client.0.smithi122.stdout:process_8_[94510]: added half of the objects 2024-09-15T12:33:39.882 INFO:tasks.workunit.client.0.smithi122.stdout:process_8_[94510]: added 50 objects... 2024-09-15T12:33:39.883 INFO:tasks.workunit.client.0.smithi122.stdout:process_8_[94510]: added 50 objects 2024-09-15T12:33:39.883 INFO:tasks.workunit.client.0.smithi122.stdout:process_8_[94510]: shutting down. 2024-09-15T12:33:40.552 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:40.552 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:40.552 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:40.552 INFO:tasks.workunit.client.0.smithi122.stdout:process_9_[94559]: starting. 2024-09-15T12:33:40.552 INFO:tasks.workunit.client.0.smithi122.stdout:process_9_[94559]: creating pool ceph_test_rados_list_parallel.smithi122-94420 2024-09-15T12:33:40.552 INFO:tasks.workunit.client.0.smithi122.stdout:process_9_[94559]: created object 0... 2024-09-15T12:33:40.552 INFO:tasks.workunit.client.0.smithi122.stdout:process_9_[94559]: created object 25... 2024-09-15T12:33:40.552 INFO:tasks.workunit.client.0.smithi122.stdout:process_9_[94559]: created object 49... 2024-09-15T12:33:40.552 INFO:tasks.workunit.client.0.smithi122.stdout:process_9_[94559]: finishing. 2024-09-15T12:33:40.553 INFO:tasks.workunit.client.0.smithi122.stdout:process_9_[94559]: shutting down. 2024-09-15T12:33:40.961 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:41.059 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:41.059 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:41.060 INFO:tasks.workunit.client.0.smithi122.stdout:process_10_[94560]: starting. 2024-09-15T12:33:41.060 INFO:tasks.workunit.client.0.smithi122.stdout:process_10_[94560]: listing objects. 2024-09-15T12:33:41.060 INFO:tasks.workunit.client.0.smithi122.stdout:process_10_[94560]: listed object 0... 2024-09-15T12:33:41.060 INFO:tasks.workunit.client.0.smithi122.stdout:process_10_[94560]: listed object 25... 2024-09-15T12:33:41.060 INFO:tasks.workunit.client.0.smithi122.stdout:process_10_[94560]: listed object 50... 2024-09-15T12:33:41.060 INFO:tasks.workunit.client.0.smithi122.stdout:process_10_[94560]: listed object 75... 2024-09-15T12:33:41.060 INFO:tasks.workunit.client.0.smithi122.stdout:process_10_[94560]: saw 100 objects 2024-09-15T12:33:41.060 INFO:tasks.workunit.client.0.smithi122.stdout:process_10_[94560]: shutting down. 2024-09-15T12:33:41.340 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:41.340 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:41.341 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:41.341 INFO:tasks.workunit.client.0.smithi122.stdout:process_11_[94561]: starting. 2024-09-15T12:33:41.341 INFO:tasks.workunit.client.0.smithi122.stdout:process_11_[94561]: added 25 objects... 2024-09-15T12:33:41.341 INFO:tasks.workunit.client.0.smithi122.stdout:process_11_[94561]: added half of the objects 2024-09-15T12:33:41.341 INFO:tasks.workunit.client.0.smithi122.stdout:process_11_[94561]: added 50 objects... 2024-09-15T12:33:41.341 INFO:tasks.workunit.client.0.smithi122.stdout:process_11_[94561]: added 50 objects 2024-09-15T12:33:41.341 INFO:tasks.workunit.client.0.smithi122.stdout:process_11_[94561]: shutting down. 2024-09-15T12:33:41.347 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:41.347 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:41.347 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:41.347 INFO:tasks.workunit.client.0.smithi122.stdout:process_13_[94563]: starting. 2024-09-15T12:33:41.347 INFO:tasks.workunit.client.0.smithi122.stdout:process_13_[94563]: removed 25 objects... 2024-09-15T12:33:41.347 INFO:tasks.workunit.client.0.smithi122.stdout:process_13_[94563]: removed half of the objects 2024-09-15T12:33:41.348 INFO:tasks.workunit.client.0.smithi122.stdout:process_13_[94563]: removed 50 objects... 2024-09-15T12:33:41.348 INFO:tasks.workunit.client.0.smithi122.stdout:process_13_[94563]: removed 50 objects 2024-09-15T12:33:41.348 INFO:tasks.workunit.client.0.smithi122.stdout:process_13_[94563]: shutting down. 2024-09-15T12:33:41.410 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:41.410 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:41.410 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:41.410 INFO:tasks.workunit.client.0.smithi122.stdout:process_12_[94562]: starting. 2024-09-15T12:33:41.410 INFO:tasks.workunit.client.0.smithi122.stdout:process_12_[94562]: added 25 objects... 2024-09-15T12:33:41.410 INFO:tasks.workunit.client.0.smithi122.stdout:process_12_[94562]: added half of the objects 2024-09-15T12:33:41.410 INFO:tasks.workunit.client.0.smithi122.stdout:process_12_[94562]: added 50 objects... 2024-09-15T12:33:41.410 INFO:tasks.workunit.client.0.smithi122.stdout:process_12_[94562]: added 50 objects 2024-09-15T12:33:41.411 INFO:tasks.workunit.client.0.smithi122.stdout:process_12_[94562]: shutting down. 2024-09-15T12:33:42.065 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:42.065 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:42.065 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:42.065 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:42.066 INFO:tasks.workunit.client.0.smithi122.stdout:process_14_[94644]: starting. 2024-09-15T12:33:42.066 INFO:tasks.workunit.client.0.smithi122.stdout:process_14_[94644]: creating pool ceph_test_rados_list_parallel.smithi122-94420 2024-09-15T12:33:42.066 INFO:tasks.workunit.client.0.smithi122.stdout:process_14_[94644]: created object 0... 2024-09-15T12:33:42.066 INFO:tasks.workunit.client.0.smithi122.stdout:process_14_[94644]: created object 25... 2024-09-15T12:33:42.066 INFO:tasks.workunit.client.0.smithi122.stdout:process_14_[94644]: created object 49... 2024-09-15T12:33:42.066 INFO:tasks.workunit.client.0.smithi122.stdout:process_14_[94644]: finishing. 2024-09-15T12:33:42.066 INFO:tasks.workunit.client.0.smithi122.stdout:process_14_[94644]: shutting down. 2024-09-15T12:33:42.408 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:42.408 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:42.408 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:42.408 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:42.408 INFO:tasks.workunit.client.0.smithi122.stdout:process_15_[94645]: starting. 2024-09-15T12:33:42.409 INFO:tasks.workunit.client.0.smithi122.stdout:process_15_[94645]: listing objects. 2024-09-15T12:33:42.409 INFO:tasks.workunit.client.0.smithi122.stdout:process_15_[94645]: listed object 0... 2024-09-15T12:33:42.409 INFO:tasks.workunit.client.0.smithi122.stdout:process_15_[94645]: listed object 25... 2024-09-15T12:33:42.409 INFO:tasks.workunit.client.0.smithi122.stdout:process_15_[94645]: listed object 50... 2024-09-15T12:33:42.409 INFO:tasks.workunit.client.0.smithi122.stdout:process_15_[94645]: listed object 75... 2024-09-15T12:33:42.409 INFO:tasks.workunit.client.0.smithi122.stdout:process_15_[94645]: listed object 100... 2024-09-15T12:33:42.409 INFO:tasks.workunit.client.0.smithi122.stdout:process_15_[94645]: listed object 125... 2024-09-15T12:33:42.409 INFO:tasks.workunit.client.0.smithi122.stdout:process_15_[94645]: saw 150 objects 2024-09-15T12:33:42.409 INFO:tasks.workunit.client.0.smithi122.stdout:process_15_[94645]: shutting down. 2024-09-15T12:33:42.730 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:42.730 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:42.730 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:42.730 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:42.730 INFO:tasks.workunit.client.0.smithi122.stdout:process_16_[94646]: starting. 2024-09-15T12:33:42.730 INFO:tasks.workunit.client.0.smithi122.stdout:process_16_[94646]: added 25 objects... 2024-09-15T12:33:42.730 INFO:tasks.workunit.client.0.smithi122.stdout:process_16_[94646]: added half of the objects 2024-09-15T12:33:42.730 INFO:tasks.workunit.client.0.smithi122.stdout:process_16_[94646]: added 50 objects... 2024-09-15T12:33:42.730 INFO:tasks.workunit.client.0.smithi122.stdout:process_16_[94646]: added 50 objects 2024-09-15T12:33:42.731 INFO:tasks.workunit.client.0.smithi122.stdout:process_16_[94646]: shutting down. 2024-09-15T12:33:43.600 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:43.601 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:43.601 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:43.601 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:43.601 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:43.601 INFO:tasks.workunit.client.0.smithi122.stdout:******* SUCCESS ********** 2024-09-15T12:33:43.602 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:33:43.602 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:33:43.602 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_open_pools_parallel 2024-09-15T12:33:46.501 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94712]: starting. 2024-09-15T12:33:46.501 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94712]: creating pool ceph_test_rados_open_pools_parallel.smithi122-94711 2024-09-15T12:33:46.502 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94712]: created object 0... 2024-09-15T12:33:46.502 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94712]: created object 25... 2024-09-15T12:33:46.502 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94712]: created object 49... 2024-09-15T12:33:46.502 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94712]: finishing. 2024-09-15T12:33:46.502 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94712]: shutting down. 2024-09-15T12:33:46.617 INFO:tasks.workunit.client.0.smithi122.stdout:process_2_[94713]: starting. 2024-09-15T12:33:46.617 INFO:tasks.workunit.client.0.smithi122.stdout:process_2_[94713]: rados_pool_create. 2024-09-15T12:33:46.617 INFO:tasks.workunit.client.0.smithi122.stdout:process_2_[94713]: rados_ioctx_create. 2024-09-15T12:33:46.617 INFO:tasks.workunit.client.0.smithi122.stdout:process_2_[94713]: shutting down. 2024-09-15T12:33:48.993 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:48.993 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94748]: starting. 2024-09-15T12:33:48.994 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94748]: creating pool ceph_test_rados_open_pools_parallel.smithi122-94711 2024-09-15T12:33:48.994 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94748]: created object 0... 2024-09-15T12:33:48.994 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94748]: created object 25... 2024-09-15T12:33:48.994 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94748]: created object 49... 2024-09-15T12:33:48.994 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94748]: finishing. 2024-09-15T12:33:48.994 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94748]: shutting down. 2024-09-15T12:33:49.061 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:49.061 INFO:tasks.workunit.client.0.smithi122.stdout:process_4_[94749]: starting. 2024-09-15T12:33:49.061 INFO:tasks.workunit.client.0.smithi122.stdout:process_4_[94749]: rados_pool_create. 2024-09-15T12:33:49.061 INFO:tasks.workunit.client.0.smithi122.stdout:process_4_[94749]: rados_ioctx_create. 2024-09-15T12:33:49.061 INFO:tasks.workunit.client.0.smithi122.stdout:process_4_[94749]: shutting down. 2024-09-15T12:33:49.062 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:49.062 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:49.062 INFO:tasks.workunit.client.0.smithi122.stdout:******* SUCCESS ********** 2024-09-15T12:33:49.063 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-15T12:33:49.063 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:33:49.063 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_rados_delete_pools_parallel 2024-09-15T12:33:52.004 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94785]: starting. 2024-09-15T12:33:52.004 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94785]: creating pool ceph_test_rados_delete_pools_parallel.smithi122-94784 2024-09-15T12:33:52.004 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94785]: created object 0... 2024-09-15T12:33:52.004 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94785]: created object 25... 2024-09-15T12:33:52.004 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94785]: created object 49... 2024-09-15T12:33:52.004 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94785]: finishing. 2024-09-15T12:33:52.004 INFO:tasks.workunit.client.0.smithi122.stdout:process_1_[94785]: shutting down. 2024-09-15T12:33:52.071 INFO:tasks.workunit.client.0.smithi122.stdout:process_2_[94786]: starting. 2024-09-15T12:33:52.071 INFO:tasks.workunit.client.0.smithi122.stdout:process_2_[94786]: deleting pool ceph_test_rados_delete_pools_parallel.smithi122-94784 2024-09-15T12:33:52.071 INFO:tasks.workunit.client.0.smithi122.stdout:process_2_[94786]: shutting down. 2024-09-15T12:33:55.020 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:55.020 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94821]: starting. 2024-09-15T12:33:55.020 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94821]: creating pool ceph_test_rados_delete_pools_parallel.smithi122-94784 2024-09-15T12:33:55.020 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94821]: created object 0... 2024-09-15T12:33:55.020 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94821]: created object 25... 2024-09-15T12:33:55.020 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94821]: created object 49... 2024-09-15T12:33:55.020 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94821]: finishing. 2024-09-15T12:33:55.020 INFO:tasks.workunit.client.0.smithi122.stdout:process_3_[94821]: shutting down. 2024-09-15T12:33:55.165 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:55.165 INFO:tasks.workunit.client.0.smithi122.stdout:process_5_[94823]: starting. 2024-09-15T12:33:55.165 INFO:tasks.workunit.client.0.smithi122.stdout:process_5_[94823]: listing objects. 2024-09-15T12:33:55.165 INFO:tasks.workunit.client.0.smithi122.stdout:process_5_[94823]: listed object 0... 2024-09-15T12:33:55.165 INFO:tasks.workunit.client.0.smithi122.stdout:process_5_[94823]: listed object 25... 2024-09-15T12:33:55.166 INFO:tasks.workunit.client.0.smithi122.stdout:process_5_[94823]: saw 50 objects 2024-09-15T12:33:55.166 INFO:tasks.workunit.client.0.smithi122.stdout:process_5_[94823]: shutting down. 2024-09-15T12:33:56.091 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:56.091 INFO:tasks.workunit.client.0.smithi122.stdout:process_4_[94822]: starting. 2024-09-15T12:33:56.091 INFO:tasks.workunit.client.0.smithi122.stdout:process_4_[94822]: deleting pool ceph_test_rados_delete_pools_parallel.smithi122-94784 2024-09-15T12:33:56.091 INFO:tasks.workunit.client.0.smithi122.stdout:process_4_[94822]: shutting down. 2024-09-15T12:33:56.093 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:56.093 INFO:tasks.workunit.client.0.smithi122.stdout:******************************* 2024-09-15T12:33:56.093 INFO:tasks.workunit.client.0.smithi122.stdout:******* SUCCESS ********** 2024-09-15T12:33:56.094 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-15T12:33:56.094 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:33:56.094 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 1 -eq 1 ']' 2024-09-15T12:33:56.094 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' cls = ec_io ']' 2024-09-15T12:33:56.094 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' cls = ec_list ']' 2024-09-15T12:33:56.094 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_neorados_cls 2024-09-15T12:33:56.117 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:33:56.117 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 1 test from 1 test suite. 2024-09-15T12:33:56.117 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:33:56.117 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from NeoRadosCls 2024-09-15T12:33:56.117 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosCls.DNE 2024-09-15T12:33:59.113 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosCls.DNE (2996 ms) 2024-09-15T12:33:59.113 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from NeoRadosCls (2996 ms total) 2024-09-15T12:33:59.113 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:33:59.114 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:33:59.114 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 1 test from 1 test suite ran. (2996 ms total) 2024-09-15T12:33:59.114 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 1 test. 2024-09-15T12:33:59.115 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-15T12:33:59.115 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:33:59.115 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 1 -eq 1 ']' 2024-09-15T12:33:59.115 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' cmd = ec_io ']' 2024-09-15T12:33:59.116 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' cmd = ec_list ']' 2024-09-15T12:33:59.116 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_neorados_cmd 2024-09-15T12:33:59.136 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:33:59.136 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-15T12:33:59.136 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:33:59.136 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 3 tests from NeoRadosCmd 2024-09-15T12:33:59.136 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosCmd.MonDescribe 2024-09-15T12:34:01.117 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosCmd.MonDescribe (1981 ms) 2024-09-15T12:34:01.117 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosCmd.OSDCmd 2024-09-15T12:34:03.137 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosCmd.OSDCmd (2020 ms) 2024-09-15T12:34:03.137 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosCmd.PGCmd 2024-09-15T12:34:06.144 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosCmd.PGCmd (3007 ms) 2024-09-15T12:34:06.144 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 3 tests from NeoRadosCmd (7008 ms total) 2024-09-15T12:34:06.144 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:34:06.144 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:34:06.144 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 3 tests from 1 test suite ran. (7008 ms total) 2024-09-15T12:34:06.144 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 3 tests. 2024-09-15T12:34:06.147 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-15T12:34:06.147 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:34:06.147 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 1 -eq 1 ']' 2024-09-15T12:34:06.147 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' handler_error = ec_io ']' 2024-09-15T12:34:06.147 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' handler_error = ec_list ']' 2024-09-15T12:34:06.148 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_neorados_handler_error 2024-09-15T12:34:06.167 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:34:06.167 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 1 test from 1 test suite. 2024-09-15T12:34:06.167 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:34:06.167 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from neocls_handler_error 2024-09-15T12:34:06.167 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] neocls_handler_error.test_handler_error 2024-09-15T12:34:09.156 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] neocls_handler_error.test_handler_error (2989 ms) 2024-09-15T12:34:09.157 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 1 test from neocls_handler_error (2989 ms total) 2024-09-15T12:34:09.157 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:34:09.157 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:34:09.157 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 1 test from 1 test suite ran. (2989 ms total) 2024-09-15T12:34:09.157 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 1 test. 2024-09-15T12:34:09.159 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-15T12:34:09.159 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:34:09.159 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 1 -eq 1 ']' 2024-09-15T12:34:09.159 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' io = ec_io ']' 2024-09-15T12:34:09.159 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' io = ec_list ']' 2024-09-15T12:34:09.160 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_neorados_io 2024-09-15T12:34:09.182 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:34:09.182 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-15T12:34:09.182 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:34:09.182 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 14 tests from NeoRadosIo 2024-09-15T12:34:09.182 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosIo.Limits 2024-09-15T12:34:10.160 INFO:tasks.workunit.client.0.smithi122.stderr:Not supported by crimson yet. Skipped 2024-09-15T12:34:11.169 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosIo.Limits (1987 ms) 2024-09-15T12:34:11.169 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosIo.SimpleWrite 2024-09-15T12:34:14.058 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosIo.SimpleWrite (2889 ms) 2024-09-15T12:34:14.059 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosIo.ReadOp 2024-09-15T12:34:17.078 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosIo.ReadOp (3020 ms) 2024-09-15T12:34:17.078 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosIo.SparseRead 2024-09-15T12:34:20.091 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosIo.SparseRead (3013 ms) 2024-09-15T12:34:20.091 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosIo.RoundTrip 2024-09-15T12:34:23.060 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosIo.RoundTrip (2969 ms) 2024-09-15T12:34:23.061 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-09-15T12:34:26.071 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosIo.ReadIntoBuufferlist (3011 ms) 2024-09-15T12:34:26.071 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-09-15T12:34:29.091 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3020 ms) 2024-09-15T12:34:29.091 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-09-15T12:34:32.105 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosIo.WriteFullRoundTrip (3014 ms) 2024-09-15T12:34:32.105 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosIo.AppendRoundTrip 2024-09-15T12:34:35.070 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosIo.AppendRoundTrip (2965 ms) 2024-09-15T12:34:35.070 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosIo.Trunc 2024-09-15T12:34:38.079 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosIo.Trunc (3009 ms) 2024-09-15T12:34:38.079 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosIo.Remove 2024-09-15T12:34:41.098 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosIo.Remove (3019 ms) 2024-09-15T12:34:41.098 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosIo.XattrsRoundTrip 2024-09-15T12:34:44.107 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosIo.XattrsRoundTrip (3009 ms) 2024-09-15T12:34:44.107 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosIo.RmXattr 2024-09-15T12:34:47.121 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosIo.RmXattr (3014 ms) 2024-09-15T12:34:47.122 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosIo.GetXattrs 2024-09-15T12:34:50.133 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosIo.GetXattrs (3012 ms) 2024-09-15T12:34:50.133 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 14 tests from NeoRadosIo (40951 ms total) 2024-09-15T12:34:50.134 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:34:50.134 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:34:50.134 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 14 tests from 1 test suite ran. (40951 ms total) 2024-09-15T12:34:50.134 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 14 tests. 2024-09-15T12:34:50.138 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-15T12:34:50.138 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:34:50.139 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping EC with Crimson 2024-09-15T12:34:50.139 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 1 -eq 1 ']' 2024-09-15T12:34:50.139 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' ec_io = ec_io ']' 2024-09-15T12:34:50.140 INFO:tasks.workunit.client.0.smithi122.stderr:+ echo 'Skipping EC with Crimson' 2024-09-15T12:34:50.140 INFO:tasks.workunit.client.0.smithi122.stderr:+ continue 2024-09-15T12:34:50.140 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-15T12:34:50.140 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:34:50.140 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 1 -eq 1 ']' 2024-09-15T12:34:50.140 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' list = ec_io ']' 2024-09-15T12:34:50.140 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' list = ec_list ']' 2024-09-15T12:34:50.140 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_neorados_list 2024-09-15T12:34:50.159 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:34:50.159 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-15T12:34:50.159 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:34:50.159 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 3 tests from NeoradosList 2024-09-15T12:34:50.159 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoradosList.ListObjects 2024-09-15T12:34:53.070 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoradosList.ListObjects (2911 ms) 2024-09-15T12:34:53.070 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoradosList.ListObjectsNS 2024-09-15T12:34:56.084 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoradosList.ListObjectsNS (3013 ms) 2024-09-15T12:34:56.084 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoradosList.ListObjectsMany 2024-09-15T12:35:05.618 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoradosList.ListObjectsMany (9534 ms) 2024-09-15T12:35:05.618 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 3 tests from NeoradosList (15459 ms total) 2024-09-15T12:35:05.618 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:35:05.618 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:35:05.618 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 3 tests from 1 test suite ran. (15459 ms total) 2024-09-15T12:35:05.618 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 3 tests. 2024-09-15T12:35:05.621 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-15T12:35:05.621 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:35:05.621 INFO:tasks.workunit.client.0.smithi122.stdout:Skipping EC with Crimson 2024-09-15T12:35:05.622 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 1 -eq 1 ']' 2024-09-15T12:35:05.622 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' ec_list = ec_io ']' 2024-09-15T12:35:05.622 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' ec_list = ec_list ']' 2024-09-15T12:35:05.622 INFO:tasks.workunit.client.0.smithi122.stderr:+ echo 'Skipping EC with Crimson' 2024-09-15T12:35:05.622 INFO:tasks.workunit.client.0.smithi122.stderr:+ continue 2024-09-15T12:35:05.622 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-15T12:35:05.622 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:35:05.622 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 1 -eq 1 ']' 2024-09-15T12:35:05.622 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' misc = ec_io ']' 2024-09-15T12:35:05.622 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' misc = ec_list ']' 2024-09-15T12:35:05.623 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_neorados_misc 2024-09-15T12:35:05.642 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:35:05.642 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-15T12:35:05.642 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:35:05.642 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 12 tests from NeoRadosMisc 2024-09-15T12:35:05.642 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosMisc.Version 2024-09-15T12:35:07.626 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosMisc.Version (1984 ms) 2024-09-15T12:35:07.626 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosMisc.WaitOSDMap 2024-09-15T12:35:09.072 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosMisc.WaitOSDMap (1446 ms) 2024-09-15T12:35:09.072 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosMisc.LongName 2024-09-15T12:35:12.085 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosMisc.LongName (3013 ms) 2024-09-15T12:35:12.086 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosMisc.LongLocator 2024-09-15T12:35:13.091 INFO:tasks.workunit.client.0.smithi122.stderr:Not supported by crimson yet. Skipped 2024-09-15T12:35:14.092 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosMisc.LongLocator (2007 ms) 2024-09-15T12:35:14.092 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosMisc.LongNamespace 2024-09-15T12:35:17.109 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosMisc.LongNamespace (3017 ms) 2024-09-15T12:35:17.109 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosMisc.LongAttrName 2024-09-15T12:35:20.113 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosMisc.LongAttrName (3004 ms) 2024-09-15T12:35:20.113 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosMisc.Exec 2024-09-15T12:35:23.130 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosMisc.Exec (3017 ms) 2024-09-15T12:35:23.131 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosMisc.Operate1 2024-09-15T12:35:26.143 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosMisc.Operate1 (3013 ms) 2024-09-15T12:35:26.143 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosMisc.Operate2 2024-09-15T12:35:29.155 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosMisc.Operate2 (3012 ms) 2024-09-15T12:35:29.155 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosMisc.BigObject 2024-09-15T12:35:32.168 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosMisc.BigObject (3013 ms) 2024-09-15T12:35:32.168 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosMisc.BigAttr 2024-09-15T12:35:34.175 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosMisc.BigAttr (2007 ms) 2024-09-15T12:35:34.176 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosMisc.WriteSame 2024-09-15T12:35:35.182 INFO:tasks.workunit.client.0.smithi122.stderr:Not supported by crimson yet. Skipped 2024-09-15T12:35:36.186 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosMisc.WriteSame (2011 ms) 2024-09-15T12:35:36.186 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 12 tests from NeoRadosMisc (30544 ms total) 2024-09-15T12:35:36.186 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:35:36.187 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:35:36.187 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 12 tests from 1 test suite ran. (30544 ms total) 2024-09-15T12:35:36.187 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 12 tests. 2024-09-15T12:35:36.190 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-15T12:35:36.190 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:35:36.190 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 1 -eq 1 ']' 2024-09-15T12:35:36.190 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' pool = ec_io ']' 2024-09-15T12:35:36.190 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' pool = ec_list ']' 2024-09-15T12:35:36.191 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_neorados_pool 2024-09-15T12:35:36.213 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:35:36.214 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-15T12:35:36.214 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:35:36.214 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 6 tests from NeoRadosPools 2024-09-15T12:35:36.214 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosPools.PoolList 2024-09-15T12:35:38.081 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosPools.PoolList (1867 ms) 2024-09-15T12:35:38.081 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosPools.PoolLookup 2024-09-15T12:35:40.092 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosPools.PoolLookup (2011 ms) 2024-09-15T12:35:40.092 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-09-15T12:35:42.104 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosPools.PoolLookupOtherInstance (2012 ms) 2024-09-15T12:35:42.104 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosPools.PoolDelete 2024-09-15T12:35:46.122 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosPools.PoolDelete (4018 ms) 2024-09-15T12:35:46.122 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosPools.PoolCreateDelete 2024-09-15T12:35:48.083 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosPools.PoolCreateDelete (1961 ms) 2024-09-15T12:35:48.083 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-09-15T12:35:50.093 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosPools.PoolCreateWithCrushRule (2010 ms) 2024-09-15T12:35:50.093 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 6 tests from NeoRadosPools (13879 ms total) 2024-09-15T12:35:50.093 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:35:50.093 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:35:50.093 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 6 tests from 1 test suite ran. (13879 ms total) 2024-09-15T12:35:50.093 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 6 tests. 2024-09-15T12:35:50.097 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-15T12:35:50.097 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:35:50.097 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 1 -eq 1 ']' 2024-09-15T12:35:50.097 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' read_operations = ec_io ']' 2024-09-15T12:35:50.097 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' read_operations = ec_list ']' 2024-09-15T12:35:50.097 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_neorados_read_operations 2024-09-15T12:35:50.121 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:35:50.121 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-15T12:35:50.121 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:35:50.121 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 14 tests from NeoRadosReadOps 2024-09-15T12:35:50.121 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosReadOps.SetOpFlags 2024-09-15T12:35:53.113 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosReadOps.SetOpFlags (2992 ms) 2024-09-15T12:35:53.113 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosReadOps.AssertExists 2024-09-15T12:35:56.126 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosReadOps.AssertExists (3013 ms) 2024-09-15T12:35:56.126 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosReadOps.AssertVersion 2024-09-15T12:35:59.140 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosReadOps.AssertVersion (3014 ms) 2024-09-15T12:35:59.140 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosReadOps.CmpXattr 2024-09-15T12:36:02.149 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosReadOps.CmpXattr (3009 ms) 2024-09-15T12:36:02.149 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosReadOps.Read 2024-09-15T12:36:05.167 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosReadOps.Read (3018 ms) 2024-09-15T12:36:05.167 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosReadOps.Checksum 2024-09-15T12:36:08.083 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosReadOps.Checksum (2917 ms) 2024-09-15T12:36:08.084 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosReadOps.RWOrderedRead 2024-09-15T12:36:11.095 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosReadOps.RWOrderedRead (3011 ms) 2024-09-15T12:36:11.096 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosReadOps.ShortRead 2024-09-15T12:36:14.103 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosReadOps.ShortRead (3008 ms) 2024-09-15T12:36:14.104 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosReadOps.Exec 2024-09-15T12:36:17.122 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosReadOps.Exec (3018 ms) 2024-09-15T12:36:17.122 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosReadOps.Stat 2024-09-15T12:36:20.122 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosReadOps.Stat (3001 ms) 2024-09-15T12:36:20.122 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosReadOps.Omap 2024-09-15T12:36:23.140 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosReadOps.Omap (3018 ms) 2024-09-15T12:36:23.140 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosReadOps.OmapNuls 2024-09-15T12:36:26.150 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosReadOps.OmapNuls (3010 ms) 2024-09-15T12:36:26.151 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosReadOps.GetXattrs 2024-09-15T12:36:29.167 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosReadOps.GetXattrs (3017 ms) 2024-09-15T12:36:29.167 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosReadOps.CmpExt 2024-09-15T12:36:32.183 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosReadOps.CmpExt (3016 ms) 2024-09-15T12:36:32.183 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 14 tests from NeoRadosReadOps (42062 ms total) 2024-09-15T12:36:32.183 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:36:32.183 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:36:32.183 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 14 tests from 1 test suite ran. (42062 ms total) 2024-09-15T12:36:32.183 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 14 tests. 2024-09-15T12:36:32.188 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-15T12:36:32.188 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:36:32.188 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 1 -eq 1 ']' 2024-09-15T12:36:32.188 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' snapshots = ec_io ']' 2024-09-15T12:36:32.188 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' snapshots = ec_list ']' 2024-09-15T12:36:32.188 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_neorados_snapshots 2024-09-15T12:36:32.208 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:36:32.209 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-15T12:36:32.209 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:36:32.209 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 5 tests from NeoRadosSnapshots 2024-09-15T12:36:32.209 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosSnapshots.SnapList 2024-09-15T12:36:37.205 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosSnapshots.SnapList (4996 ms) 2024-09-15T12:36:37.205 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosSnapshots.SnapRemove 2024-09-15T12:36:42.107 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosSnapshots.SnapRemove (4902 ms) 2024-09-15T12:36:42.107 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosSnapshots.Rollback 2024-09-15T12:36:46.134 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosSnapshots.Rollback (4027 ms) 2024-09-15T12:36:46.135 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosSnapshots.SnapGetName 2024-09-15T12:36:51.165 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosSnapshots.SnapGetName (5031 ms) 2024-09-15T12:36:51.165 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-09-15T12:36:58.096 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosSnapshots.SnapCreateRemove (6931 ms) 2024-09-15T12:36:58.096 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 5 tests from NeoRadosSnapshots (25887 ms total) 2024-09-15T12:36:58.096 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:36:58.096 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps 2024-09-15T12:36:58.096 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-09-15T12:37:03.121 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosSelfManagedSnaps.Snap (5025 ms) 2024-09-15T12:37:03.122 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-09-15T12:37:04.128 INFO:tasks.workunit.client.0.smithi122.stderr:Not supported by crimson yet. Skipped 2024-09-15T12:37:05.132 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosSelfManagedSnaps.Rollback (2011 ms) 2024-09-15T12:37:05.132 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-09-15T12:37:06.137 INFO:tasks.workunit.client.0.smithi122.stderr:Not supported by crimson yet. Skipped 2024-09-15T12:37:07.142 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (2010 ms) 2024-09-15T12:37:07.142 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-09-15T12:37:13.154 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6012 ms) 2024-09-15T12:37:13.155 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-09-15T12:37:17.181 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4027 ms) 2024-09-15T12:37:17.181 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-09-15T12:37:20.181 INFO:tasks.workunit.client.0.smithi122.stdout:Deleting snap 3 in pool ReusePurgedSnapsmithi122-95716-11. 2024-09-15T12:37:21.189 INFO:tasks.workunit.client.0.smithi122.stdout:Waiting for snaps to purge. 2024-09-15T12:37:37.118 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19937 ms) 2024-09-15T12:37:37.118 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps (39022 ms total) 2024-09-15T12:37:37.118 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:37:37.118 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:37:37.118 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 11 tests from 2 test suites ran. (64909 ms total) 2024-09-15T12:37:37.118 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 11 tests. 2024-09-15T12:37:37.123 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-15T12:37:37.123 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:37:37.123 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 1 -eq 1 ']' 2024-09-15T12:37:37.123 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' watch_notify = ec_io ']' 2024-09-15T12:37:37.123 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' watch_notify = ec_list ']' 2024-09-15T12:37:37.123 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_neorados_watch_notify 2024-09-15T12:37:37.146 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:37:37.146 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-15T12:37:37.146 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:37:37.146 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from NeoRadosWatchNotify 2024-09-15T12:37:37.146 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotify 2024-09-15T12:37:39.433 INFO:tasks.workunit.client.0.smithi122.stdout:handle_notify cookie 18262704 notify_id 2834678415366 notifier_gid 15851 2024-09-15T12:37:40.123 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosWatchNotify.WatchNotify (2977 ms) 2024-09-15T12:37:40.123 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-09-15T12:37:42.463 INFO:tasks.workunit.client.0.smithi122.stdout:Trying... 2024-09-15T12:37:42.466 INFO:tasks.workunit.client.0.smithi122.stdout:handle_notify cookie 31763600 notify_id 2847563317252 notifier_gid 15854 2024-09-15T12:37:42.466 INFO:tasks.workunit.client.0.smithi122.stdout:Waiting for 3.000000000s 2024-09-15T12:37:43.465 INFO:tasks.workunit.client.0.smithi122.stdout:Timed out. 2024-09-15T12:37:43.478 INFO:tasks.workunit.client.0.smithi122.stdout:Flushing... 2024-09-15T12:37:43.478 INFO:tasks.workunit.client.0.smithi122.stdout:Flushed... 2024-09-15T12:37:46.537 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (6414 ms) 2024-09-15T12:37:46.537 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 2 tests from NeoRadosWatchNotify (9391 ms total) 2024-09-15T12:37:46.537 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:37:46.537 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:37:46.537 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 2 tests from 1 test suite ran. (9391 ms total) 2024-09-15T12:37:46.537 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 2 tests. 2024-09-15T12:37:46.540 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-15T12:37:46.540 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:37:46.540 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 1 -eq 1 ']' 2024-09-15T12:37:46.540 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' write_operations = ec_io ']' 2024-09-15T12:37:46.541 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' write_operations = ec_list ']' 2024-09-15T12:37:46.541 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph_test_neorados_write_operations 2024-09-15T12:37:46.562 INFO:tasks.workunit.client.0.smithi122.stdout:Running main() from gmock_main.cc 2024-09-15T12:37:46.563 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-15T12:37:46.563 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment set-up. 2024-09-15T12:37:46.563 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from NeoRadosWriteOps 2024-09-15T12:37:46.563 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosWriteOps.AssertExists 2024-09-15T12:37:49.112 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosWriteOps.AssertExists (2550 ms) 2024-09-15T12:37:49.112 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosWriteOps.AssertVersion 2024-09-15T12:37:52.132 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosWriteOps.AssertVersion (3020 ms) 2024-09-15T12:37:52.132 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosWriteOps.Xattrs 2024-09-15T12:37:55.151 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosWriteOps.Xattrs (3018 ms) 2024-09-15T12:37:55.151 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosWriteOps.Write 2024-09-15T12:37:58.164 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosWriteOps.Write (3014 ms) 2024-09-15T12:37:58.164 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosWriteOps.Exec 2024-09-15T12:38:01.188 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosWriteOps.Exec (3024 ms) 2024-09-15T12:38:01.188 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosWriteOps.WriteSame 2024-09-15T12:38:04.200 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosWriteOps.WriteSame (3012 ms) 2024-09-15T12:38:04.201 INFO:tasks.workunit.client.0.smithi122.stdout:[ RUN ] NeoRadosWriteOps.CmpExt 2024-09-15T12:38:15.665 INFO:tasks.workunit.client.0.smithi122.stdout:[ OK ] NeoRadosWriteOps.CmpExt (11465 ms) 2024-09-15T12:38:15.665 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] 7 tests from NeoRadosWriteOps (29103 ms total) 2024-09-15T12:38:15.666 INFO:tasks.workunit.client.0.smithi122.stdout: 2024-09-15T12:38:15.666 INFO:tasks.workunit.client.0.smithi122.stdout:[----------] Global test environment tear-down 2024-09-15T12:38:15.666 INFO:tasks.workunit.client.0.smithi122.stdout:[==========] 7 tests from 1 test suite ran. (29103 ms total) 2024-09-15T12:38:15.666 INFO:tasks.workunit.client.0.smithi122.stdout:[ PASSED ] 7 tests. 2024-09-15T12:38:15.669 INFO:tasks.workunit.client.0.smithi122.stderr:+ ret=0 2024-09-15T12:38:15.669 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -eq 1 ']' 2024-09-15T12:38:15.669 INFO:tasks.workunit.client.0.smithi122.stderr:+ exit 0 2024-09-15T12:38:15.669 INFO:tasks.workunit.client.0.smithi122.stderr:+ cleanup 2024-09-15T12:38:15.669 INFO:tasks.workunit.client.0.smithi122.stderr:+ pkill -P 30157 2024-09-15T12:38:15.695 INFO:tasks.workunit.client.0.smithi122.stderr:+ true 2024-09-15T12:38:15.696 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-15T12:38:15.696 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-15T12:38:15.774 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-09-15T12:38:15.776 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-09-15T12:38:15.776 DEBUG:teuthology.orchestra.run.smithi122:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-09-15T12:38:15.839 INFO:tasks.workunit.client.0.smithi122.stderr:++ uuidgen 2024-09-15T12:38:15.852 INFO:tasks.workunit.client.0.smithi122.stderr:+ p=ed9b5ffb-fd10-45e9-a651-fa504ac931a6 2024-09-15T12:38:15.852 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph osd pool create ed9b5ffb-fd10-45e9-a651-fa504ac931a6 12 2024-09-15T12:38:15.990 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.978+0000 7f77c68ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:15.991 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.989+0000 7f77c68ec640 1 Processor -- start 2024-09-15T12:38:15.991 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.989+0000 7f77c68ec640 1 -- start start 2024-09-15T12:38:15.993 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.990+0000 7f77c68ec640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f77c009ecc0 0x7f77c006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:15.993 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.990+0000 7f77c68ec640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c009fa40 con 0x7f77c006f120 2024-09-15T12:38:15.993 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.990+0000 7f77c68ec640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f77c009fd50 con 0x7f77c009ecc0 2024-09-15T12:38:15.994 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.990+0000 7f77bffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f77c009ecc0 0x7f77c006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:15.994 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.990+0000 7f77bffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f77c009ecc0 0x7f77c006ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47710/0 (socket says 172.21.15.122:47710) 2024-09-15T12:38:15.994 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.990+0000 7f77bffff640 1 -- 172.21.15.122:0/843486248 learned_addr learned my addr 172.21.15.122:0/843486248 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:15.994 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.990+0000 7f77bf7fe640 1 --1- 172.21.15.122:0/843486248 >> v1:172.21.15.122:6789/0 conn(0x7f77c006f120 0x7f77c0135e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:57852/0 (socket says 172.21.15.122:57852) 2024-09-15T12:38:15.994 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.991+0000 7f77bffff640 1 -- 172.21.15.122:0/843486248 >> v1:172.21.15.122:6789/0 conn(0x7f77c006f120 legacy=0x7f77c0135e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:15.994 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.991+0000 7f77bffff640 1 -- 172.21.15.122:0/843486248 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c009ff70 con 0x7f77c009ecc0 2024-09-15T12:38:15.994 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.991+0000 7f77bffff640 1 --2- 172.21.15.122:0/843486248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77c009ecc0 0x7f77c006ebe0 crc :-1 s=READY pgs=12825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3925b3e9cff77d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:15.994 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.991+0000 7f77beffd640 1 -- 172.21.15.122:0/843486248 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f77b0009e50 con 0x7f77c009ecc0 2024-09-15T12:38:15.994 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.991+0000 7f77beffd640 1 -- 172.21.15.122:0/843486248 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f77b000e230 con 0x7f77c009ecc0 2024-09-15T12:38:15.994 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.991+0000 7f77beffd640 1 -- 172.21.15.122:0/843486248 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f77b000e4d0 con 0x7f77c009ecc0 2024-09-15T12:38:15.995 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.992+0000 7f77c68ec640 1 -- 172.21.15.122:0/843486248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77c009ecc0 msgr2=0x7f77c006ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:15.995 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.992+0000 7f77c68ec640 1 --2- 172.21.15.122:0/843486248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77c009ecc0 0x7f77c006ebe0 crc :-1 s=READY pgs=12825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:15.996 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.992+0000 7f77c68ec640 1 -- 172.21.15.122:0/843486248 shutdown_connections 2024-09-15T12:38:15.996 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.992+0000 7f77c68ec640 1 --2- 172.21.15.122:0/843486248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77c009ecc0 0x7f77c006ebe0 unknown :-1 s=CLOSED pgs=12825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:15.996 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.992+0000 7f77c68ec640 1 -- 172.21.15.122:0/843486248 >> 172.21.15.122:0/843486248 conn(0x7f77c00a5350 msgr2=0x7f77c00a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:15.996 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.992+0000 7f77c68ec640 1 -- 172.21.15.122:0/843486248 shutdown_connections 2024-09-15T12:38:15.996 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.992+0000 7f77c68ec640 1 -- 172.21.15.122:0/843486248 wait complete. 2024-09-15T12:38:15.996 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.992+0000 7f77c68ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:15.996 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.994+0000 7f77c68ec640 1 Processor -- start 2024-09-15T12:38:15.996 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.994+0000 7f77c68ec640 1 -- start start 2024-09-15T12:38:15.998 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.995+0000 7f77c68ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77c006f120 0x7f77c0135a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:15.998 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.995+0000 7f77c68ec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f77c0125b00 con 0x7f77c006f120 2024-09-15T12:38:15.998 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.995+0000 7f77bffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77c006f120 0x7f77c0135a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:15.998 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.995+0000 7f77bffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77c006f120 0x7f77c0135a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47712/0 (socket says 172.21.15.122:47712) 2024-09-15T12:38:15.998 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.995+0000 7f77bffff640 1 -- 172.21.15.122:0/3454539246 learned_addr learned my addr 172.21.15.122:0/3454539246 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:15.998 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.995+0000 7f77bffff640 1 -- 172.21.15.122:0/3454539246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c0136120 con 0x7f77c006f120 2024-09-15T12:38:15.998 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.996+0000 7f77bffff640 1 --2- 172.21.15.122:0/3454539246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77c006f120 0x7f77c0135a20 crc :-1 s=READY pgs=12826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:15.998 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.996+0000 7f77bcff9640 1 -- 172.21.15.122:0/3454539246 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f77b000eda0 con 0x7f77c006f120 2024-09-15T12:38:15.998 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.996+0000 7f77bcff9640 1 -- 172.21.15.122:0/3454539246 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f77b0015420 con 0x7f77c006f120 2024-09-15T12:38:15.999 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.996+0000 7f77c68ec640 1 -- 172.21.15.122:0/3454539246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c0122e30 con 0x7f77c006f120 2024-09-15T12:38:15.999 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.996+0000 7f77bcff9640 1 -- 172.21.15.122:0/3454539246 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f77b00156c0 con 0x7f77c006f120 2024-09-15T12:38:15.999 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.996+0000 7f77c68ec640 1 -- 172.21.15.122:0/3454539246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c0124330 con 0x7f77c006f120 2024-09-15T12:38:16.000 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.997+0000 7f77c68ec640 1 -- 172.21.15.122:0/3454539246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77c009e2b0 con 0x7f77c006f120 2024-09-15T12:38:16.000 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.997+0000 7f77bcff9640 1 -- 172.21.15.122:0/3454539246 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f77b0015870 con 0x7f77c006f120 2024-09-15T12:38:16.000 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.997+0000 7f77bcff9640 1 --2- 172.21.15.122:0/3454539246 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f77ac03e930 0x7f77ac040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:16.000 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.997+0000 7f77bcff9640 1 -- 172.21.15.122:0/3454539246 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(690..690 src has 621..690) ==== 3431+0+0 (crc 0 0 0) 0x7f77b0050d90 con 0x7f77c006f120 2024-09-15T12:38:16.000 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.997+0000 7f77bf7fe640 1 --2- 172.21.15.122:0/3454539246 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f77ac03e930 0x7f77ac040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:16.000 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:15.998+0000 7f77bf7fe640 1 --2- 172.21.15.122:0/3454539246 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f77ac03e930 0x7f77ac040e40 crc :-1 s=READY pgs=3808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:16.004 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.003+0000 7f77bcff9640 1 -- 172.21.15.122:0/3454539246 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f77b0014c60 con 0x7f77c006f120 2024-09-15T12:38:16.180 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.178+0000 7f77c68ec640 1 -- 172.21.15.122:0/3454539246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "pg_num": 12} v 0) -- 0x7f77c0136120 con 0x7f77c006f120 2024-09-15T12:38:16.665 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.663+0000 7f77bcff9640 1 -- 172.21.15.122:0/3454539246 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "pg_num": 12}]=0 pool 'ed9b5ffb-fd10-45e9-a651-fa504ac931a6' created v691) ==== 176+0+0 (crc 0 0 0) 0x7f77c0136120 con 0x7f77c006f120 2024-09-15T12:38:16.803 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.801+0000 7f77c68ec640 1 -- 172.21.15.122:0/3454539246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "pg_num": 12} v 0) -- 0x7f77c0136120 con 0x7f77c006f120 2024-09-15T12:38:16.803 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.801+0000 7f77bcff9640 1 -- 172.21.15.122:0/3454539246 <== mon.0 v2:172.21.15.122:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "pg_num": 12}]=0 pool 'ed9b5ffb-fd10-45e9-a651-fa504ac931a6' already exists v691) ==== 183+0+0 (crc 0 0 0) 0x7f77c0136120 con 0x7f77c006f120 2024-09-15T12:38:16.803 INFO:tasks.workunit.client.0.smithi122.stderr:pool 'ed9b5ffb-fd10-45e9-a651-fa504ac931a6' already exists 2024-09-15T12:38:16.806 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.804+0000 7f77c68ec640 1 -- 172.21.15.122:0/3454539246 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f77ac03e930 msgr2=0x7f77ac040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:16.806 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.804+0000 7f77c68ec640 1 --2- 172.21.15.122:0/3454539246 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f77ac03e930 0x7f77ac040e40 crc :-1 s=READY pgs=3808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:16.806 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.804+0000 7f77c68ec640 1 -- 172.21.15.122:0/3454539246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77c006f120 msgr2=0x7f77c0135a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:16.806 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.804+0000 7f77c68ec640 1 --2- 172.21.15.122:0/3454539246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77c006f120 0x7f77c0135a20 crc :-1 s=READY pgs=12826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:16.806 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.804+0000 7f77c68ec640 1 -- 172.21.15.122:0/3454539246 shutdown_connections 2024-09-15T12:38:16.806 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.804+0000 7f77c68ec640 1 --2- 172.21.15.122:0/3454539246 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f77ac03e930 0x7f77ac040e40 unknown :-1 s=CLOSED pgs=3808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:16.806 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.804+0000 7f77c68ec640 1 --2- 172.21.15.122:0/3454539246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77c006f120 0x7f77c0135a20 unknown :-1 s=CLOSED pgs=12826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:16.807 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.804+0000 7f77c68ec640 1 -- 172.21.15.122:0/3454539246 >> 172.21.15.122:0/3454539246 conn(0x7f77c00a5350 msgr2=0x7f77c00a7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:16.807 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.804+0000 7f77c68ec640 1 -- 172.21.15.122:0/3454539246 shutdown_connections 2024-09-15T12:38:16.807 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.804+0000 7f77c68ec640 1 -- 172.21.15.122:0/3454539246 wait complete. 2024-09-15T12:38:16.815 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph osd pool set-quota ed9b5ffb-fd10-45e9-a651-fa504ac931a6 max_objects 10 2024-09-15T12:38:16.907 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.896+0000 7fcea9e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:16.908 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.906+0000 7fcea9e63640 1 Processor -- start 2024-09-15T12:38:16.908 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.906+0000 7fcea9e63640 1 -- start start 2024-09-15T12:38:16.910 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.907+0000 7fcea9e63640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcea406f5d0 0x7fcea413b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:16.910 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.907+0000 7fcea9e63640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcea4074c40 con 0x7fcea406eab0 2024-09-15T12:38:16.910 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.907+0000 7fcea9e63640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fcea40a5f00 con 0x7fcea406f5d0 2024-09-15T12:38:16.910 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.907+0000 7fcea2ffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcea406f5d0 0x7fcea413b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:16.910 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.907+0000 7fcea2ffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcea406f5d0 0x7fcea413b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47722/0 (socket says 172.21.15.122:47722) 2024-09-15T12:38:16.910 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.907+0000 7fcea37fe640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fcea406eab0 0x7fcea406eec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:57866/0 (socket says 172.21.15.122:57866) 2024-09-15T12:38:16.910 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.907+0000 7fcea2ffd640 1 -- 172.21.15.122:0/703253786 learned_addr learned my addr 172.21.15.122:0/703253786 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:16.910 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.908+0000 7fcea2ffd640 1 -- 172.21.15.122:0/703253786 >> v1:172.21.15.122:6789/0 conn(0x7fcea406eab0 legacy=0x7fcea406eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:16.911 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.908+0000 7fcea27fc640 1 -- 172.21.15.122:0/703253786 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2783847732 0 0) 0x7fcea4074c40 con 0x7fcea406eab0 2024-09-15T12:38:16.911 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.908+0000 7fcea2ffd640 1 -- 172.21.15.122:0/703253786 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea40a6290 con 0x7fcea406f5d0 2024-09-15T12:38:16.911 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.908+0000 7fcea2ffd640 1 --2- 172.21.15.122:0/703253786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406f5d0 0x7fcea413b350 crc :-1 s=READY pgs=12828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1457ce50d02b058 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:16.911 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.908+0000 7fcea27fc640 1 -- 172.21.15.122:0/703253786 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce98009e50 con 0x7fcea406f5d0 2024-09-15T12:38:16.911 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.908+0000 7fcea27fc640 1 -- 172.21.15.122:0/703253786 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fce9800e230 con 0x7fcea406f5d0 2024-09-15T12:38:16.911 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.908+0000 7fcea27fc640 1 -- 172.21.15.122:0/703253786 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce9800e4d0 con 0x7fcea406f5d0 2024-09-15T12:38:16.912 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.909+0000 7fcea9e63640 1 -- 172.21.15.122:0/703253786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406f5d0 msgr2=0x7fcea413b350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:16.912 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.909+0000 7fcea9e63640 1 --2- 172.21.15.122:0/703253786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406f5d0 0x7fcea413b350 crc :-1 s=READY pgs=12828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:16.912 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.909+0000 7fcea9e63640 1 -- 172.21.15.122:0/703253786 shutdown_connections 2024-09-15T12:38:16.912 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.909+0000 7fcea9e63640 1 --2- 172.21.15.122:0/703253786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406f5d0 0x7fcea413b350 unknown :-1 s=CLOSED pgs=12828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:16.913 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.909+0000 7fcea9e63640 1 -- 172.21.15.122:0/703253786 >> 172.21.15.122:0/703253786 conn(0x7fcea40a43d0 msgr2=0x7fcea40a47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:16.913 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.909+0000 7fcea9e63640 1 -- 172.21.15.122:0/703253786 shutdown_connections 2024-09-15T12:38:16.913 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.909+0000 7fcea9e63640 1 -- 172.21.15.122:0/703253786 wait complete. 2024-09-15T12:38:16.913 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.909+0000 7fcea9e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:16.913 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.910+0000 7fcea9e63640 1 Processor -- start 2024-09-15T12:38:16.913 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.911+0000 7fcea9e63640 1 -- start start 2024-09-15T12:38:16.915 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.912+0000 7fcea9e63640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406eab0 0x7fcea41241e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:16.915 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.912+0000 7fcea9e63640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcea4125260 con 0x7fcea406eab0 2024-09-15T12:38:16.915 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.912+0000 7fcea37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406eab0 0x7fcea41241e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:16.915 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.912+0000 7fcea37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406eab0 0x7fcea41241e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47724/0 (socket says 172.21.15.122:47724) 2024-09-15T12:38:16.915 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.912+0000 7fcea37fe640 1 -- 172.21.15.122:0/1669411566 learned_addr learned my addr 172.21.15.122:0/1669411566 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:16.915 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.912+0000 7fcea37fe640 1 -- 172.21.15.122:0/1669411566 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea4123e20 con 0x7fcea406eab0 2024-09-15T12:38:16.915 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.912+0000 7fcea37fe640 1 --2- 172.21.15.122:0/1669411566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406eab0 0x7fcea41241e0 crc :-1 s=READY pgs=12829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:16.915 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.912+0000 7fce8bfff640 1 -- 172.21.15.122:0/1669411566 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce94004b80 con 0x7fcea406eab0 2024-09-15T12:38:16.915 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.912+0000 7fce8bfff640 1 -- 172.21.15.122:0/1669411566 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fce94004ce0 con 0x7fcea406eab0 2024-09-15T12:38:16.915 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.912+0000 7fcea9e63640 1 -- 172.21.15.122:0/1669411566 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea41276a0 con 0x7fcea406eab0 2024-09-15T12:38:16.916 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.912+0000 7fce8bfff640 1 -- 172.21.15.122:0/1669411566 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce94007120 con 0x7fcea406eab0 2024-09-15T12:38:16.916 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.912+0000 7fcea9e63640 1 -- 172.21.15.122:0/1669411566 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea4126180 con 0x7fcea406eab0 2024-09-15T12:38:16.917 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.913+0000 7fcea9e63640 1 -- 172.21.15.122:0/1669411566 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea4073790 con 0x7fcea406eab0 2024-09-15T12:38:16.917 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.913+0000 7fce8bfff640 1 -- 172.21.15.122:0/1669411566 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fce94007320 con 0x7fcea406eab0 2024-09-15T12:38:16.917 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.914+0000 7fce8bfff640 1 --2- 172.21.15.122:0/1669411566 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fce9003e910 0x7fce90040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:16.917 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.914+0000 7fce8bfff640 1 -- 172.21.15.122:0/1669411566 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(691..691 src has 621..691) ==== 3806+0+0 (crc 0 0 0) 0x7fce9404fc70 con 0x7fcea406eab0 2024-09-15T12:38:16.917 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.914+0000 7fcea2ffd640 1 --2- 172.21.15.122:0/1669411566 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fce9003e910 0x7fce90040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:16.917 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.915+0000 7fcea2ffd640 1 --2- 172.21.15.122:0/1669411566 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fce9003e910 0x7fce90040e20 crc :-1 s=READY pgs=3809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:16.921 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:16.919+0000 7fce8bfff640 1 -- 172.21.15.122:0/1669411566 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fce9400f420 con 0x7fcea406eab0 2024-09-15T12:38:17.097 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:17.095+0000 7fcea9e63640 1 -- 172.21.15.122:0/1669411566 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_objects", "val": "10"} v 0) -- 0x7fcea4123770 con 0x7fcea406eab0 2024-09-15T12:38:17.669 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:17.667+0000 7fce8bfff640 1 -- 172.21.15.122:0/1669411566 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 v692) ==== 223+0+0 (crc 0 0 0) 0x7fce9400a0c0 con 0x7fcea406eab0 2024-09-15T12:38:17.849 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:17.847+0000 7fcea9e63640 1 -- 172.21.15.122:0/1669411566 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_objects", "val": "10"} v 0) -- 0x7fcea40742e0 con 0x7fcea406eab0 2024-09-15T12:38:18.670 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.668+0000 7fce8bfff640 1 -- 172.21.15.122:0/1669411566 <== mon.0 v2:172.21.15.122:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 v693) ==== 223+0+0 (crc 0 0 0) 0x7fce9400a7b0 con 0x7fcea406eab0 2024-09-15T12:38:18.670 INFO:tasks.workunit.client.0.smithi122.stderr:set-quota max_objects = 10 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 2024-09-15T12:38:18.673 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.670+0000 7fcea9e63640 1 -- 172.21.15.122:0/1669411566 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fce9003e910 msgr2=0x7fce90040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:18.673 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.670+0000 7fcea9e63640 1 --2- 172.21.15.122:0/1669411566 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fce9003e910 0x7fce90040e20 crc :-1 s=READY pgs=3809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:18.673 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.670+0000 7fcea9e63640 1 -- 172.21.15.122:0/1669411566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406eab0 msgr2=0x7fcea41241e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:18.673 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.670+0000 7fcea9e63640 1 --2- 172.21.15.122:0/1669411566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406eab0 0x7fcea41241e0 crc :-1 s=READY pgs=12829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:18.673 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.670+0000 7fcea9e63640 1 -- 172.21.15.122:0/1669411566 shutdown_connections 2024-09-15T12:38:18.673 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.670+0000 7fcea9e63640 1 --2- 172.21.15.122:0/1669411566 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fce9003e910 0x7fce90040e20 unknown :-1 s=CLOSED pgs=3809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:18.673 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.670+0000 7fcea9e63640 1 --2- 172.21.15.122:0/1669411566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcea406eab0 0x7fcea41241e0 unknown :-1 s=CLOSED pgs=12829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:18.673 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.670+0000 7fcea9e63640 1 -- 172.21.15.122:0/1669411566 >> 172.21.15.122:0/1669411566 conn(0x7fcea40a43d0 msgr2=0x7fcea411cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:18.673 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.671+0000 7fcea9e63640 1 -- 172.21.15.122:0/1669411566 shutdown_connections 2024-09-15T12:38:18.674 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.671+0000 7fcea9e63640 1 -- 172.21.15.122:0/1669411566 wait complete. 2024-09-15T12:38:18.687 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph osd pool application enable ed9b5ffb-fd10-45e9-a651-fa504ac931a6 rados 2024-09-15T12:38:18.788 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.777+0000 7fe198311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:18.788 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.787+0000 7fe198311640 1 Processor -- start 2024-09-15T12:38:18.789 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.787+0000 7fe198311640 1 -- start start 2024-09-15T12:38:18.791 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.788+0000 7fe198311640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe19006e6e0 0x7fe19006eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:18.791 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.788+0000 7fe198311640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe19006dd50 con 0x7fe190136070 2024-09-15T12:38:18.791 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.788+0000 7fe198311640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fe19006e290 con 0x7fe19006e6e0 2024-09-15T12:38:18.791 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.788+0000 7fe1960ad640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe19006e6e0 0x7fe19006eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:18.791 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.788+0000 7fe1960ad640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe19006e6e0 0x7fe19006eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47736/0 (socket says 172.21.15.122:47736) 2024-09-15T12:38:18.791 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.788+0000 7fe1958ac640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fe190136070 0x7fe190136480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:57876/0 (socket says 172.21.15.122:57876) 2024-09-15T12:38:18.791 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.788+0000 7fe1960ad640 1 -- 172.21.15.122:0/3365209966 learned_addr learned my addr 172.21.15.122:0/3365209966 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:18.791 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.788+0000 7fe1960ad640 1 -- 172.21.15.122:0/3365209966 >> v1:172.21.15.122:6789/0 conn(0x7fe190136070 legacy=0x7fe190136480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:18.792 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.788+0000 7fe1960ad640 1 -- 172.21.15.122:0/3365209966 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19006f590 con 0x7fe19006e6e0 2024-09-15T12:38:18.792 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.788+0000 7fe1950ab640 1 -- 172.21.15.122:0/3365209966 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3002049827 0 0) 0x7fe19006dd50 con 0x7fe190136070 2024-09-15T12:38:18.792 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.788+0000 7fe1960ad640 1 --2- 172.21.15.122:0/3365209966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe19006e6e0 0x7fe19006eaf0 crc :-1 s=READY pgs=12831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54532f5271444271 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:18.792 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.789+0000 7fe1950ab640 1 -- 172.21.15.122:0/3365209966 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe180009e40 con 0x7fe19006e6e0 2024-09-15T12:38:18.792 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.789+0000 7fe1950ab640 1 -- 172.21.15.122:0/3365209966 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe18000e230 con 0x7fe19006e6e0 2024-09-15T12:38:18.792 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.789+0000 7fe1950ab640 1 -- 172.21.15.122:0/3365209966 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe18000e4d0 con 0x7fe19006e6e0 2024-09-15T12:38:18.793 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.789+0000 7fe198311640 1 -- 172.21.15.122:0/3365209966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe19006e6e0 msgr2=0x7fe19006eaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:18.793 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.789+0000 7fe198311640 1 --2- 172.21.15.122:0/3365209966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe19006e6e0 0x7fe19006eaf0 crc :-1 s=READY pgs=12831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:18.793 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.789+0000 7fe198311640 1 -- 172.21.15.122:0/3365209966 shutdown_connections 2024-09-15T12:38:18.794 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.789+0000 7fe198311640 1 --2- 172.21.15.122:0/3365209966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe19006e6e0 0x7fe19006eaf0 unknown :-1 s=CLOSED pgs=12831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:18.794 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.789+0000 7fe198311640 1 -- 172.21.15.122:0/3365209966 >> 172.21.15.122:0/3365209966 conn(0x7fe1900a31b0 msgr2=0x7fe1900a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:18.794 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.789+0000 7fe198311640 1 -- 172.21.15.122:0/3365209966 shutdown_connections 2024-09-15T12:38:18.794 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.789+0000 7fe198311640 1 -- 172.21.15.122:0/3365209966 wait complete. 2024-09-15T12:38:18.794 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.790+0000 7fe198311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:18.794 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.791+0000 7fe198311640 1 Processor -- start 2024-09-15T12:38:18.794 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.791+0000 7fe198311640 1 -- start start 2024-09-15T12:38:18.796 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.792+0000 7fe198311640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe19006e6e0 0x7fe190121e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:18.796 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.792+0000 7fe198311640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe190125e30 con 0x7fe19006e6e0 2024-09-15T12:38:18.796 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.792+0000 7fe1960ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe19006e6e0 0x7fe190121e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:18.796 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.792+0000 7fe1960ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe19006e6e0 0x7fe190121e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47748/0 (socket says 172.21.15.122:47748) 2024-09-15T12:38:18.796 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.792+0000 7fe1960ad640 1 -- 172.21.15.122:0/1220896498 learned_addr learned my addr 172.21.15.122:0/1220896498 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:18.796 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.793+0000 7fe1960ad640 1 -- 172.21.15.122:0/1220896498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1901331d0 con 0x7fe19006e6e0 2024-09-15T12:38:18.796 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.793+0000 7fe1960ad640 1 --2- 172.21.15.122:0/1220896498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe19006e6e0 0x7fe190121e20 crc :-1 s=READY pgs=12832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:18.796 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.793+0000 7fe18effd640 1 -- 172.21.15.122:0/1220896498 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe18000edc0 con 0x7fe19006e6e0 2024-09-15T12:38:18.796 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.793+0000 7fe18effd640 1 -- 172.21.15.122:0/1220896498 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe180015420 con 0x7fe19006e6e0 2024-09-15T12:38:18.796 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.793+0000 7fe198311640 1 -- 172.21.15.122:0/1220896498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1901240b0 con 0x7fe19006e6e0 2024-09-15T12:38:18.796 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.793+0000 7fe18effd640 1 -- 172.21.15.122:0/1220896498 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe1800156c0 con 0x7fe19006e6e0 2024-09-15T12:38:18.797 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.793+0000 7fe198311640 1 -- 172.21.15.122:0/1220896498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe190132b10 con 0x7fe19006e6e0 2024-09-15T12:38:18.797 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.794+0000 7fe198311640 1 -- 172.21.15.122:0/1220896498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe190070290 con 0x7fe19006e6e0 2024-09-15T12:38:18.797 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.794+0000 7fe18effd640 1 -- 172.21.15.122:0/1220896498 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe180015870 con 0x7fe19006e6e0 2024-09-15T12:38:18.797 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.794+0000 7fe18effd640 1 --2- 172.21.15.122:0/1220896498 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fe17c03e930 0x7fe17c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:18.798 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.794+0000 7fe18effd640 1 -- 172.21.15.122:0/1220896498 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(693..693 src has 621..693) ==== 3806+0+0 (crc 0 0 0) 0x7fe180050ef0 con 0x7fe19006e6e0 2024-09-15T12:38:18.798 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.795+0000 7fe1958ac640 1 --2- 172.21.15.122:0/1220896498 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fe17c03e930 0x7fe17c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:18.798 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.795+0000 7fe1958ac640 1 --2- 172.21.15.122:0/1220896498 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fe17c03e930 0x7fe17c040e40 crc :-1 s=READY pgs=3810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:18.801 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.799+0000 7fe18effd640 1 -- 172.21.15.122:0/1220896498 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fe180014c60 con 0x7fe19006e6e0 2024-09-15T12:38:18.976 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:18.974+0000 7fe198311640 1 -- 172.21.15.122:0/1220896498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "app": "rados"} v 0) -- 0x7fe1901331d0 con 0x7fe19006e6e0 2024-09-15T12:38:19.675 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:19.673+0000 7fe18effd640 1 -- 172.21.15.122:0/1220896498 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "app": "rados"}]=0 enabled application 'rados' on pool 'ed9b5ffb-fd10-45e9-a651-fa504ac931a6' v694) ==== 213+0+0 (crc 0 0 0) 0x7fe1901331d0 con 0x7fe19006e6e0 2024-09-15T12:38:19.793 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:19.791+0000 7fe198311640 1 -- 172.21.15.122:0/1220896498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "app": "rados"} v 0) -- 0x7fe1901331d0 con 0x7fe19006e6e0 2024-09-15T12:38:20.681 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.679+0000 7fe18effd640 1 -- 172.21.15.122:0/1220896498 <== mon.0 v2:172.21.15.122:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "app": "rados"}]=0 enabled application 'rados' on pool 'ed9b5ffb-fd10-45e9-a651-fa504ac931a6' v695) ==== 213+0+0 (crc 0 0 0) 0x7fe1901331d0 con 0x7fe19006e6e0 2024-09-15T12:38:20.681 INFO:tasks.workunit.client.0.smithi122.stderr:enabled application 'rados' on pool 'ed9b5ffb-fd10-45e9-a651-fa504ac931a6' 2024-09-15T12:38:20.684 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.682+0000 7fe198311640 1 -- 172.21.15.122:0/1220896498 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fe17c03e930 msgr2=0x7fe17c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.684 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.682+0000 7fe198311640 1 --2- 172.21.15.122:0/1220896498 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fe17c03e930 0x7fe17c040e40 crc :-1 s=READY pgs=3810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.684 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.682+0000 7fe198311640 1 -- 172.21.15.122:0/1220896498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe19006e6e0 msgr2=0x7fe190121e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.685 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.682+0000 7fe198311640 1 --2- 172.21.15.122:0/1220896498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe19006e6e0 0x7fe190121e20 crc :-1 s=READY pgs=12832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.685 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.682+0000 7fe198311640 1 -- 172.21.15.122:0/1220896498 shutdown_connections 2024-09-15T12:38:20.685 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.682+0000 7fe198311640 1 --2- 172.21.15.122:0/1220896498 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fe17c03e930 0x7fe17c040e40 unknown :-1 s=CLOSED pgs=3810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.685 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.682+0000 7fe198311640 1 --2- 172.21.15.122:0/1220896498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe19006e6e0 0x7fe190121e20 unknown :-1 s=CLOSED pgs=12832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.685 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.682+0000 7fe198311640 1 -- 172.21.15.122:0/1220896498 >> 172.21.15.122:0/1220896498 conn(0x7fe1900a31b0 msgr2=0x7fe190133370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:20.685 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.682+0000 7fe198311640 1 -- 172.21.15.122:0/1220896498 shutdown_connections 2024-09-15T12:38:20.685 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.682+0000 7fe198311640 1 -- 172.21.15.122:0/1220896498 wait complete. 2024-09-15T12:38:20.699 INFO:tasks.workunit.client.0.smithi122.stderr:++ seq 1 10 2024-09-15T12:38:20.710 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:38:20.710 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p ed9b5ffb-fd10-45e9-a651-fa504ac931a6 put obj1 /etc/passwd 2024-09-15T12:38:20.748 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.746+0000 7ff399541ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:20.753 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.751+0000 7ff399541ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:20.753 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.751+0000 7ff399541ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:20.753 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.752+0000 7ff399541ec0 1 Processor -- start 2024-09-15T12:38:20.754 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.752+0000 7ff399541ec0 1 -- start start 2024-09-15T12:38:20.755 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.753+0000 7ff399541ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x24609b0 0x24e88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:20.755 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.753+0000 7ff399541ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x2332520 con 0x24609b0 2024-09-15T12:38:20.755 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.753+0000 7ff39199b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x24609b0 0x24e88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:20.756 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.753+0000 7ff39199b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x24609b0 0x24e88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47752/0 (socket says 172.21.15.122:47752) 2024-09-15T12:38:20.756 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.753+0000 7ff39199b640 1 -- 172.21.15.122:0/1902927938 learned_addr learned my addr 172.21.15.122:0/1902927938 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:20.756 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.753+0000 7ff39199b640 1 -- 172.21.15.122:0/1902927938 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x22cee10 con 0x24609b0 2024-09-15T12:38:20.756 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.753+0000 7ff39199b640 1 --2- 172.21.15.122:0/1902927938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x24609b0 0x24e88f0 crc :-1 s=READY pgs=12835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafc3def409e94c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:20.756 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.753+0000 7ff38b7fe640 1 -- 172.21.15.122:0/1902927938 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff37c00c5e0 con 0x24609b0 2024-09-15T12:38:20.756 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.753+0000 7ff38b7fe640 1 -- 172.21.15.122:0/1902927938 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff37c00c740 con 0x24609b0 2024-09-15T12:38:20.756 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.753+0000 7ff38b7fe640 1 -- 172.21.15.122:0/1902927938 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff37c00c9e0 con 0x24609b0 2024-09-15T12:38:20.757 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.754+0000 7ff399541ec0 1 -- 172.21.15.122:0/1902927938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x24609b0 msgr2=0x24e88f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.757 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.754+0000 7ff399541ec0 1 --2- 172.21.15.122:0/1902927938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x24609b0 0x24e88f0 crc :-1 s=READY pgs=12835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.757 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.754+0000 7ff399541ec0 1 -- 172.21.15.122:0/1902927938 shutdown_connections 2024-09-15T12:38:20.757 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.754+0000 7ff399541ec0 1 --2- 172.21.15.122:0/1902927938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x24609b0 0x24e88f0 unknown :-1 s=CLOSED pgs=12835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.757 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.754+0000 7ff399541ec0 1 -- 172.21.15.122:0/1902927938 >> 172.21.15.122:0/1902927938 conn(0x22f2770 msgr2=0x23cb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:20.757 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.754+0000 7ff399541ec0 1 -- 172.21.15.122:0/1902927938 shutdown_connections 2024-09-15T12:38:20.757 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.754+0000 7ff399541ec0 1 -- 172.21.15.122:0/1902927938 wait complete. 2024-09-15T12:38:20.758 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.755+0000 7ff399541ec0 1 Processor -- start 2024-09-15T12:38:20.758 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.755+0000 7ff399541ec0 1 -- start start 2024-09-15T12:38:20.759 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.756+0000 7ff399541ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x24609b0 0x24f7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:20.759 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.756+0000 7ff399541ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x2330280 con 0x24609b0 2024-09-15T12:38:20.759 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.756+0000 7ff39199b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x24609b0 0x24f7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:20.759 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.756+0000 7ff39199b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x24609b0 0x24f7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47766/0 (socket says 172.21.15.122:47766) 2024-09-15T12:38:20.759 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.756+0000 7ff39199b640 1 -- 172.21.15.122:0/2518543662 learned_addr learned my addr 172.21.15.122:0/2518543662 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:20.759 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.756+0000 7ff39199b640 1 -- 172.21.15.122:0/2518543662 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x22c0920 con 0x24609b0 2024-09-15T12:38:20.759 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.756+0000 7ff39199b640 1 --2- 172.21.15.122:0/2518543662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x24609b0 0x24f7a40 crc :-1 s=READY pgs=12836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:20.760 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.757+0000 7ff38a7fc640 1 -- 172.21.15.122:0/2518543662 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff37c0139c0 con 0x24609b0 2024-09-15T12:38:20.760 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.757+0000 7ff38a7fc640 1 -- 172.21.15.122:0/2518543662 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff37c013b20 con 0x24609b0 2024-09-15T12:38:20.760 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.757+0000 7ff399541ec0 1 -- 172.21.15.122:0/2518543662 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x22c0380 con 0x24609b0 2024-09-15T12:38:20.760 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.757+0000 7ff38a7fc640 1 -- 172.21.15.122:0/2518543662 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff37c013dc0 con 0x24609b0 2024-09-15T12:38:20.760 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.757+0000 7ff399541ec0 1 -- 172.21.15.122:0/2518543662 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x23c6220 con 0x24609b0 2024-09-15T12:38:20.761 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.758+0000 7ff38a7fc640 1 -- 172.21.15.122:0/2518543662 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff37c010400 con 0x24609b0 2024-09-15T12:38:20.761 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.758+0000 7ff38a7fc640 1 --2- 172.21.15.122:0/2518543662 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7ff37803d1c0 0x7ff37803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:20.761 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.758+0000 7ff38a7fc640 1 -- 172.21.15.122:0/2518543662 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(695..695 src has 621..695) ==== 3819+0+0 (crc 0 0 0) 0x7ff37c008040 con 0x24609b0 2024-09-15T12:38:20.761 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.758+0000 7ff399541ec0 1 --2- 172.21.15.122:0/2518543662 >> v2:172.21.15.122:6800/2464407069 conn(0x24614d0 0x245f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:20.761 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.758+0000 7ff399541ec0 1 -- 172.21.15.122:0/2518543662 --> v2:172.21.15.122:6800/2464407069 -- osd_op(unknown.0.0:1 199.7 199:ff7b1f36:::obj1:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e695) -- 0x2451540 con 0x24614d0 2024-09-15T12:38:20.761 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.758+0000 7ff39119a640 1 --2- 172.21.15.122:0/2518543662 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7ff37803d1c0 0x7ff37803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:20.761 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.759+0000 7ff39119a640 1 --2- 172.21.15.122:0/2518543662 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7ff37803d1c0 0x7ff37803f6d0 crc :-1 s=READY pgs=3811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:20.761 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.759+0000 7ff39219c640 1 --2- 172.21.15.122:0/2518543662 >> v2:172.21.15.122:6800/2464407069 conn(0x24614d0 0x245f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:38:20.763 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.761+0000 7ff39219c640 1 --2- 172.21.15.122:0/2518543662 >> v2:172.21.15.122:6800/2464407069 conn(0x24614d0 0x245f7d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:20.778 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.775+0000 7ff39219c640 1 -- 172.21.15.122:0/2518543662 <== osd.0 v2:172.21.15.122:6800/2464407069 1 ==== osd_op_reply(1 obj1 [writefull 0~12875] v695'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff38400a430 con 0x24614d0 2024-09-15T12:38:20.778 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.775+0000 7ff399541ec0 1 -- 172.21.15.122:0/2518543662 >> v2:172.21.15.122:6800/2464407069 conn(0x24614d0 msgr2=0x245f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.778 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.775+0000 7ff399541ec0 1 --2- 172.21.15.122:0/2518543662 >> v2:172.21.15.122:6800/2464407069 conn(0x24614d0 0x245f7d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.778 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.776+0000 7ff399541ec0 1 -- 172.21.15.122:0/2518543662 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7ff37803d1c0 msgr2=0x7ff37803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.779 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.776+0000 7ff399541ec0 1 --2- 172.21.15.122:0/2518543662 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7ff37803d1c0 0x7ff37803f6d0 crc :-1 s=READY pgs=3811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.779 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.776+0000 7ff399541ec0 1 -- 172.21.15.122:0/2518543662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x24609b0 msgr2=0x24f7a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.779 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.776+0000 7ff399541ec0 1 --2- 172.21.15.122:0/2518543662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x24609b0 0x24f7a40 crc :-1 s=READY pgs=12836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.779 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.776+0000 7ff399541ec0 1 -- 172.21.15.122:0/2518543662 shutdown_connections 2024-09-15T12:38:20.779 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.776+0000 7ff399541ec0 1 --2- 172.21.15.122:0/2518543662 >> v2:172.21.15.122:6800/2464407069 conn(0x24614d0 0x245f7d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.779 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.776+0000 7ff399541ec0 1 --2- 172.21.15.122:0/2518543662 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7ff37803d1c0 0x7ff37803f6d0 unknown :-1 s=CLOSED pgs=3811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.779 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.776+0000 7ff399541ec0 1 --2- 172.21.15.122:0/2518543662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x24609b0 0x24f7a40 unknown :-1 s=CLOSED pgs=12836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.779 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.776+0000 7ff399541ec0 1 -- 172.21.15.122:0/2518543662 >> 172.21.15.122:0/2518543662 conn(0x22f2770 msgr2=0x23cb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:20.779 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.776+0000 7ff399541ec0 1 -- 172.21.15.122:0/2518543662 shutdown_connections 2024-09-15T12:38:20.779 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.776+0000 7ff399541ec0 1 -- 172.21.15.122:0/2518543662 wait complete. 2024-09-15T12:38:20.781 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:38:20.781 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p ed9b5ffb-fd10-45e9-a651-fa504ac931a6 put obj2 /etc/passwd 2024-09-15T12:38:20.817 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.815+0000 7fc3d8257ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:20.822 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.820+0000 7fc3d8257ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:20.822 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.820+0000 7fc3d8257ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:20.822 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.821+0000 7fc3d8257ec0 1 Processor -- start 2024-09-15T12:38:20.822 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.821+0000 7fc3d8257ec0 1 -- start start 2024-09-15T12:38:20.824 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.822+0000 7fc3d8257ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x10e49b0 0x10cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:20.824 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.822+0000 7fc3d8257ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0xfb6520 con 0x10e49b0 2024-09-15T12:38:20.824 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.822+0000 7fc3cb7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x10e49b0 0x10cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:20.824 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.822+0000 7fc3cb7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x10e49b0 0x10cf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47780/0 (socket says 172.21.15.122:47780) 2024-09-15T12:38:20.825 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.822+0000 7fc3cb7fe640 1 -- 172.21.15.122:0/3274464773 learned_addr learned my addr 172.21.15.122:0/3274464773 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:20.825 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.822+0000 7fc3cb7fe640 1 -- 172.21.15.122:0/3274464773 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xf52e10 con 0x10e49b0 2024-09-15T12:38:20.825 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.822+0000 7fc3cb7fe640 1 --2- 172.21.15.122:0/3274464773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x10e49b0 0x10cf850 crc :-1 s=READY pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba88ffec06a8154 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:20.825 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.822+0000 7fc3ca7fc640 1 -- 172.21.15.122:0/3274464773 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3bc00c490 con 0x10e49b0 2024-09-15T12:38:20.825 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.822+0000 7fc3ca7fc640 1 -- 172.21.15.122:0/3274464773 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc3bc00c5f0 con 0x10e49b0 2024-09-15T12:38:20.825 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.822+0000 7fc3ca7fc640 1 -- 172.21.15.122:0/3274464773 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3bc00c890 con 0x10e49b0 2024-09-15T12:38:20.826 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.823+0000 7fc3d8257ec0 1 -- 172.21.15.122:0/3274464773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x10e49b0 msgr2=0x10cf850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.826 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.823+0000 7fc3d8257ec0 1 --2- 172.21.15.122:0/3274464773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x10e49b0 0x10cf850 crc :-1 s=READY pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.826 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.823+0000 7fc3d8257ec0 1 -- 172.21.15.122:0/3274464773 shutdown_connections 2024-09-15T12:38:20.826 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.823+0000 7fc3d8257ec0 1 --2- 172.21.15.122:0/3274464773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x10e49b0 0x10cf850 unknown :-1 s=CLOSED pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.826 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.823+0000 7fc3d8257ec0 1 -- 172.21.15.122:0/3274464773 >> 172.21.15.122:0/3274464773 conn(0xf76770 msgr2=0x10559b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:20.826 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.823+0000 7fc3d8257ec0 1 -- 172.21.15.122:0/3274464773 shutdown_connections 2024-09-15T12:38:20.826 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.823+0000 7fc3d8257ec0 1 -- 172.21.15.122:0/3274464773 wait complete. 2024-09-15T12:38:20.826 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.824+0000 7fc3d8257ec0 1 Processor -- start 2024-09-15T12:38:20.827 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.824+0000 7fc3d8257ec0 1 -- start start 2024-09-15T12:38:20.828 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.825+0000 7fc3d8257ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x10e49b0 0x10d2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:20.828 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.825+0000 7fc3d8257ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0xfb4280 con 0x10e49b0 2024-09-15T12:38:20.828 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.825+0000 7fc3cb7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x10e49b0 0x10d2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:20.828 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.825+0000 7fc3cb7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x10e49b0 0x10d2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47796/0 (socket says 172.21.15.122:47796) 2024-09-15T12:38:20.828 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.825+0000 7fc3cb7fe640 1 -- 172.21.15.122:0/3858018910 learned_addr learned my addr 172.21.15.122:0/3858018910 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:20.828 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.825+0000 7fc3cb7fe640 1 -- 172.21.15.122:0/3858018910 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xf44920 con 0x10e49b0 2024-09-15T12:38:20.828 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.825+0000 7fc3cb7fe640 1 --2- 172.21.15.122:0/3858018910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x10e49b0 0x10d2d50 crc :-1 s=READY pgs=12840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:20.829 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.825+0000 7fc3c97fa640 1 -- 172.21.15.122:0/3858018910 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3bc0111e0 con 0x10e49b0 2024-09-15T12:38:20.829 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.825+0000 7fc3c97fa640 1 -- 172.21.15.122:0/3858018910 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc3bc011a00 con 0x10e49b0 2024-09-15T12:38:20.829 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.825+0000 7fc3d8257ec0 1 -- 172.21.15.122:0/3858018910 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xf44380 con 0x10e49b0 2024-09-15T12:38:20.829 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.825+0000 7fc3c97fa640 1 -- 172.21.15.122:0/3858018910 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3bc011b70 con 0x10e49b0 2024-09-15T12:38:20.829 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.825+0000 7fc3d8257ec0 1 -- 172.21.15.122:0/3858018910 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x10d61e0 con 0x10e49b0 2024-09-15T12:38:20.829 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.826+0000 7fc3c97fa640 1 -- 172.21.15.122:0/3858018910 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc3bc011d20 con 0x10e49b0 2024-09-15T12:38:20.830 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.827+0000 7fc3c97fa640 1 --2- 172.21.15.122:0/3858018910 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc3ac03d1c0 0x7fc3ac03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:20.830 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.827+0000 7fc3c97fa640 1 -- 172.21.15.122:0/3858018910 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(695..695 src has 621..695) ==== 3819+0+0 (crc 0 0 0) 0x7fc3bc050220 con 0x10e49b0 2024-09-15T12:38:20.830 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.827+0000 7fc3d8257ec0 1 --2- 172.21.15.122:0/3858018910 >> v2:172.21.15.142:6811/2150609480 conn(0x10e54d0 0x157da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:20.830 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.827+0000 7fc3d8257ec0 1 -- 172.21.15.122:0/3858018910 --> v2:172.21.15.142:6811/2150609480 -- osd_op(unknown.0.0:1 199.8 199:104778fc:::obj2:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e695) -- 0x10d6770 con 0x10e54d0 2024-09-15T12:38:20.830 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.827+0000 7fc3c3fff640 1 --2- 172.21.15.122:0/3858018910 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc3ac03d1c0 0x7fc3ac03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:20.830 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.827+0000 7fc3c3fff640 1 --2- 172.21.15.122:0/3858018910 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc3ac03d1c0 0x7fc3ac03f6d0 crc :-1 s=READY pgs=3812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:20.830 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.828+0000 7fc3cbfff640 1 --2- 172.21.15.122:0/3858018910 >> v2:172.21.15.142:6811/2150609480 conn(0x10e54d0 0x157da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:38:20.833 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.832+0000 7fc3cbfff640 1 --2- 172.21.15.122:0/3858018910 >> v2:172.21.15.142:6811/2150609480 conn(0x10e54d0 0x157da00 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:20.848 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.846+0000 7fc3cbfff640 1 -- 172.21.15.122:0/3858018910 <== osd.3 v2:172.21.15.142:6811/2150609480 1 ==== osd_op_reply(1 obj2 [writefull 0~12875] v695'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc3c400a430 con 0x10e54d0 2024-09-15T12:38:20.848 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.846+0000 7fc3d8257ec0 1 -- 172.21.15.122:0/3858018910 >> v2:172.21.15.142:6811/2150609480 conn(0x10e54d0 msgr2=0x157da00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.848 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.846+0000 7fc3d8257ec0 1 --2- 172.21.15.122:0/3858018910 >> v2:172.21.15.142:6811/2150609480 conn(0x10e54d0 0x157da00 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.849 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.846+0000 7fc3d8257ec0 1 -- 172.21.15.122:0/3858018910 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc3ac03d1c0 msgr2=0x7fc3ac03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.849 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.846+0000 7fc3d8257ec0 1 --2- 172.21.15.122:0/3858018910 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc3ac03d1c0 0x7fc3ac03f6d0 crc :-1 s=READY pgs=3812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.849 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.846+0000 7fc3d8257ec0 1 -- 172.21.15.122:0/3858018910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x10e49b0 msgr2=0x10d2d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.849 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.846+0000 7fc3d8257ec0 1 --2- 172.21.15.122:0/3858018910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x10e49b0 0x10d2d50 crc :-1 s=READY pgs=12840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.849 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.846+0000 7fc3d8257ec0 1 -- 172.21.15.122:0/3858018910 shutdown_connections 2024-09-15T12:38:20.849 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.846+0000 7fc3d8257ec0 1 --2- 172.21.15.122:0/3858018910 >> v2:172.21.15.142:6811/2150609480 conn(0x10e54d0 0x157da00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.849 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.846+0000 7fc3d8257ec0 1 --2- 172.21.15.122:0/3858018910 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc3ac03d1c0 0x7fc3ac03f6d0 unknown :-1 s=CLOSED pgs=3812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.849 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.846+0000 7fc3d8257ec0 1 --2- 172.21.15.122:0/3858018910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x10e49b0 0x10d2d50 unknown :-1 s=CLOSED pgs=12840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.849 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.846+0000 7fc3d8257ec0 1 -- 172.21.15.122:0/3858018910 >> 172.21.15.122:0/3858018910 conn(0xf76770 msgr2=0x104f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:20.849 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.846+0000 7fc3d8257ec0 1 -- 172.21.15.122:0/3858018910 shutdown_connections 2024-09-15T12:38:20.849 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.846+0000 7fc3d8257ec0 1 -- 172.21.15.122:0/3858018910 wait complete. 2024-09-15T12:38:20.850 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:38:20.850 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p ed9b5ffb-fd10-45e9-a651-fa504ac931a6 put obj3 /etc/passwd 2024-09-15T12:38:20.886 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.884+0000 7efdbc0edec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:20.891 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.889+0000 7efdbc0edec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:20.891 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.890+0000 7efdbc0edec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:20.892 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.890+0000 7efdbc0edec0 1 Processor -- start 2024-09-15T12:38:20.892 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.890+0000 7efdbc0edec0 1 -- start start 2024-09-15T12:38:20.894 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.891+0000 7efdbc0edec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x22589b0 0x21c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:20.895 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.891+0000 7efdbc0edec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x212a520 con 0x22589b0 2024-09-15T12:38:20.895 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.891+0000 7efdaf7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x22589b0 0x21c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:20.895 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.891+0000 7efdaf7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x22589b0 0x21c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47822/0 (socket says 172.21.15.122:47822) 2024-09-15T12:38:20.895 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.891+0000 7efdaf7fe640 1 -- 172.21.15.122:0/1177489263 learned_addr learned my addr 172.21.15.122:0/1177489263 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:20.895 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.892+0000 7efdaf7fe640 1 -- 172.21.15.122:0/1177489263 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x20c6e10 con 0x22589b0 2024-09-15T12:38:20.895 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.892+0000 7efdaf7fe640 1 --2- 172.21.15.122:0/1177489263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x22589b0 0x21c99b0 crc :-1 s=READY pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb8bd172c2c2afb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:20.895 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.892+0000 7efdae7fc640 1 -- 172.21.15.122:0/1177489263 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efda000b580 con 0x22589b0 2024-09-15T12:38:20.895 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.892+0000 7efdae7fc640 1 -- 172.21.15.122:0/1177489263 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efda000b6e0 con 0x22589b0 2024-09-15T12:38:20.895 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.892+0000 7efdae7fc640 1 -- 172.21.15.122:0/1177489263 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efda000b980 con 0x22589b0 2024-09-15T12:38:20.895 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.892+0000 7efdbc0edec0 1 -- 172.21.15.122:0/1177489263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x22589b0 msgr2=0x21c99b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.895 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.892+0000 7efdbc0edec0 1 --2- 172.21.15.122:0/1177489263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x22589b0 0x21c99b0 crc :-1 s=READY pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.896 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.893+0000 7efdbc0edec0 1 -- 172.21.15.122:0/1177489263 shutdown_connections 2024-09-15T12:38:20.896 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.893+0000 7efdbc0edec0 1 --2- 172.21.15.122:0/1177489263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x22589b0 0x21c99b0 unknown :-1 s=CLOSED pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.896 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.893+0000 7efdbc0edec0 1 -- 172.21.15.122:0/1177489263 >> 172.21.15.122:0/1177489263 conn(0x20ea770 msgr2=0x21c1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:20.896 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.893+0000 7efdbc0edec0 1 -- 172.21.15.122:0/1177489263 shutdown_connections 2024-09-15T12:38:20.896 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.893+0000 7efdbc0edec0 1 -- 172.21.15.122:0/1177489263 wait complete. 2024-09-15T12:38:20.897 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.893+0000 7efdbc0edec0 1 Processor -- start 2024-09-15T12:38:20.897 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.893+0000 7efdbc0edec0 1 -- start start 2024-09-15T12:38:20.898 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.894+0000 7efdbc0edec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x22589b0 0x2244e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:20.898 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.894+0000 7efdbc0edec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x2128280 con 0x22589b0 2024-09-15T12:38:20.898 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.894+0000 7efdaf7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x22589b0 0x2244e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:20.898 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.894+0000 7efdaf7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x22589b0 0x2244e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47830/0 (socket says 172.21.15.122:47830) 2024-09-15T12:38:20.898 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.894+0000 7efdaf7fe640 1 -- 172.21.15.122:0/284969902 learned_addr learned my addr 172.21.15.122:0/284969902 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:20.898 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.895+0000 7efdaf7fe640 1 -- 172.21.15.122:0/284969902 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x20b8920 con 0x22589b0 2024-09-15T12:38:20.898 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.895+0000 7efdaf7fe640 1 --2- 172.21.15.122:0/284969902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x22589b0 0x2244e70 crc :-1 s=READY pgs=12844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:20.898 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.895+0000 7efdad7fa640 1 -- 172.21.15.122:0/284969902 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efda00129c0 con 0x22589b0 2024-09-15T12:38:20.898 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.895+0000 7efdad7fa640 1 -- 172.21.15.122:0/284969902 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efda0005040 con 0x22589b0 2024-09-15T12:38:20.898 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.895+0000 7efdbc0edec0 1 -- 172.21.15.122:0/284969902 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x20b8380 con 0x22589b0 2024-09-15T12:38:20.898 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.895+0000 7efdad7fa640 1 -- 172.21.15.122:0/284969902 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efda0012c50 con 0x22589b0 2024-09-15T12:38:20.898 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.895+0000 7efdbc0edec0 1 -- 172.21.15.122:0/284969902 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2245e00 con 0x22589b0 2024-09-15T12:38:20.899 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.896+0000 7efdad7fa640 1 -- 172.21.15.122:0/284969902 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7efda000d040 con 0x22589b0 2024-09-15T12:38:20.900 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.896+0000 7efdad7fa640 1 --2- 172.21.15.122:0/284969902 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efd9003d1c0 0x7efd9003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:20.900 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.896+0000 7efdad7fa640 1 -- 172.21.15.122:0/284969902 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(695..695 src has 621..695) ==== 3819+0+0 (crc 0 0 0) 0x7efda000a040 con 0x22589b0 2024-09-15T12:38:20.900 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.897+0000 7efdbc0edec0 1 --2- 172.21.15.122:0/284969902 >> v2:172.21.15.122:6800/2464407069 conn(0x22594d0 0x22edcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:20.900 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.897+0000 7efdbc0edec0 1 -- 172.21.15.122:0/284969902 --> v2:172.21.15.122:6800/2464407069 -- osd_op(unknown.0.0:1 199.1 199:8dd16f86:::obj3:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e695) -- 0x22476f0 con 0x22594d0 2024-09-15T12:38:20.900 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.897+0000 7efda6ffd640 1 --2- 172.21.15.122:0/284969902 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efd9003d1c0 0x7efd9003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:20.900 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.897+0000 7efda6ffd640 1 --2- 172.21.15.122:0/284969902 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efd9003d1c0 0x7efd9003f6d0 crc :-1 s=READY pgs=3813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:20.900 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.897+0000 7efdb4d9c640 1 --2- 172.21.15.122:0/284969902 >> v2:172.21.15.122:6800/2464407069 conn(0x22594d0 0x22edcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:38:20.903 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.901+0000 7efdb4d9c640 1 --2- 172.21.15.122:0/284969902 >> v2:172.21.15.122:6800/2464407069 conn(0x22594d0 0x22edcf0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:20.918 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.915+0000 7efdb4d9c640 1 -- 172.21.15.122:0/284969902 <== osd.0 v2:172.21.15.122:6800/2464407069 1 ==== osd_op_reply(1 obj3 [writefull 0~12875] v695'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7efda800a430 con 0x22594d0 2024-09-15T12:38:20.918 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.916+0000 7efdbc0edec0 1 -- 172.21.15.122:0/284969902 >> v2:172.21.15.122:6800/2464407069 conn(0x22594d0 msgr2=0x22edcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.918 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.916+0000 7efdbc0edec0 1 --2- 172.21.15.122:0/284969902 >> v2:172.21.15.122:6800/2464407069 conn(0x22594d0 0x22edcf0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.919 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.916+0000 7efdbc0edec0 1 -- 172.21.15.122:0/284969902 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efd9003d1c0 msgr2=0x7efd9003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.919 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.916+0000 7efdbc0edec0 1 --2- 172.21.15.122:0/284969902 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efd9003d1c0 0x7efd9003f6d0 crc :-1 s=READY pgs=3813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.919 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.916+0000 7efdbc0edec0 1 -- 172.21.15.122:0/284969902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x22589b0 msgr2=0x2244e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.919 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.916+0000 7efdbc0edec0 1 --2- 172.21.15.122:0/284969902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x22589b0 0x2244e70 crc :-1 s=READY pgs=12844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.919 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.916+0000 7efdbc0edec0 1 -- 172.21.15.122:0/284969902 shutdown_connections 2024-09-15T12:38:20.919 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.916+0000 7efdbc0edec0 1 --2- 172.21.15.122:0/284969902 >> v2:172.21.15.122:6800/2464407069 conn(0x22594d0 0x22edcf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.919 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.916+0000 7efdbc0edec0 1 --2- 172.21.15.122:0/284969902 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efd9003d1c0 0x7efd9003f6d0 unknown :-1 s=CLOSED pgs=3813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.919 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.916+0000 7efdbc0edec0 1 --2- 172.21.15.122:0/284969902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x22589b0 0x2244e70 unknown :-1 s=CLOSED pgs=12844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.919 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.916+0000 7efdbc0edec0 1 -- 172.21.15.122:0/284969902 >> 172.21.15.122:0/284969902 conn(0x20ea770 msgr2=0x21c1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:20.919 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.916+0000 7efdbc0edec0 1 -- 172.21.15.122:0/284969902 shutdown_connections 2024-09-15T12:38:20.919 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.916+0000 7efdbc0edec0 1 -- 172.21.15.122:0/284969902 wait complete. 2024-09-15T12:38:20.920 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:38:20.921 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p ed9b5ffb-fd10-45e9-a651-fa504ac931a6 put obj4 /etc/passwd 2024-09-15T12:38:20.957 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.955+0000 7f4aced32ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:20.962 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.960+0000 7f4aced32ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:20.962 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.960+0000 7f4aced32ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:20.963 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.961+0000 7f4aced32ec0 1 Processor -- start 2024-09-15T12:38:20.963 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.961+0000 7f4aced32ec0 1 -- start start 2024-09-15T12:38:20.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.962+0000 7f4aced32ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbad9b0 0xc358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:20.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.962+0000 7f4aced32ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0xa7f520 con 0xbad9b0 2024-09-15T12:38:20.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.962+0000 7f4ac703f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbad9b0 0xc358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:20.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.962+0000 7f4ac703f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbad9b0 0xc358f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47846/0 (socket says 172.21.15.122:47846) 2024-09-15T12:38:20.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.962+0000 7f4ac703f640 1 -- 172.21.15.122:0/3872623951 learned_addr learned my addr 172.21.15.122:0/3872623951 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:20.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.962+0000 7f4ac703f640 1 -- 172.21.15.122:0/3872623951 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xa1be10 con 0xbad9b0 2024-09-15T12:38:20.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.963+0000 7f4ac703f640 1 --2- 172.21.15.122:0/3872623951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbad9b0 0xc358f0 crc :-1 s=READY pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25a59faea2c89c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:20.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.963+0000 7f4ac583c640 1 -- 172.21.15.122:0/3872623951 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4ab000c5e0 con 0xbad9b0 2024-09-15T12:38:20.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.963+0000 7f4ac583c640 1 -- 172.21.15.122:0/3872623951 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4ab000c740 con 0xbad9b0 2024-09-15T12:38:20.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.963+0000 7f4ac583c640 1 -- 172.21.15.122:0/3872623951 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4ab000c9e0 con 0xbad9b0 2024-09-15T12:38:20.966 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.964+0000 7f4aced32ec0 1 -- 172.21.15.122:0/3872623951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbad9b0 msgr2=0xc358f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.966 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.964+0000 7f4aced32ec0 1 --2- 172.21.15.122:0/3872623951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbad9b0 0xc358f0 crc :-1 s=READY pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.967 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.964+0000 7f4aced32ec0 1 -- 172.21.15.122:0/3872623951 shutdown_connections 2024-09-15T12:38:20.967 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.964+0000 7f4aced32ec0 1 --2- 172.21.15.122:0/3872623951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbad9b0 0xc358f0 unknown :-1 s=CLOSED pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.967 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.964+0000 7f4aced32ec0 1 -- 172.21.15.122:0/3872623951 >> 172.21.15.122:0/3872623951 conn(0xa3f770 msgr2=0xb182b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:20.967 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.964+0000 7f4aced32ec0 1 -- 172.21.15.122:0/3872623951 shutdown_connections 2024-09-15T12:38:20.967 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.964+0000 7f4aced32ec0 1 -- 172.21.15.122:0/3872623951 wait complete. 2024-09-15T12:38:20.967 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.964+0000 7f4aced32ec0 1 Processor -- start 2024-09-15T12:38:20.967 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.965+0000 7f4aced32ec0 1 -- start start 2024-09-15T12:38:20.968 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.965+0000 7f4aced32ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbad9b0 0xc42880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:20.968 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.965+0000 7f4aced32ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0xa7d280 con 0xbad9b0 2024-09-15T12:38:20.969 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.966+0000 7f4ac703f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbad9b0 0xc42880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:20.969 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.966+0000 7f4ac703f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbad9b0 0xc42880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47862/0 (socket says 172.21.15.122:47862) 2024-09-15T12:38:20.969 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.966+0000 7f4ac703f640 1 -- 172.21.15.122:0/2508891623 learned_addr learned my addr 172.21.15.122:0/2508891623 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:20.969 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.966+0000 7f4ac703f640 1 -- 172.21.15.122:0/2508891623 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xa0d920 con 0xbad9b0 2024-09-15T12:38:20.969 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.966+0000 7f4ac703f640 1 --2- 172.21.15.122:0/2508891623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbad9b0 0xc42880 crc :-1 s=READY pgs=12848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:20.969 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.966+0000 7f4ac483a640 1 -- 172.21.15.122:0/2508891623 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4ab00139c0 con 0xbad9b0 2024-09-15T12:38:20.969 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.966+0000 7f4ac483a640 1 -- 172.21.15.122:0/2508891623 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4ab0013b20 con 0xbad9b0 2024-09-15T12:38:20.969 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.966+0000 7f4aced32ec0 1 -- 172.21.15.122:0/2508891623 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xa0d380 con 0xbad9b0 2024-09-15T12:38:20.969 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.966+0000 7f4ac483a640 1 -- 172.21.15.122:0/2508891623 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4ab0013dc0 con 0xbad9b0 2024-09-15T12:38:20.969 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.966+0000 7f4aced32ec0 1 -- 172.21.15.122:0/2508891623 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0xbad520 con 0xbad9b0 2024-09-15T12:38:20.970 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.967+0000 7f4ac483a640 1 -- 172.21.15.122:0/2508891623 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4ab0010400 con 0xbad9b0 2024-09-15T12:38:20.970 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.967+0000 7f4ac483a640 1 --2- 172.21.15.122:0/2508891623 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4aac03d1c0 0x7f4aac03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:20.970 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.967+0000 7f4ac483a640 1 -- 172.21.15.122:0/2508891623 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(695..695 src has 621..695) ==== 3819+0+0 (crc 0 0 0) 0x7f4ab0008040 con 0xbad9b0 2024-09-15T12:38:20.971 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.968+0000 7f4aced32ec0 1 --2- 172.21.15.122:0/2508891623 >> v2:172.21.15.122:6803/3904627990 conn(0xbae4d0 0xbac460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:20.971 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.968+0000 7f4aced32ec0 1 -- 172.21.15.122:0/2508891623 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:1 199.0 199:0ee9ae15:::obj4:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e695) -- 0xb9caf0 con 0xbae4d0 2024-09-15T12:38:20.971 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.968+0000 7f4ac683e640 1 --2- 172.21.15.122:0/2508891623 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4aac03d1c0 0x7f4aac03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:20.971 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.968+0000 7f4ac683e640 1 --2- 172.21.15.122:0/2508891623 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4aac03d1c0 0x7f4aac03f6d0 crc :-1 s=READY pgs=3814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:20.971 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.968+0000 7f4ac7840640 1 --2- 172.21.15.122:0/2508891623 >> v2:172.21.15.122:6803/3904627990 conn(0xbae4d0 0xbac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:38:20.973 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.972+0000 7f4ac7840640 1 --2- 172.21.15.122:0/2508891623 >> v2:172.21.15.122:6803/3904627990 conn(0xbae4d0 0xbac460 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:20.987 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.985+0000 7f4ac7840640 1 -- 172.21.15.122:0/2508891623 <== osd.1 v2:172.21.15.122:6803/3904627990 1 ==== osd_op_reply(1 obj4 [writefull 0~12875] v695'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4ab800a430 con 0xbae4d0 2024-09-15T12:38:20.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.985+0000 7f4aced32ec0 1 -- 172.21.15.122:0/2508891623 >> v2:172.21.15.122:6803/3904627990 conn(0xbae4d0 msgr2=0xbac460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.985+0000 7f4aced32ec0 1 --2- 172.21.15.122:0/2508891623 >> v2:172.21.15.122:6803/3904627990 conn(0xbae4d0 0xbac460 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.985+0000 7f4aced32ec0 1 -- 172.21.15.122:0/2508891623 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4aac03d1c0 msgr2=0x7f4aac03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.985+0000 7f4aced32ec0 1 --2- 172.21.15.122:0/2508891623 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4aac03d1c0 0x7f4aac03f6d0 crc :-1 s=READY pgs=3814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.985+0000 7f4aced32ec0 1 -- 172.21.15.122:0/2508891623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbad9b0 msgr2=0xc42880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:20.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.985+0000 7f4aced32ec0 1 --2- 172.21.15.122:0/2508891623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbad9b0 0xc42880 crc :-1 s=READY pgs=12848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.985+0000 7f4aced32ec0 1 -- 172.21.15.122:0/2508891623 shutdown_connections 2024-09-15T12:38:20.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.985+0000 7f4aced32ec0 1 --2- 172.21.15.122:0/2508891623 >> v2:172.21.15.122:6803/3904627990 conn(0xbae4d0 0xbac460 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.985+0000 7f4aced32ec0 1 --2- 172.21.15.122:0/2508891623 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4aac03d1c0 0x7f4aac03f6d0 unknown :-1 s=CLOSED pgs=3814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.985+0000 7f4aced32ec0 1 --2- 172.21.15.122:0/2508891623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbad9b0 0xc42880 unknown :-1 s=CLOSED pgs=12848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:20.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.985+0000 7f4aced32ec0 1 -- 172.21.15.122:0/2508891623 >> 172.21.15.122:0/2508891623 conn(0xa3f770 msgr2=0xb182b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:20.989 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.985+0000 7f4aced32ec0 1 -- 172.21.15.122:0/2508891623 shutdown_connections 2024-09-15T12:38:20.989 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:20.985+0000 7f4aced32ec0 1 -- 172.21.15.122:0/2508891623 wait complete. 2024-09-15T12:38:20.993 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:38:20.993 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p ed9b5ffb-fd10-45e9-a651-fa504ac931a6 put obj5 /etc/passwd 2024-09-15T12:38:21.026 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.024+0000 7f6935432ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.031 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.029+0000 7f6935432ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.031 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.029+0000 7f6935432ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.031 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.030+0000 7f6935432ec0 1 Processor -- start 2024-09-15T12:38:21.031 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.030+0000 7f6935432ec0 1 -- start start 2024-09-15T12:38:21.033 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.031+0000 7f6935432ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x2125050 0x2127c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.033 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.031+0000 7f6935432ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x2092520 con 0x2125050 2024-09-15T12:38:21.033 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.031+0000 7f692d59b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x2125050 0x2127c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.033 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.031+0000 7f692d59b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x2125050 0x2127c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47870/0 (socket says 172.21.15.122:47870) 2024-09-15T12:38:21.033 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.031+0000 7f692d59b640 1 -- 172.21.15.122:0/712953450 learned_addr learned my addr 172.21.15.122:0/712953450 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:21.034 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.031+0000 7f692d59b640 1 -- 172.21.15.122:0/712953450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x202ee10 con 0x2125050 2024-09-15T12:38:21.034 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.031+0000 7f692d59b640 1 --2- 172.21.15.122:0/712953450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x2125050 0x2127c10 crc :-1 s=READY pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34939760b9211e45 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.034 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.031+0000 7f6926ffd640 1 -- 172.21.15.122:0/712953450 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f692002d960 con 0x2125050 2024-09-15T12:38:21.034 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.031+0000 7f6926ffd640 1 -- 172.21.15.122:0/712953450 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f692002db60 con 0x2125050 2024-09-15T12:38:21.034 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.031+0000 7f6926ffd640 1 -- 172.21.15.122:0/712953450 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f692002de00 con 0x2125050 2024-09-15T12:38:21.035 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.032+0000 7f6935432ec0 1 -- 172.21.15.122:0/712953450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x2125050 msgr2=0x2127c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.035 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.032+0000 7f6935432ec0 1 --2- 172.21.15.122:0/712953450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x2125050 0x2127c10 crc :-1 s=READY pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.035 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.032+0000 7f6935432ec0 1 -- 172.21.15.122:0/712953450 shutdown_connections 2024-09-15T12:38:21.035 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.032+0000 7f6935432ec0 1 --2- 172.21.15.122:0/712953450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x2125050 0x2127c10 unknown :-1 s=CLOSED pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.035 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.032+0000 7f6935432ec0 1 -- 172.21.15.122:0/712953450 >> 172.21.15.122:0/712953450 conn(0x2052770 msgr2=0x21c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:21.035 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.032+0000 7f6935432ec0 1 -- 172.21.15.122:0/712953450 shutdown_connections 2024-09-15T12:38:21.035 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.032+0000 7f6935432ec0 1 -- 172.21.15.122:0/712953450 wait complete. 2024-09-15T12:38:21.035 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.033+0000 7f6935432ec0 1 Processor -- start 2024-09-15T12:38:21.035 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.033+0000 7f6935432ec0 1 -- start start 2024-09-15T12:38:21.037 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.034+0000 7f6935432ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x2125050 0x2255810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.037 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.034+0000 7f6935432ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x2090280 con 0x2125050 2024-09-15T12:38:21.037 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.034+0000 7f692d59b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x2125050 0x2255810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.037 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.034+0000 7f692d59b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x2125050 0x2255810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47872/0 (socket says 172.21.15.122:47872) 2024-09-15T12:38:21.037 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.034+0000 7f692d59b640 1 -- 172.21.15.122:0/2079766103 learned_addr learned my addr 172.21.15.122:0/2079766103 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:21.037 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.034+0000 7f692d59b640 1 -- 172.21.15.122:0/2079766103 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2020920 con 0x2125050 2024-09-15T12:38:21.037 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.034+0000 7f692d59b640 1 --2- 172.21.15.122:0/2079766103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x2125050 0x2255810 crc :-1 s=READY pgs=12852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.037 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.034+0000 7f6925ffb640 1 -- 172.21.15.122:0/2079766103 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f692002d960 con 0x2125050 2024-09-15T12:38:21.037 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.034+0000 7f6925ffb640 1 -- 172.21.15.122:0/2079766103 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f692002dcd0 con 0x2125050 2024-09-15T12:38:21.037 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.034+0000 7f6935432ec0 1 -- 172.21.15.122:0/2079766103 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2020380 con 0x2125050 2024-09-15T12:38:21.037 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.034+0000 7f6925ffb640 1 -- 172.21.15.122:0/2079766103 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6920038af0 con 0x2125050 2024-09-15T12:38:21.038 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.034+0000 7f6935432ec0 1 -- 172.21.15.122:0/2079766103 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x21c65f0 con 0x2125050 2024-09-15T12:38:21.039 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.035+0000 7f6925ffb640 1 -- 172.21.15.122:0/2079766103 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6920003040 con 0x2125050 2024-09-15T12:38:21.039 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.036+0000 7f6925ffb640 1 --2- 172.21.15.122:0/2079766103 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f690803d1c0 0x7f690803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.039 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.036+0000 7f6925ffb640 1 -- 172.21.15.122:0/2079766103 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(695..695 src has 621..695) ==== 3819+0+0 (crc 0 0 0) 0x7f692003e040 con 0x2125050 2024-09-15T12:38:21.039 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.036+0000 7f6935432ec0 1 --2- 172.21.15.122:0/2079766103 >> v2:172.21.15.142:6811/2150609480 conn(0x21bc3a0 0x21c0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.039 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.036+0000 7f6935432ec0 1 -- 172.21.15.122:0/2079766103 --> v2:172.21.15.142:6811/2150609480 -- osd_op(unknown.0.0:1 199.3 199:c52c9666:::obj5:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e695) -- 0x21c2e10 con 0x21bc3a0 2024-09-15T12:38:21.039 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.036+0000 7f692cd9a640 1 --2- 172.21.15.122:0/2079766103 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f690803d1c0 0x7f690803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.039 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.036+0000 7f692cd9a640 1 --2- 172.21.15.122:0/2079766103 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f690803d1c0 0x7f690803f6d0 crc :-1 s=READY pgs=3815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.039 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.037+0000 7f692dd9c640 1 --2- 172.21.15.122:0/2079766103 >> v2:172.21.15.142:6811/2150609480 conn(0x21bc3a0 0x21c0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:38:21.042 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.040+0000 7f692dd9c640 1 --2- 172.21.15.122:0/2079766103 >> v2:172.21.15.142:6811/2150609480 conn(0x21bc3a0 0x21c0600 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.058 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.055+0000 7f692dd9c640 1 -- 172.21.15.122:0/2079766103 <== osd.3 v2:172.21.15.142:6811/2150609480 1 ==== osd_op_reply(1 obj5 [writefull 0~12875] v695'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f691800c430 con 0x21bc3a0 2024-09-15T12:38:21.058 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.055+0000 7f6935432ec0 1 -- 172.21.15.122:0/2079766103 >> v2:172.21.15.142:6811/2150609480 conn(0x21bc3a0 msgr2=0x21c0600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.058 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.055+0000 7f6935432ec0 1 --2- 172.21.15.122:0/2079766103 >> v2:172.21.15.142:6811/2150609480 conn(0x21bc3a0 0x21c0600 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.058 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.055+0000 7f6935432ec0 1 -- 172.21.15.122:0/2079766103 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f690803d1c0 msgr2=0x7f690803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.058 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.055+0000 7f6935432ec0 1 --2- 172.21.15.122:0/2079766103 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f690803d1c0 0x7f690803f6d0 crc :-1 s=READY pgs=3815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.058 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.055+0000 7f6935432ec0 1 -- 172.21.15.122:0/2079766103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x2125050 msgr2=0x2255810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.058 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.055+0000 7f6935432ec0 1 --2- 172.21.15.122:0/2079766103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x2125050 0x2255810 crc :-1 s=READY pgs=12852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.058 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.055+0000 7f6935432ec0 1 -- 172.21.15.122:0/2079766103 shutdown_connections 2024-09-15T12:38:21.058 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.055+0000 7f6935432ec0 1 --2- 172.21.15.122:0/2079766103 >> v2:172.21.15.142:6811/2150609480 conn(0x21bc3a0 0x21c0600 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.059 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.055+0000 7f6935432ec0 1 --2- 172.21.15.122:0/2079766103 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f690803d1c0 0x7f690803f6d0 unknown :-1 s=CLOSED pgs=3815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.059 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.055+0000 7f6935432ec0 1 --2- 172.21.15.122:0/2079766103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x2125050 0x2255810 unknown :-1 s=CLOSED pgs=12852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.059 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.055+0000 7f6935432ec0 1 -- 172.21.15.122:0/2079766103 >> 172.21.15.122:0/2079766103 conn(0x2052770 msgr2=0x21c5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:21.059 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.055+0000 7f6935432ec0 1 -- 172.21.15.122:0/2079766103 shutdown_connections 2024-09-15T12:38:21.059 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.055+0000 7f6935432ec0 1 -- 172.21.15.122:0/2079766103 wait complete. 2024-09-15T12:38:21.059 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:38:21.060 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p ed9b5ffb-fd10-45e9-a651-fa504ac931a6 put obj6 /etc/passwd 2024-09-15T12:38:21.095 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.094+0000 7f4c8e634ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.101 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.099+0000 7f4c8e634ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.101 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.099+0000 7f4c8e634ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.101 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.099+0000 7f4c8e634ec0 1 Processor -- start 2024-09-15T12:38:21.101 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.100+0000 7f4c8e634ec0 1 -- start start 2024-09-15T12:38:21.104 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.100+0000 7f4c8e634ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xe913c0 0xe97520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.104 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.100+0000 7f4c8e634ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0xd67520 con 0xe913c0 2024-09-15T12:38:21.104 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.101+0000 7f4c8663f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xe913c0 0xe97520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.104 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.101+0000 7f4c8663f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xe913c0 0xe97520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47896/0 (socket says 172.21.15.122:47896) 2024-09-15T12:38:21.104 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.101+0000 7f4c8663f640 1 -- 172.21.15.122:0/967103528 learned_addr learned my addr 172.21.15.122:0/967103528 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:21.104 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.101+0000 7f4c8663f640 1 -- 172.21.15.122:0/967103528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd03e10 con 0xe913c0 2024-09-15T12:38:21.104 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.101+0000 7f4c8663f640 1 --2- 172.21.15.122:0/967103528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xe913c0 0xe97520 crc :-1 s=READY pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8444f1000342fd38 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.104 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.101+0000 7f4c84e3c640 1 -- 172.21.15.122:0/967103528 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c7800b580 con 0xe913c0 2024-09-15T12:38:21.104 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.101+0000 7f4c84e3c640 1 -- 172.21.15.122:0/967103528 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4c7800b6e0 con 0xe913c0 2024-09-15T12:38:21.105 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.101+0000 7f4c84e3c640 1 -- 172.21.15.122:0/967103528 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c7800b980 con 0xe913c0 2024-09-15T12:38:21.105 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.102+0000 7f4c8e634ec0 1 -- 172.21.15.122:0/967103528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xe913c0 msgr2=0xe97520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.105 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.102+0000 7f4c8e634ec0 1 --2- 172.21.15.122:0/967103528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xe913c0 0xe97520 crc :-1 s=READY pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.105 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.102+0000 7f4c8e634ec0 1 -- 172.21.15.122:0/967103528 shutdown_connections 2024-09-15T12:38:21.105 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.102+0000 7f4c8e634ec0 1 --2- 172.21.15.122:0/967103528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xe913c0 0xe97520 unknown :-1 s=CLOSED pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.105 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.102+0000 7f4c8e634ec0 1 -- 172.21.15.122:0/967103528 >> 172.21.15.122:0/967103528 conn(0xd27770 msgr2=0xe06ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:21.105 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.102+0000 7f4c8e634ec0 1 -- 172.21.15.122:0/967103528 shutdown_connections 2024-09-15T12:38:21.105 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.102+0000 7f4c8e634ec0 1 -- 172.21.15.122:0/967103528 wait complete. 2024-09-15T12:38:21.107 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.103+0000 7f4c8e634ec0 1 Processor -- start 2024-09-15T12:38:21.107 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.103+0000 7f4c8e634ec0 1 -- start start 2024-09-15T12:38:21.107 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.104+0000 7f4c8e634ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xe913c0 0xe7e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.107 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.104+0000 7f4c8e634ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0xd65280 con 0xe913c0 2024-09-15T12:38:21.107 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.104+0000 7f4c8663f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xe913c0 0xe7e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.108 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.104+0000 7f4c8663f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xe913c0 0xe7e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47898/0 (socket says 172.21.15.122:47898) 2024-09-15T12:38:21.108 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.104+0000 7f4c8663f640 1 -- 172.21.15.122:0/626890922 learned_addr learned my addr 172.21.15.122:0/626890922 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:21.108 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.104+0000 7f4c8663f640 1 -- 172.21.15.122:0/626890922 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xcf5920 con 0xe913c0 2024-09-15T12:38:21.108 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.104+0000 7f4c8663f640 1 --2- 172.21.15.122:0/626890922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xe913c0 0xe7e320 crc :-1 s=READY pgs=12856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.108 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.104+0000 7f4c7effd640 1 -- 172.21.15.122:0/626890922 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c780129e0 con 0xe913c0 2024-09-15T12:38:21.108 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.104+0000 7f4c7effd640 1 -- 172.21.15.122:0/626890922 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4c78005040 con 0xe913c0 2024-09-15T12:38:21.108 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.104+0000 7f4c8e634ec0 1 -- 172.21.15.122:0/626890922 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xcf5380 con 0xe913c0 2024-09-15T12:38:21.108 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.104+0000 7f4c7effd640 1 -- 172.21.15.122:0/626890922 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c78012c70 con 0xe913c0 2024-09-15T12:38:21.108 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.104+0000 7f4c8e634ec0 1 -- 172.21.15.122:0/626890922 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0xe80d70 con 0xe913c0 2024-09-15T12:38:21.108 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.105+0000 7f4c7effd640 1 -- 172.21.15.122:0/626890922 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4c7800d040 con 0xe913c0 2024-09-15T12:38:21.108 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.105+0000 7f4c7effd640 1 --2- 172.21.15.122:0/626890922 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4c6c03d1c0 0x7f4c6c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.109 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.105+0000 7f4c7effd640 1 -- 172.21.15.122:0/626890922 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(695..695 src has 621..695) ==== 3819+0+0 (crc 0 0 0) 0x7f4c7800a040 con 0xe913c0 2024-09-15T12:38:21.109 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.106+0000 7f4c8e634ec0 1 --2- 172.21.15.122:0/626890922 >> v2:172.21.15.122:6800/2464407069 conn(0xe9aa60 0x1330c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.109 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.106+0000 7f4c8e634ec0 1 -- 172.21.15.122:0/626890922 --> v2:172.21.15.122:6800/2464407069 -- osd_op(unknown.0.0:1 199.4 199:233a42c1:::obj6:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e695) -- 0xe81ab0 con 0xe9aa60 2024-09-15T12:38:21.109 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.106+0000 7f4c85e3e640 1 --2- 172.21.15.122:0/626890922 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4c6c03d1c0 0x7f4c6c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.110 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.106+0000 7f4c85e3e640 1 --2- 172.21.15.122:0/626890922 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4c6c03d1c0 0x7f4c6c03f6d0 crc :-1 s=READY pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.110 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.106+0000 7f4c86e40640 1 --2- 172.21.15.122:0/626890922 >> v2:172.21.15.122:6800/2464407069 conn(0xe9aa60 0x1330c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:38:21.112 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.110+0000 7f4c86e40640 1 --2- 172.21.15.122:0/626890922 >> v2:172.21.15.122:6800/2464407069 conn(0xe9aa60 0x1330c80 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.127 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.124+0000 7f4c86e40640 1 -- 172.21.15.122:0/626890922 <== osd.0 v2:172.21.15.122:6800/2464407069 1 ==== osd_op_reply(1 obj6 [writefull 0~12875] v695'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4c7000c430 con 0xe9aa60 2024-09-15T12:38:21.127 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.125+0000 7f4c8e634ec0 1 -- 172.21.15.122:0/626890922 >> v2:172.21.15.122:6800/2464407069 conn(0xe9aa60 msgr2=0x1330c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.127 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.125+0000 7f4c8e634ec0 1 --2- 172.21.15.122:0/626890922 >> v2:172.21.15.122:6800/2464407069 conn(0xe9aa60 0x1330c80 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.127 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.125+0000 7f4c8e634ec0 1 -- 172.21.15.122:0/626890922 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4c6c03d1c0 msgr2=0x7f4c6c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.128 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.125+0000 7f4c8e634ec0 1 --2- 172.21.15.122:0/626890922 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4c6c03d1c0 0x7f4c6c03f6d0 crc :-1 s=READY pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.128 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.125+0000 7f4c8e634ec0 1 -- 172.21.15.122:0/626890922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xe913c0 msgr2=0xe7e320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.128 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.125+0000 7f4c8e634ec0 1 --2- 172.21.15.122:0/626890922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xe913c0 0xe7e320 crc :-1 s=READY pgs=12856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.128 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.125+0000 7f4c8e634ec0 1 -- 172.21.15.122:0/626890922 shutdown_connections 2024-09-15T12:38:21.128 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.125+0000 7f4c8e634ec0 1 --2- 172.21.15.122:0/626890922 >> v2:172.21.15.122:6800/2464407069 conn(0xe9aa60 0x1330c80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.128 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.125+0000 7f4c8e634ec0 1 --2- 172.21.15.122:0/626890922 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4c6c03d1c0 0x7f4c6c03f6d0 unknown :-1 s=CLOSED pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.128 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.125+0000 7f4c8e634ec0 1 --2- 172.21.15.122:0/626890922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xe913c0 0xe7e320 unknown :-1 s=CLOSED pgs=12856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.128 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.125+0000 7f4c8e634ec0 1 -- 172.21.15.122:0/626890922 >> 172.21.15.122:0/626890922 conn(0xd27770 msgr2=0xe98a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:21.128 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.125+0000 7f4c8e634ec0 1 -- 172.21.15.122:0/626890922 shutdown_connections 2024-09-15T12:38:21.128 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.125+0000 7f4c8e634ec0 1 -- 172.21.15.122:0/626890922 wait complete. 2024-09-15T12:38:21.129 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:38:21.129 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p ed9b5ffb-fd10-45e9-a651-fa504ac931a6 put obj7 /etc/passwd 2024-09-15T12:38:21.165 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.163+0000 7f3b59a31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.170 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.168+0000 7f3b59a31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.171 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.168+0000 7f3b59a31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.171 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.169+0000 7f3b59a31ec0 1 Processor -- start 2024-09-15T12:38:21.171 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.169+0000 7f3b59a31ec0 1 -- start start 2024-09-15T12:38:21.173 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.170+0000 7f3b59a31ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x18099b0 0x18918f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.173 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.170+0000 7f3b59a31ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x16db520 con 0x18099b0 2024-09-15T12:38:21.173 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.170+0000 7f3b51b9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x18099b0 0x18918f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.173 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.170+0000 7f3b51b9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x18099b0 0x18918f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47916/0 (socket says 172.21.15.122:47916) 2024-09-15T12:38:21.173 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.170+0000 7f3b51b9b640 1 -- 172.21.15.122:0/649988581 learned_addr learned my addr 172.21.15.122:0/649988581 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:21.173 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.170+0000 7f3b51b9b640 1 -- 172.21.15.122:0/649988581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1677e10 con 0x18099b0 2024-09-15T12:38:21.173 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.171+0000 7f3b51b9b640 1 --2- 172.21.15.122:0/649988581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x18099b0 0x18918f0 crc :-1 s=READY pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdf56127f9cc861 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.173 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.171+0000 7f3b4b7fe640 1 -- 172.21.15.122:0/649988581 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b3c00b500 con 0x18099b0 2024-09-15T12:38:21.174 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.171+0000 7f3b4b7fe640 1 -- 172.21.15.122:0/649988581 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3b3c00b660 con 0x18099b0 2024-09-15T12:38:21.174 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.171+0000 7f3b4b7fe640 1 -- 172.21.15.122:0/649988581 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b3c00b900 con 0x18099b0 2024-09-15T12:38:21.175 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.171+0000 7f3b59a31ec0 1 -- 172.21.15.122:0/649988581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x18099b0 msgr2=0x18918f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.175 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.171+0000 7f3b59a31ec0 1 --2- 172.21.15.122:0/649988581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x18099b0 0x18918f0 crc :-1 s=READY pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.175 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.171+0000 7f3b59a31ec0 1 -- 172.21.15.122:0/649988581 shutdown_connections 2024-09-15T12:38:21.175 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.171+0000 7f3b59a31ec0 1 --2- 172.21.15.122:0/649988581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x18099b0 0x18918f0 unknown :-1 s=CLOSED pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.175 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.171+0000 7f3b59a31ec0 1 -- 172.21.15.122:0/649988581 >> 172.21.15.122:0/649988581 conn(0x169b770 msgr2=0x17742b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:21.175 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.171+0000 7f3b59a31ec0 1 -- 172.21.15.122:0/649988581 shutdown_connections 2024-09-15T12:38:21.175 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.172+0000 7f3b59a31ec0 1 -- 172.21.15.122:0/649988581 wait complete. 2024-09-15T12:38:21.175 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.172+0000 7f3b59a31ec0 1 Processor -- start 2024-09-15T12:38:21.175 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.172+0000 7f3b59a31ec0 1 -- start start 2024-09-15T12:38:21.177 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.173+0000 7f3b59a31ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x18099b0 0x189e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.177 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.173+0000 7f3b59a31ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x16d9280 con 0x18099b0 2024-09-15T12:38:21.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.173+0000 7f3b51b9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x18099b0 0x189e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.173+0000 7f3b51b9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x18099b0 0x189e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47926/0 (socket says 172.21.15.122:47926) 2024-09-15T12:38:21.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.173+0000 7f3b51b9b640 1 -- 172.21.15.122:0/3036524992 learned_addr learned my addr 172.21.15.122:0/3036524992 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:21.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.174+0000 7f3b51b9b640 1 -- 172.21.15.122:0/3036524992 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1669920 con 0x18099b0 2024-09-15T12:38:21.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.174+0000 7f3b51b9b640 1 --2- 172.21.15.122:0/3036524992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x18099b0 0x189e880 crc :-1 s=READY pgs=12860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.174+0000 7f3b4a7fc640 1 -- 172.21.15.122:0/3036524992 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b3c0111e0 con 0x18099b0 2024-09-15T12:38:21.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.174+0000 7f3b4a7fc640 1 -- 172.21.15.122:0/3036524992 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3b3c011880 con 0x18099b0 2024-09-15T12:38:21.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.174+0000 7f3b59a31ec0 1 -- 172.21.15.122:0/3036524992 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1669380 con 0x18099b0 2024-09-15T12:38:21.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.174+0000 7f3b4a7fc640 1 -- 172.21.15.122:0/3036524992 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b3c0119f0 con 0x18099b0 2024-09-15T12:38:21.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.174+0000 7f3b59a31ec0 1 -- 172.21.15.122:0/3036524992 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1809520 con 0x18099b0 2024-09-15T12:38:21.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.175+0000 7f3b4a7fc640 1 -- 172.21.15.122:0/3036524992 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3b3c011ba0 con 0x18099b0 2024-09-15T12:38:21.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.175+0000 7f3b4a7fc640 1 --2- 172.21.15.122:0/3036524992 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3b3803d1c0 0x7f3b3803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.175+0000 7f3b4a7fc640 1 -- 172.21.15.122:0/3036524992 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(695..695 src has 621..695) ==== 3819+0+0 (crc 0 0 0) 0x7f3b3c050130 con 0x18099b0 2024-09-15T12:38:21.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.175+0000 7f3b59a31ec0 1 --2- 172.21.15.122:0/3036524992 >> v2:172.21.15.122:6803/3904627990 conn(0x180a4d0 0x1808460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.179 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.175+0000 7f3b59a31ec0 1 -- 172.21.15.122:0/3036524992 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:1 199.9 199:9a09113a:::obj7:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e695) -- 0x17f8af0 con 0x180a4d0 2024-09-15T12:38:21.179 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.176+0000 7f3b5139a640 1 --2- 172.21.15.122:0/3036524992 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3b3803d1c0 0x7f3b3803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.179 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.176+0000 7f3b5239c640 1 --2- 172.21.15.122:0/3036524992 >> v2:172.21.15.122:6803/3904627990 conn(0x180a4d0 0x1808460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:38:21.179 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.176+0000 7f3b5139a640 1 --2- 172.21.15.122:0/3036524992 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3b3803d1c0 0x7f3b3803f6d0 crc :-1 s=READY pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.180 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.178+0000 7f3b5239c640 1 --2- 172.21.15.122:0/3036524992 >> v2:172.21.15.122:6803/3904627990 conn(0x180a4d0 0x1808460 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.195 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.192+0000 7f3b5239c640 1 -- 172.21.15.122:0/3036524992 <== osd.1 v2:172.21.15.122:6803/3904627990 1 ==== osd_op_reply(1 obj7 [writefull 0~12875] v695'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3b4400a430 con 0x180a4d0 2024-09-15T12:38:21.195 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.192+0000 7f3b59a31ec0 1 -- 172.21.15.122:0/3036524992 >> v2:172.21.15.122:6803/3904627990 conn(0x180a4d0 msgr2=0x1808460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.196 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.192+0000 7f3b59a31ec0 1 --2- 172.21.15.122:0/3036524992 >> v2:172.21.15.122:6803/3904627990 conn(0x180a4d0 0x1808460 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.196 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.192+0000 7f3b59a31ec0 1 -- 172.21.15.122:0/3036524992 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3b3803d1c0 msgr2=0x7f3b3803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.196 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.192+0000 7f3b59a31ec0 1 --2- 172.21.15.122:0/3036524992 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3b3803d1c0 0x7f3b3803f6d0 crc :-1 s=READY pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.196 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.193+0000 7f3b59a31ec0 1 -- 172.21.15.122:0/3036524992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x18099b0 msgr2=0x189e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.196 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.193+0000 7f3b59a31ec0 1 --2- 172.21.15.122:0/3036524992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x18099b0 0x189e880 crc :-1 s=READY pgs=12860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.196 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.193+0000 7f3b59a31ec0 1 -- 172.21.15.122:0/3036524992 shutdown_connections 2024-09-15T12:38:21.196 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.193+0000 7f3b59a31ec0 1 --2- 172.21.15.122:0/3036524992 >> v2:172.21.15.122:6803/3904627990 conn(0x180a4d0 0x1808460 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.196 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.193+0000 7f3b59a31ec0 1 --2- 172.21.15.122:0/3036524992 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3b3803d1c0 0x7f3b3803f6d0 unknown :-1 s=CLOSED pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.196 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.193+0000 7f3b59a31ec0 1 --2- 172.21.15.122:0/3036524992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x18099b0 0x189e880 unknown :-1 s=CLOSED pgs=12860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.196 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.193+0000 7f3b59a31ec0 1 -- 172.21.15.122:0/3036524992 >> 172.21.15.122:0/3036524992 conn(0x169b770 msgr2=0x17742b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:21.197 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.193+0000 7f3b59a31ec0 1 -- 172.21.15.122:0/3036524992 shutdown_connections 2024-09-15T12:38:21.197 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.193+0000 7f3b59a31ec0 1 -- 172.21.15.122:0/3036524992 wait complete. 2024-09-15T12:38:21.197 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:38:21.197 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p ed9b5ffb-fd10-45e9-a651-fa504ac931a6 put obj8 /etc/passwd 2024-09-15T12:38:21.234 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.232+0000 7fc472f1eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.238 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.237+0000 7fc472f1eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.239 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.237+0000 7fc472f1eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.239 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.237+0000 7fc472f1eec0 1 Processor -- start 2024-09-15T12:38:21.239 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.237+0000 7fc472f1eec0 1 -- start start 2024-09-15T12:38:21.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.238+0000 7fc472f1eec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1ce39b0 0x1cce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.238+0000 7fc472f1eec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x1bb5520 con 0x1ce39b0 2024-09-15T12:38:21.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.238+0000 7fc46b23f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1ce39b0 0x1cce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.238+0000 7fc46b23f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1ce39b0 0x1cce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47932/0 (socket says 172.21.15.122:47932) 2024-09-15T12:38:21.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.239+0000 7fc46b23f640 1 -- 172.21.15.122:0/3178729450 learned_addr learned my addr 172.21.15.122:0/3178729450 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:21.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.239+0000 7fc46b23f640 1 -- 172.21.15.122:0/3178729450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1b51e10 con 0x1ce39b0 2024-09-15T12:38:21.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.239+0000 7fc46b23f640 1 --2- 172.21.15.122:0/3178729450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1ce39b0 0x1cce850 crc :-1 s=READY pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12d00f47e82cb3a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.239+0000 7fc469a3c640 1 -- 172.21.15.122:0/3178729450 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc45c00c490 con 0x1ce39b0 2024-09-15T12:38:21.242 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.239+0000 7fc469a3c640 1 -- 172.21.15.122:0/3178729450 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc45c00c5f0 con 0x1ce39b0 2024-09-15T12:38:21.242 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.239+0000 7fc469a3c640 1 -- 172.21.15.122:0/3178729450 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc45c00c890 con 0x1ce39b0 2024-09-15T12:38:21.243 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.240+0000 7fc472f1eec0 1 -- 172.21.15.122:0/3178729450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1ce39b0 msgr2=0x1cce850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.243 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.240+0000 7fc472f1eec0 1 --2- 172.21.15.122:0/3178729450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1ce39b0 0x1cce850 crc :-1 s=READY pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.243 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.240+0000 7fc472f1eec0 1 -- 172.21.15.122:0/3178729450 shutdown_connections 2024-09-15T12:38:21.243 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.240+0000 7fc472f1eec0 1 --2- 172.21.15.122:0/3178729450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1ce39b0 0x1cce850 unknown :-1 s=CLOSED pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.243 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.240+0000 7fc472f1eec0 1 -- 172.21.15.122:0/3178729450 >> 172.21.15.122:0/3178729450 conn(0x1b75770 msgr2=0x1c549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:21.243 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.240+0000 7fc472f1eec0 1 -- 172.21.15.122:0/3178729450 shutdown_connections 2024-09-15T12:38:21.243 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.240+0000 7fc472f1eec0 1 -- 172.21.15.122:0/3178729450 wait complete. 2024-09-15T12:38:21.243 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.240+0000 7fc472f1eec0 1 Processor -- start 2024-09-15T12:38:21.243 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.241+0000 7fc472f1eec0 1 -- start start 2024-09-15T12:38:21.245 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.241+0000 7fc472f1eec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1ce39b0 0x1d789d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.245 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.242+0000 7fc472f1eec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x1bb3280 con 0x1ce39b0 2024-09-15T12:38:21.246 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.242+0000 7fc46b23f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1ce39b0 0x1d789d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.246 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.242+0000 7fc46b23f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1ce39b0 0x1d789d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47944/0 (socket says 172.21.15.122:47944) 2024-09-15T12:38:21.246 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.242+0000 7fc46b23f640 1 -- 172.21.15.122:0/4185131054 learned_addr learned my addr 172.21.15.122:0/4185131054 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:21.246 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.242+0000 7fc46b23f640 1 -- 172.21.15.122:0/4185131054 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1b43920 con 0x1ce39b0 2024-09-15T12:38:21.246 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.242+0000 7fc46b23f640 1 --2- 172.21.15.122:0/4185131054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1ce39b0 0x1d789d0 crc :-1 s=READY pgs=12864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.246 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.242+0000 7fc468a3a640 1 -- 172.21.15.122:0/4185131054 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc45c0111e0 con 0x1ce39b0 2024-09-15T12:38:21.246 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.242+0000 7fc468a3a640 1 -- 172.21.15.122:0/4185131054 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc45c011a30 con 0x1ce39b0 2024-09-15T12:38:21.246 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.242+0000 7fc472f1eec0 1 -- 172.21.15.122:0/4185131054 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1b43380 con 0x1ce39b0 2024-09-15T12:38:21.246 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.242+0000 7fc468a3a640 1 -- 172.21.15.122:0/4185131054 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc45c011ba0 con 0x1ce39b0 2024-09-15T12:38:21.246 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.242+0000 7fc472f1eec0 1 -- 172.21.15.122:0/4185131054 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1cd3a70 con 0x1ce39b0 2024-09-15T12:38:21.246 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.243+0000 7fc468a3a640 1 -- 172.21.15.122:0/4185131054 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc45c011d50 con 0x1ce39b0 2024-09-15T12:38:21.246 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.243+0000 7fc468a3a640 1 --2- 172.21.15.122:0/4185131054 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc45003d1c0 0x7fc45003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.246 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.243+0000 7fc468a3a640 1 -- 172.21.15.122:0/4185131054 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(695..695 src has 621..695) ==== 3819+0+0 (crc 0 0 0) 0x7fc45c050230 con 0x1ce39b0 2024-09-15T12:38:21.246 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.244+0000 7fc472f1eec0 1 --2- 172.21.15.122:0/4185131054 >> v2:172.21.15.142:6803/3269009979 conn(0x1ce44d0 0x1cd22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.247 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.244+0000 7fc472f1eec0 1 -- 172.21.15.122:0/4185131054 --> v2:172.21.15.142:6803/3269009979 -- osd_op(unknown.0.0:1 199.5 199:a557efb1:::obj8:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e695) -- 0x1cd5ad0 con 0x1ce44d0 2024-09-15T12:38:21.247 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.244+0000 7fc46aa3e640 1 --2- 172.21.15.122:0/4185131054 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc45003d1c0 0x7fc45003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.247 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.244+0000 7fc46aa3e640 1 --2- 172.21.15.122:0/4185131054 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc45003d1c0 0x7fc45003f6d0 crc :-1 s=READY pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.247 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.245+0000 7fc46ba40640 1 --2- 172.21.15.122:0/4185131054 >> v2:172.21.15.142:6803/3269009979 conn(0x1ce44d0 0x1cd22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:38:21.250 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.248+0000 7fc46ba40640 1 --2- 172.21.15.122:0/4185131054 >> v2:172.21.15.142:6803/3269009979 conn(0x1ce44d0 0x1cd22c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.266 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.263+0000 7fc46ba40640 1 -- 172.21.15.122:0/4185131054 <== osd.2 v2:172.21.15.142:6803/3269009979 1 ==== osd_op_reply(1 obj8 [writefull 0~12875] v695'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc45400c430 con 0x1ce44d0 2024-09-15T12:38:21.266 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.264+0000 7fc472f1eec0 1 -- 172.21.15.122:0/4185131054 >> v2:172.21.15.142:6803/3269009979 conn(0x1ce44d0 msgr2=0x1cd22c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.266 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.264+0000 7fc472f1eec0 1 --2- 172.21.15.122:0/4185131054 >> v2:172.21.15.142:6803/3269009979 conn(0x1ce44d0 0x1cd22c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.266 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.264+0000 7fc472f1eec0 1 -- 172.21.15.122:0/4185131054 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc45003d1c0 msgr2=0x7fc45003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.266 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.264+0000 7fc472f1eec0 1 --2- 172.21.15.122:0/4185131054 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc45003d1c0 0x7fc45003f6d0 crc :-1 s=READY pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.266 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.264+0000 7fc472f1eec0 1 -- 172.21.15.122:0/4185131054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1ce39b0 msgr2=0x1d789d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.266 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.264+0000 7fc472f1eec0 1 --2- 172.21.15.122:0/4185131054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1ce39b0 0x1d789d0 crc :-1 s=READY pgs=12864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.267 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.264+0000 7fc472f1eec0 1 -- 172.21.15.122:0/4185131054 shutdown_connections 2024-09-15T12:38:21.267 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.264+0000 7fc472f1eec0 1 --2- 172.21.15.122:0/4185131054 >> v2:172.21.15.142:6803/3269009979 conn(0x1ce44d0 0x1cd22c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.267 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.264+0000 7fc472f1eec0 1 --2- 172.21.15.122:0/4185131054 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc45003d1c0 0x7fc45003f6d0 unknown :-1 s=CLOSED pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.267 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.264+0000 7fc472f1eec0 1 --2- 172.21.15.122:0/4185131054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1ce39b0 0x1d789d0 unknown :-1 s=CLOSED pgs=12864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.267 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.264+0000 7fc472f1eec0 1 -- 172.21.15.122:0/4185131054 >> 172.21.15.122:0/4185131054 conn(0x1b75770 msgr2=0x1cce850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:21.267 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.264+0000 7fc472f1eec0 1 -- 172.21.15.122:0/4185131054 shutdown_connections 2024-09-15T12:38:21.267 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.264+0000 7fc472f1eec0 1 -- 172.21.15.122:0/4185131054 wait complete. 2024-09-15T12:38:21.268 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:38:21.269 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p ed9b5ffb-fd10-45e9-a651-fa504ac931a6 put obj9 /etc/passwd 2024-09-15T12:38:21.304 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.302+0000 7f66ffa2eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.309 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.307+0000 7f66ffa2eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.309 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.308+0000 7f66ffa2eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.310 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.309+0000 7f66ffa2eec0 1 Processor -- start 2024-09-15T12:38:21.311 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.309+0000 7f66ffa2eec0 1 -- start start 2024-09-15T12:38:21.312 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.310+0000 7f66ffa2eec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x16efe30 0x180f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.312 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.310+0000 7f66ffa2eec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x165a520 con 0x16efe30 2024-09-15T12:38:21.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.310+0000 7f66f2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x16efe30 0x180f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.310+0000 7f66f2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x16efe30 0x180f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47958/0 (socket says 172.21.15.122:47958) 2024-09-15T12:38:21.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.310+0000 7f66f2ffd640 1 -- 172.21.15.122:0/1513119241 learned_addr learned my addr 172.21.15.122:0/1513119241 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:21.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.310+0000 7f66f2ffd640 1 -- 172.21.15.122:0/1513119241 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x15f6e10 con 0x16efe30 2024-09-15T12:38:21.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.310+0000 7f66f2ffd640 1 --2- 172.21.15.122:0/1513119241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x16efe30 0x180f7d0 crc :-1 s=READY pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ed3a6a3378cd55 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.310+0000 7f66f17fa640 1 -- 172.21.15.122:0/1513119241 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f66e400c5e0 con 0x16efe30 2024-09-15T12:38:21.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.310+0000 7f66f17fa640 1 -- 172.21.15.122:0/1513119241 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f66e400c740 con 0x16efe30 2024-09-15T12:38:21.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.310+0000 7f66f17fa640 1 -- 172.21.15.122:0/1513119241 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f66e400c9e0 con 0x16efe30 2024-09-15T12:38:21.314 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.311+0000 7f66ffa2eec0 1 -- 172.21.15.122:0/1513119241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x16efe30 msgr2=0x180f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.314 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.311+0000 7f66ffa2eec0 1 --2- 172.21.15.122:0/1513119241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x16efe30 0x180f7d0 crc :-1 s=READY pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.314 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.311+0000 7f66ffa2eec0 1 -- 172.21.15.122:0/1513119241 shutdown_connections 2024-09-15T12:38:21.314 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.311+0000 7f66ffa2eec0 1 --2- 172.21.15.122:0/1513119241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x16efe30 0x180f7d0 unknown :-1 s=CLOSED pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.315 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.311+0000 7f66ffa2eec0 1 -- 172.21.15.122:0/1513119241 >> 172.21.15.122:0/1513119241 conn(0x161a770 msgr2=0x180e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:21.315 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.311+0000 7f66ffa2eec0 1 -- 172.21.15.122:0/1513119241 shutdown_connections 2024-09-15T12:38:21.315 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.311+0000 7f66ffa2eec0 1 -- 172.21.15.122:0/1513119241 wait complete. 2024-09-15T12:38:21.315 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.312+0000 7f66ffa2eec0 1 Processor -- start 2024-09-15T12:38:21.315 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.312+0000 7f66ffa2eec0 1 -- start start 2024-09-15T12:38:21.316 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.313+0000 7f66ffa2eec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x16efe30 0x16f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.316 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.313+0000 7f66ffa2eec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x1658280 con 0x16efe30 2024-09-15T12:38:21.316 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.313+0000 7f66f2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x16efe30 0x16f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.316 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.313+0000 7f66f2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x16efe30 0x16f2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47966/0 (socket says 172.21.15.122:47966) 2024-09-15T12:38:21.317 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.313+0000 7f66f2ffd640 1 -- 172.21.15.122:0/2379118023 learned_addr learned my addr 172.21.15.122:0/2379118023 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:21.317 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.313+0000 7f66f2ffd640 1 -- 172.21.15.122:0/2379118023 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x15e8920 con 0x16efe30 2024-09-15T12:38:21.317 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.313+0000 7f66f2ffd640 1 --2- 172.21.15.122:0/2379118023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x16efe30 0x16f2da0 crc :-1 s=READY pgs=12868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.317 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.313+0000 7f66dbfff640 1 -- 172.21.15.122:0/2379118023 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f66e4013a70 con 0x16efe30 2024-09-15T12:38:21.317 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.313+0000 7f66dbfff640 1 -- 172.21.15.122:0/2379118023 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f66e4013bd0 con 0x16efe30 2024-09-15T12:38:21.317 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.313+0000 7f66ffa2eec0 1 -- 172.21.15.122:0/2379118023 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x15e8380 con 0x16efe30 2024-09-15T12:38:21.317 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.313+0000 7f66dbfff640 1 -- 172.21.15.122:0/2379118023 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f66e4013e70 con 0x16efe30 2024-09-15T12:38:21.317 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.314+0000 7f66ffa2eec0 1 -- 172.21.15.122:0/2379118023 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x16f2b80 con 0x16efe30 2024-09-15T12:38:21.317 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.315+0000 7f66dbfff640 1 -- 172.21.15.122:0/2379118023 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f66e4010400 con 0x16efe30 2024-09-15T12:38:21.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.315+0000 7f66dbfff640 1 --2- 172.21.15.122:0/2379118023 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f66e003d1c0 0x7f66e003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.315+0000 7f66dbfff640 1 -- 172.21.15.122:0/2379118023 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(695..695 src has 621..695) ==== 3819+0+0 (crc 0 0 0) 0x7f66e4008040 con 0x16efe30 2024-09-15T12:38:21.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.315+0000 7f66ffa2eec0 1 --2- 172.21.15.122:0/2379118023 >> v2:172.21.15.122:6800/2464407069 conn(0x1788fc0 0x181d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.315+0000 7f66ffa2eec0 1 -- 172.21.15.122:0/2379118023 --> v2:172.21.15.122:6800/2464407069 -- osd_op(unknown.0.0:1 199.7 199:fe351e27:::obj9:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e695) -- 0x16f2340 con 0x1788fc0 2024-09-15T12:38:21.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.315+0000 7f66f27fc640 1 --2- 172.21.15.122:0/2379118023 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f66e003d1c0 0x7f66e003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.319 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.316+0000 7f66f27fc640 1 --2- 172.21.15.122:0/2379118023 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f66e003d1c0 0x7f66e003f6d0 crc :-1 s=READY pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.319 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.316+0000 7f66f37fe640 1 --2- 172.21.15.122:0/2379118023 >> v2:172.21.15.122:6800/2464407069 conn(0x1788fc0 0x181d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:38:21.320 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.318+0000 7f66f37fe640 1 --2- 172.21.15.122:0/2379118023 >> v2:172.21.15.122:6800/2464407069 conn(0x1788fc0 0x181d6e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.335 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.332+0000 7f66f37fe640 1 -- 172.21.15.122:0/2379118023 <== osd.0 v2:172.21.15.122:6800/2464407069 1 ==== osd_op_reply(1 obj9 [writefull 0~12875] v695'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f66ec00a430 con 0x1788fc0 2024-09-15T12:38:21.335 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.332+0000 7f66ffa2eec0 1 -- 172.21.15.122:0/2379118023 >> v2:172.21.15.122:6800/2464407069 conn(0x1788fc0 msgr2=0x181d6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.335 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.332+0000 7f66ffa2eec0 1 --2- 172.21.15.122:0/2379118023 >> v2:172.21.15.122:6800/2464407069 conn(0x1788fc0 0x181d6e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.335 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.332+0000 7f66ffa2eec0 1 -- 172.21.15.122:0/2379118023 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f66e003d1c0 msgr2=0x7f66e003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.335 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.332+0000 7f66ffa2eec0 1 --2- 172.21.15.122:0/2379118023 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f66e003d1c0 0x7f66e003f6d0 crc :-1 s=READY pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.335 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.332+0000 7f66ffa2eec0 1 -- 172.21.15.122:0/2379118023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x16efe30 msgr2=0x16f2da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.335 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.332+0000 7f66ffa2eec0 1 --2- 172.21.15.122:0/2379118023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x16efe30 0x16f2da0 crc :-1 s=READY pgs=12868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.335 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.332+0000 7f66ffa2eec0 1 -- 172.21.15.122:0/2379118023 shutdown_connections 2024-09-15T12:38:21.335 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.332+0000 7f66ffa2eec0 1 --2- 172.21.15.122:0/2379118023 >> v2:172.21.15.122:6800/2464407069 conn(0x1788fc0 0x181d6e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.335 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.332+0000 7f66ffa2eec0 1 --2- 172.21.15.122:0/2379118023 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f66e003d1c0 0x7f66e003f6d0 unknown :-1 s=CLOSED pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.335 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.332+0000 7f66ffa2eec0 1 --2- 172.21.15.122:0/2379118023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x16efe30 0x16f2da0 unknown :-1 s=CLOSED pgs=12868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.336 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.332+0000 7f66ffa2eec0 1 -- 172.21.15.122:0/2379118023 >> 172.21.15.122:0/2379118023 conn(0x161a770 msgr2=0x180e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:21.336 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.332+0000 7f66ffa2eec0 1 -- 172.21.15.122:0/2379118023 shutdown_connections 2024-09-15T12:38:21.336 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.332+0000 7f66ffa2eec0 1 -- 172.21.15.122:0/2379118023 wait complete. 2024-09-15T12:38:21.337 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:38:21.337 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p ed9b5ffb-fd10-45e9-a651-fa504ac931a6 put obj10 /etc/passwd 2024-09-15T12:38:21.372 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.370+0000 7f3a88477ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.377 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.375+0000 7f3a88477ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.377 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.375+0000 7f3a88477ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:21.378 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.376+0000 7f3a88477ec0 1 Processor -- start 2024-09-15T12:38:21.378 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.376+0000 7f3a88477ec0 1 -- start start 2024-09-15T12:38:21.379 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.377+0000 7f3a88477ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x12d49b0 0x135c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.380 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.377+0000 7f3a88477ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x11a6520 con 0x12d49b0 2024-09-15T12:38:21.380 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.377+0000 7f3a7bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x12d49b0 0x135c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.380 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.377+0000 7f3a7bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x12d49b0 0x135c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47982/0 (socket says 172.21.15.122:47982) 2024-09-15T12:38:21.380 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.377+0000 7f3a7bfff640 1 -- 172.21.15.122:0/3920161391 learned_addr learned my addr 172.21.15.122:0/3920161391 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:21.380 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.377+0000 7f3a7bfff640 1 -- 172.21.15.122:0/3920161391 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1142e10 con 0x12d49b0 2024-09-15T12:38:21.380 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.377+0000 7f3a7bfff640 1 --2- 172.21.15.122:0/3920161391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x12d49b0 0x135c8f0 crc :-1 s=READY pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4120d3fea057ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.380 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.377+0000 7f3a7a7fc640 1 -- 172.21.15.122:0/3920161391 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3a6c0061e0 con 0x12d49b0 2024-09-15T12:38:21.380 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.377+0000 7f3a7a7fc640 1 -- 172.21.15.122:0/3920161391 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3a6c006340 con 0x12d49b0 2024-09-15T12:38:21.380 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.377+0000 7f3a7a7fc640 1 -- 172.21.15.122:0/3920161391 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3a6c004880 con 0x12d49b0 2024-09-15T12:38:21.381 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.378+0000 7f3a88477ec0 1 -- 172.21.15.122:0/3920161391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x12d49b0 msgr2=0x135c8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.381 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.378+0000 7f3a88477ec0 1 --2- 172.21.15.122:0/3920161391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x12d49b0 0x135c8f0 crc :-1 s=READY pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.382 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.378+0000 7f3a88477ec0 1 -- 172.21.15.122:0/3920161391 shutdown_connections 2024-09-15T12:38:21.382 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.378+0000 7f3a88477ec0 1 --2- 172.21.15.122:0/3920161391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x12d49b0 0x135c8f0 unknown :-1 s=CLOSED pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.382 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.378+0000 7f3a88477ec0 1 -- 172.21.15.122:0/3920161391 >> 172.21.15.122:0/3920161391 conn(0x1166770 msgr2=0x123f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:21.382 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.378+0000 7f3a88477ec0 1 -- 172.21.15.122:0/3920161391 shutdown_connections 2024-09-15T12:38:21.382 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.378+0000 7f3a88477ec0 1 -- 172.21.15.122:0/3920161391 wait complete. 2024-09-15T12:38:21.382 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.379+0000 7f3a88477ec0 1 Processor -- start 2024-09-15T12:38:21.382 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.379+0000 7f3a88477ec0 1 -- start start 2024-09-15T12:38:21.384 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.380+0000 7f3a88477ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x12d54d0 0x12c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.385 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.380+0000 7f3a88477ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x11a4280 con 0x12d54d0 2024-09-15T12:38:21.385 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.380+0000 7f3a7bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x12d54d0 0x12c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.385 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.380+0000 7f3a7bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x12d54d0 0x12c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:47992/0 (socket says 172.21.15.122:47992) 2024-09-15T12:38:21.385 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.380+0000 7f3a7bfff640 1 -- 172.21.15.122:0/2080140141 learned_addr learned my addr 172.21.15.122:0/2080140141 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:21.385 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.380+0000 7f3a7bfff640 1 -- 172.21.15.122:0/2080140141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1134920 con 0x12d54d0 2024-09-15T12:38:21.385 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.380+0000 7f3a7bfff640 1 --2- 172.21.15.122:0/2080140141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x12d54d0 0x12c5f90 crc :-1 s=READY pgs=12872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.385 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.381+0000 7f3a797fa640 1 -- 172.21.15.122:0/2080140141 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3a6c001b20 con 0x12d54d0 2024-09-15T12:38:21.385 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.381+0000 7f3a797fa640 1 -- 172.21.15.122:0/2080140141 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3a6c001c80 con 0x12d54d0 2024-09-15T12:38:21.385 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.381+0000 7f3a88477ec0 1 -- 172.21.15.122:0/2080140141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1134380 con 0x12d54d0 2024-09-15T12:38:21.385 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.381+0000 7f3a797fa640 1 -- 172.21.15.122:0/2080140141 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3a6c001f20 con 0x12d54d0 2024-09-15T12:38:21.385 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.381+0000 7f3a88477ec0 1 -- 172.21.15.122:0/2080140141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x12c5600 con 0x12d54d0 2024-09-15T12:38:21.385 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.382+0000 7f3a797fa640 1 -- 172.21.15.122:0/2080140141 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3a6c014410 con 0x12d54d0 2024-09-15T12:38:21.386 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.382+0000 7f3a797fa640 1 --2- 172.21.15.122:0/2080140141 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3a6803d1c0 0x7f3a6803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.386 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.382+0000 7f3a797fa640 1 -- 172.21.15.122:0/2080140141 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(695..695 src has 621..695) ==== 3819+0+0 (crc 0 0 0) 0x7f3a6c04fa90 con 0x12d54d0 2024-09-15T12:38:21.386 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.382+0000 7f3a88477ec0 1 --2- 172.21.15.122:0/2080140141 >> v2:172.21.15.122:6800/2464407069 conn(0x136bf70 0x136c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:21.386 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.382+0000 7f3a88477ec0 1 -- 172.21.15.122:0/2080140141 --> v2:172.21.15.122:6800/2464407069 -- osd_op(unknown.0.0:1 199.b 199:d1337354:::obj10:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e695) -- 0x12c8f10 con 0x136bf70 2024-09-15T12:38:21.386 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.382+0000 7f3a7b7fe640 1 --2- 172.21.15.122:0/2080140141 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3a6803d1c0 0x7f3a6803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:21.386 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.383+0000 7f3a7b7fe640 1 --2- 172.21.15.122:0/2080140141 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3a6803d1c0 0x7f3a6803f6d0 crc :-1 s=READY pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.386 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.383+0000 7f3a80d9c640 1 --2- 172.21.15.122:0/2080140141 >> v2:172.21.15.122:6800/2464407069 conn(0x136bf70 0x136c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:38:21.388 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.386+0000 7f3a80d9c640 1 --2- 172.21.15.122:0/2080140141 >> v2:172.21.15.122:6800/2464407069 conn(0x136bf70 0x136c380 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:21.403 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.400+0000 7f3a80d9c640 1 -- 172.21.15.122:0/2080140141 <== osd.0 v2:172.21.15.122:6800/2464407069 1 ==== osd_op_reply(1 obj10 [writefull 0~12875] v695'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3a7400c430 con 0x136bf70 2024-09-15T12:38:21.403 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.400+0000 7f3a88477ec0 1 -- 172.21.15.122:0/2080140141 >> v2:172.21.15.122:6800/2464407069 conn(0x136bf70 msgr2=0x136c380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.403 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.400+0000 7f3a88477ec0 1 --2- 172.21.15.122:0/2080140141 >> v2:172.21.15.122:6800/2464407069 conn(0x136bf70 0x136c380 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.404 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.401+0000 7f3a88477ec0 1 -- 172.21.15.122:0/2080140141 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3a6803d1c0 msgr2=0x7f3a6803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.404 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.401+0000 7f3a88477ec0 1 --2- 172.21.15.122:0/2080140141 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3a6803d1c0 0x7f3a6803f6d0 crc :-1 s=READY pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.404 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.401+0000 7f3a88477ec0 1 -- 172.21.15.122:0/2080140141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x12d54d0 msgr2=0x12c5f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:21.404 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.401+0000 7f3a88477ec0 1 --2- 172.21.15.122:0/2080140141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x12d54d0 0x12c5f90 crc :-1 s=READY pgs=12872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.404 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.401+0000 7f3a88477ec0 1 -- 172.21.15.122:0/2080140141 shutdown_connections 2024-09-15T12:38:21.404 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.401+0000 7f3a88477ec0 1 --2- 172.21.15.122:0/2080140141 >> v2:172.21.15.122:6800/2464407069 conn(0x136bf70 0x136c380 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.404 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.401+0000 7f3a88477ec0 1 --2- 172.21.15.122:0/2080140141 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f3a6803d1c0 0x7f3a6803f6d0 unknown :-1 s=CLOSED pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.404 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.401+0000 7f3a88477ec0 1 --2- 172.21.15.122:0/2080140141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x12d54d0 0x12c5f90 unknown :-1 s=CLOSED pgs=12872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:21.404 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.401+0000 7f3a88477ec0 1 -- 172.21.15.122:0/2080140141 >> 172.21.15.122:0/2080140141 conn(0x1166770 msgr2=0x123f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:21.404 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.401+0000 7f3a88477ec0 1 -- 172.21.15.122:0/2080140141 shutdown_connections 2024-09-15T12:38:21.404 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:21.401+0000 7f3a88477ec0 1 -- 172.21.15.122:0/2080140141 wait complete. 2024-09-15T12:38:21.405 INFO:tasks.workunit.client.0.smithi122.stderr:+ sleep 30 2024-09-15T12:38:51.408 INFO:tasks.workunit.client.0.smithi122.stderr:+ pid=96349 2024-09-15T12:38:51.408 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph osd pool set-quota ed9b5ffb-fd10-45e9-a651-fa504ac931a6 max_objects 100 2024-09-15T12:38:51.408 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p ed9b5ffb-fd10-45e9-a651-fa504ac931a6 put onemore /etc/passwd 2024-09-15T12:38:51.450 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.447+0000 7ff1bc6edec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:51.457 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.454+0000 7ff1bc6edec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:51.457 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.454+0000 7ff1bc6edec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:51.457 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.455+0000 7ff1bc6edec0 1 Processor -- start 2024-09-15T12:38:51.458 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.455+0000 7ff1bc6edec0 1 -- start start 2024-09-15T12:38:51.459 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.456+0000 7ff1bc6edec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7869b0 0x6f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:51.460 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.456+0000 7ff1bc6edec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x658520 con 0x7869b0 2024-09-15T12:38:51.460 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.456+0000 7ff1b4b9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7869b0 0x6f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:51.460 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.456+0000 7ff1b4b9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7869b0 0x6f79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52392/0 (socket says 172.21.15.122:52392) 2024-09-15T12:38:51.460 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.456+0000 7ff1b4b9b640 1 -- 172.21.15.122:0/3600143802 learned_addr learned my addr 172.21.15.122:0/3600143802 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:51.460 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.456+0000 7ff1b4b9b640 1 -- 172.21.15.122:0/3600143802 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5f4e10 con 0x7869b0 2024-09-15T12:38:51.460 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.456+0000 7ff1b4b9b640 1 --2- 172.21.15.122:0/3600143802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7869b0 0x6f79b0 crc :-1 s=READY pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c6d85ec2348605 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:51.460 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.456+0000 7ff1aeffd640 1 -- 172.21.15.122:0/3600143802 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff1a000b580 con 0x7869b0 2024-09-15T12:38:51.460 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.456+0000 7ff1aeffd640 1 -- 172.21.15.122:0/3600143802 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff1a000b6e0 con 0x7869b0 2024-09-15T12:38:51.460 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.456+0000 7ff1aeffd640 1 -- 172.21.15.122:0/3600143802 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff1a000b980 con 0x7869b0 2024-09-15T12:38:51.462 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.457+0000 7ff1bc6edec0 1 -- 172.21.15.122:0/3600143802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7869b0 msgr2=0x6f79b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:51.462 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.457+0000 7ff1bc6edec0 1 --2- 172.21.15.122:0/3600143802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7869b0 0x6f79b0 crc :-1 s=READY pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:51.462 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.457+0000 7ff1bc6edec0 1 -- 172.21.15.122:0/3600143802 shutdown_connections 2024-09-15T12:38:51.462 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.457+0000 7ff1bc6edec0 1 --2- 172.21.15.122:0/3600143802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7869b0 0x6f79b0 unknown :-1 s=CLOSED pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:51.462 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.457+0000 7ff1bc6edec0 1 -- 172.21.15.122:0/3600143802 >> 172.21.15.122:0/3600143802 conn(0x618770 msgr2=0x6efe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:51.462 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.457+0000 7ff1bc6edec0 1 -- 172.21.15.122:0/3600143802 shutdown_connections 2024-09-15T12:38:51.462 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.457+0000 7ff1bc6edec0 1 -- 172.21.15.122:0/3600143802 wait complete. 2024-09-15T12:38:51.462 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.458+0000 7ff1bc6edec0 1 Processor -- start 2024-09-15T12:38:51.462 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.458+0000 7ff1bc6edec0 1 -- start start 2024-09-15T12:38:51.464 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.460+0000 7ff1bc6edec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7869b0 0x772e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:51.464 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.460+0000 7ff1bc6edec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x656280 con 0x7869b0 2024-09-15T12:38:51.464 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.460+0000 7ff1b4b9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7869b0 0x772e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:51.464 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.460+0000 7ff1b4b9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7869b0 0x772e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52408/0 (socket says 172.21.15.122:52408) 2024-09-15T12:38:51.464 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.460+0000 7ff1b4b9b640 1 -- 172.21.15.122:0/4133970406 learned_addr learned my addr 172.21.15.122:0/4133970406 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:51.465 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.460+0000 7ff1b4b9b640 1 -- 172.21.15.122:0/4133970406 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5e6920 con 0x7869b0 2024-09-15T12:38:51.465 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.460+0000 7ff1b4b9b640 1 --2- 172.21.15.122:0/4133970406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7869b0 0x772e70 crc :-1 s=READY pgs=12876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:51.465 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.460+0000 7ff1adffb640 1 -- 172.21.15.122:0/4133970406 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff1a00129c0 con 0x7869b0 2024-09-15T12:38:51.465 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.460+0000 7ff1adffb640 1 -- 172.21.15.122:0/4133970406 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff1a0005040 con 0x7869b0 2024-09-15T12:38:51.465 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.461+0000 7ff1bc6edec0 1 -- 172.21.15.122:0/4133970406 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5e6380 con 0x7869b0 2024-09-15T12:38:51.465 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.461+0000 7ff1adffb640 1 -- 172.21.15.122:0/4133970406 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff1a0012c50 con 0x7869b0 2024-09-15T12:38:51.465 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.461+0000 7ff1bc6edec0 1 -- 172.21.15.122:0/4133970406 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x773e00 con 0x7869b0 2024-09-15T12:38:51.466 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.462+0000 7ff1adffb640 1 -- 172.21.15.122:0/4133970406 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff1a000d040 con 0x7869b0 2024-09-15T12:38:51.466 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.462+0000 7ff1adffb640 1 --2- 172.21.15.122:0/4133970406 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7ff19003d170 0x7ff19003f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:51.466 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.462+0000 7ff1adffb640 1 -- 172.21.15.122:0/4133970406 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(697..697 src has 621..697) ==== 3819+0+0 (crc 0 0 0) 0x7ff1a000a040 con 0x7869b0 2024-09-15T12:38:51.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.463+0000 7ff1adffb640 1 -- 172.21.15.122:0/4133970406 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=698}) -- 0x7ff190043460 con 0x7869b0 2024-09-15T12:38:51.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.463+0000 7ff1bc6edec0 1 --2- 172.21.15.122:0/4133970406 >> v2:172.21.15.142:6803/3269009979 conn(0x7874d0 0x81bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:51.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.463+0000 7ff1a7fff640 1 --2- 172.21.15.122:0/4133970406 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7ff19003d170 0x7ff19003f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:51.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.463+0000 7ff1a7fff640 1 --2- 172.21.15.122:0/4133970406 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7ff19003d170 0x7ff19003f680 crc :-1 s=READY pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:51.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.464+0000 7ff1b539c640 1 --2- 172.21.15.122:0/4133970406 >> v2:172.21.15.142:6803/3269009979 conn(0x7874d0 0x81bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:38:51.470 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.467+0000 7ff1b539c640 1 --2- 172.21.15.122:0/4133970406 >> v2:172.21.15.142:6803/3269009979 conn(0x7874d0 0x81bcf0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:51.521 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.508+0000 7fb456afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:51.522 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.519+0000 7fb456afd640 1 Processor -- start 2024-09-15T12:38:51.522 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.519+0000 7fb456afd640 1 -- start start 2024-09-15T12:38:51.524 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.520+0000 7fb456afd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb45006e6e0 0x7fb45006eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:51.525 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.520+0000 7fb456afd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb45006dd50 con 0x7fb450136070 2024-09-15T12:38:51.525 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.520+0000 7fb456afd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb45006e290 con 0x7fb45006e6e0 2024-09-15T12:38:51.525 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.521+0000 7fb454899640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb45006e6e0 0x7fb45006eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:51.525 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.521+0000 7fb454899640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb45006e6e0 0x7fb45006eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52414/0 (socket says 172.21.15.122:52414) 2024-09-15T12:38:51.525 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.521+0000 7fb454899640 1 -- 172.21.15.122:0/137636323 learned_addr learned my addr 172.21.15.122:0/137636323 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:51.525 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.521+0000 7fb44ffff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fb450136070 0x7fb450136480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:38830/0 (socket says 172.21.15.122:38830) 2024-09-15T12:38:51.525 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.521+0000 7fb454899640 1 -- 172.21.15.122:0/137636323 >> v1:172.21.15.122:6789/0 conn(0x7fb450136070 legacy=0x7fb450136480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:51.525 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.521+0000 7fb454899640 1 -- 172.21.15.122:0/137636323 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45006f590 con 0x7fb45006e6e0 2024-09-15T12:38:51.525 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.521+0000 7fb454899640 1 --2- 172.21.15.122:0/137636323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb45006e6e0 0x7fb45006eaf0 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e8f3db80208985 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:51.525 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.521+0000 7fb44f7fe640 1 -- 172.21.15.122:0/137636323 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb440009e40 con 0x7fb45006e6e0 2024-09-15T12:38:51.525 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.521+0000 7fb44f7fe640 1 -- 172.21.15.122:0/137636323 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb44000e230 con 0x7fb45006e6e0 2024-09-15T12:38:51.525 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.521+0000 7fb44f7fe640 1 -- 172.21.15.122:0/137636323 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb44000e4d0 con 0x7fb45006e6e0 2024-09-15T12:38:51.526 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.522+0000 7fb456afd640 1 -- 172.21.15.122:0/137636323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb45006e6e0 msgr2=0x7fb45006eaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:51.526 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.522+0000 7fb456afd640 1 --2- 172.21.15.122:0/137636323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb45006e6e0 0x7fb45006eaf0 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:51.527 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.522+0000 7fb456afd640 1 -- 172.21.15.122:0/137636323 shutdown_connections 2024-09-15T12:38:51.527 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.522+0000 7fb456afd640 1 --2- 172.21.15.122:0/137636323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb45006e6e0 0x7fb45006eaf0 unknown :-1 s=CLOSED pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:51.527 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.522+0000 7fb456afd640 1 -- 172.21.15.122:0/137636323 >> 172.21.15.122:0/137636323 conn(0x7fb4500a31b0 msgr2=0x7fb4500a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:51.527 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.522+0000 7fb456afd640 1 -- 172.21.15.122:0/137636323 shutdown_connections 2024-09-15T12:38:51.527 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.522+0000 7fb456afd640 1 -- 172.21.15.122:0/137636323 wait complete. 2024-09-15T12:38:51.527 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.523+0000 7fb456afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:51.527 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.524+0000 7fb456afd640 1 Processor -- start 2024-09-15T12:38:51.527 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.524+0000 7fb456afd640 1 -- start start 2024-09-15T12:38:51.529 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.525+0000 7fb456afd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb45006e6e0 0x7fb450122200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:51.529 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.525+0000 7fb456afd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb4501218b0 con 0x7fb45006e6e0 2024-09-15T12:38:51.529 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.525+0000 7fb454899640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb45006e6e0 0x7fb450122200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:51.529 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.525+0000 7fb454899640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb45006e6e0 0x7fb450122200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52420/0 (socket says 172.21.15.122:52420) 2024-09-15T12:38:51.529 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.525+0000 7fb454899640 1 -- 172.21.15.122:0/3023931977 learned_addr learned my addr 172.21.15.122:0/3023931977 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:51.530 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.526+0000 7fb454899640 1 -- 172.21.15.122:0/3023931977 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb450121e40 con 0x7fb45006e6e0 2024-09-15T12:38:51.530 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.526+0000 7fb454899640 1 --2- 172.21.15.122:0/3023931977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb45006e6e0 0x7fb450122200 crc :-1 s=READY pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:51.530 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.526+0000 7fb44d7fa640 1 -- 172.21.15.122:0/3023931977 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb44000ee10 con 0x7fb45006e6e0 2024-09-15T12:38:51.530 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.526+0000 7fb44d7fa640 1 -- 172.21.15.122:0/3023931977 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb440015420 con 0x7fb45006e6e0 2024-09-15T12:38:51.530 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.526+0000 7fb456afd640 1 -- 172.21.15.122:0/3023931977 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb450124d80 con 0x7fb45006e6e0 2024-09-15T12:38:51.530 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.526+0000 7fb44d7fa640 1 -- 172.21.15.122:0/3023931977 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb4400156c0 con 0x7fb45006e6e0 2024-09-15T12:38:51.530 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.526+0000 7fb456afd640 1 -- 172.21.15.122:0/3023931977 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4501240c0 con 0x7fb45006e6e0 2024-09-15T12:38:51.531 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.527+0000 7fb44d7fa640 1 -- 172.21.15.122:0/3023931977 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb4400158c0 con 0x7fb45006e6e0 2024-09-15T12:38:51.531 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.527+0000 7fb456afd640 1 -- 172.21.15.122:0/3023931977 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb450070290 con 0x7fb45006e6e0 2024-09-15T12:38:51.531 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.527+0000 7fb44d7fa640 1 --2- 172.21.15.122:0/3023931977 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb43003e910 0x7fb430040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:51.531 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.527+0000 7fb44d7fa640 1 -- 172.21.15.122:0/3023931977 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(697..697 src has 621..697) ==== 3819+0+0 (crc 0 0 0) 0x7fb4400511b0 con 0x7fb45006e6e0 2024-09-15T12:38:51.531 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.528+0000 7fb44d7fa640 1 -- 172.21.15.122:0/3023931977 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=698}) -- 0x7fb430044ba0 con 0x7fb45006e6e0 2024-09-15T12:38:51.531 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.528+0000 7fb44ffff640 1 --2- 172.21.15.122:0/3023931977 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb43003e910 0x7fb430040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:51.531 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.528+0000 7fb44ffff640 1 --2- 172.21.15.122:0/3023931977 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb43003e910 0x7fb430040e20 crc :-1 s=READY pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:51.535 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.533+0000 7fb44d7fa640 1 -- 172.21.15.122:0/3023931977 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fb440014c60 con 0x7fb45006e6e0 2024-09-15T12:38:51.710 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:51.707+0000 7fb456afd640 1 -- 172.21.15.122:0/3023931977 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_objects", "val": "100"} v 0) -- 0x7fb45006a450 con 0x7fb45006e6e0 2024-09-15T12:38:52.674 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:52.671+0000 7fb44d7fa640 1 -- 172.21.15.122:0/3023931977 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 v698) ==== 225+0+0 (crc 0 0 0) 0x7fb440012b80 con 0x7fb45006e6e0 2024-09-15T12:38:52.677 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:52.673+0000 7ff1adffb640 1 -- 172.21.15.122:0/4133970406 <== mon.0 v2:172.21.15.122:3300/0 6 ==== osd_map(698..698 src has 621..698) ==== 628+0+0 (crc 0 0 0) 0x7ff1a000d2f0 con 0x7869b0 2024-09-15T12:38:52.677 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:52.673+0000 7fb44d7fa640 1 -- 172.21.15.122:0/3023931977 <== mon.0 v2:172.21.15.122:3300/0 8 ==== osd_map(698..698 src has 621..698) ==== 628+0+0 (crc 0 0 0) 0x7fb440012d40 con 0x7fb45006e6e0 2024-09-15T12:38:52.677 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:52.673+0000 7ff1adffb640 1 -- 172.21.15.122:0/4133970406 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=699}) -- 0x7ff190043ba0 con 0x7869b0 2024-09-15T12:38:52.677 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:52.673+0000 7fb44d7fa640 1 -- 172.21.15.122:0/3023931977 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=699}) -- 0x7fb430045b50 con 0x7fb45006e6e0 2024-09-15T12:38:52.798 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:52.796+0000 7fb456afd640 1 -- 172.21.15.122:0/3023931977 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_objects", "val": "100"} v 0) -- 0x7fb450125310 con 0x7fb45006e6e0 2024-09-15T12:38:53.121 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.118+0000 7fb44d7fa640 1 -- 172.21.15.122:0/3023931977 <== mon.0 v2:172.21.15.122:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 v699) ==== 225+0+0 (crc 0 0 0) 0x7fb44000f2a0 con 0x7fb45006e6e0 2024-09-15T12:38:53.122 INFO:tasks.workunit.client.0.smithi122.stderr:set-quota max_objects = 100 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 2024-09-15T12:38:53.122 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.118+0000 7fb44d7fa640 1 -- 172.21.15.122:0/3023931977 <== mon.0 v2:172.21.15.122:3300/0 10 ==== osd_map(699..699 src has 621..699) ==== 628+0+0 (crc 0 0 0) 0x7fb440011dd0 con 0x7fb45006e6e0 2024-09-15T12:38:53.122 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.118+0000 7fb44d7fa640 1 -- 172.21.15.122:0/3023931977 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=700}) -- 0x7fb430045c00 con 0x7fb45006e6e0 2024-09-15T12:38:53.122 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.118+0000 7ff1adffb640 1 -- 172.21.15.122:0/4133970406 <== mon.0 v2:172.21.15.122:3300/0 7 ==== osd_map(699..699 src has 621..699) ==== 628+0+0 (crc 0 0 0) 0x7ff1a000de10 con 0x7869b0 2024-09-15T12:38:53.122 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.118+0000 7ff1adffb640 1 -- 172.21.15.122:0/4133970406 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=700}) -- 0x7ff190043dc0 con 0x7869b0 2024-09-15T12:38:53.122 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.118+0000 7ff1adffb640 1 -- 172.21.15.122:0/4133970406 --> v2:172.21.15.142:6803/3269009979 -- osd_op(unknown.0.0:1 199.5 199:b9ff7440:::onemore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e699) -- 0x7ff190043fe0 con 0x7874d0 2024-09-15T12:38:53.124 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.120+0000 7fb456afd640 1 -- 172.21.15.122:0/3023931977 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb43003e910 msgr2=0x7fb430040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:53.124 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.120+0000 7fb456afd640 1 --2- 172.21.15.122:0/3023931977 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb43003e910 0x7fb430040e20 crc :-1 s=READY pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.124 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.120+0000 7fb456afd640 1 -- 172.21.15.122:0/3023931977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb45006e6e0 msgr2=0x7fb450122200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:53.124 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.120+0000 7fb456afd640 1 --2- 172.21.15.122:0/3023931977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb45006e6e0 0x7fb450122200 crc :-1 s=READY pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.124 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.121+0000 7fb456afd640 1 -- 172.21.15.122:0/3023931977 shutdown_connections 2024-09-15T12:38:53.124 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.121+0000 7fb456afd640 1 --2- 172.21.15.122:0/3023931977 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb43003e910 0x7fb430040e20 unknown :-1 s=CLOSED pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.124 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.121+0000 7fb456afd640 1 --2- 172.21.15.122:0/3023931977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb45006e6e0 0x7fb450122200 unknown :-1 s=CLOSED pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.124 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.121+0000 7fb456afd640 1 -- 172.21.15.122:0/3023931977 >> 172.21.15.122:0/3023931977 conn(0x7fb4500a31b0 msgr2=0x7fb4500a73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:53.124 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.121+0000 7fb456afd640 1 -- 172.21.15.122:0/3023931977 shutdown_connections 2024-09-15T12:38:53.125 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.121+0000 7fb456afd640 1 -- 172.21.15.122:0/3023931977 wait complete. 2024-09-15T12:38:53.137 INFO:tasks.workunit.client.0.smithi122.stderr:+ wait 96349 2024-09-15T12:38:53.170 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.167+0000 7ff1b539c640 1 -- 172.21.15.122:0/4133970406 <== osd.2 v2:172.21.15.142:6803/3269009979 1 ==== osd_op_reply(1 onemore [writefull 0~12875] v699'2 uv2 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7ff1a800a430 con 0x7874d0 2024-09-15T12:38:53.170 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.167+0000 7ff1bc6edec0 1 -- 172.21.15.122:0/4133970406 >> v2:172.21.15.142:6803/3269009979 conn(0x7874d0 msgr2=0x81bcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:53.170 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.167+0000 7ff1bc6edec0 1 --2- 172.21.15.122:0/4133970406 >> v2:172.21.15.142:6803/3269009979 conn(0x7874d0 0x81bcf0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.170 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.167+0000 7ff1bc6edec0 1 -- 172.21.15.122:0/4133970406 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7ff19003d170 msgr2=0x7ff19003f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:53.170 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.167+0000 7ff1bc6edec0 1 --2- 172.21.15.122:0/4133970406 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7ff19003d170 0x7ff19003f680 crc :-1 s=READY pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.170 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.167+0000 7ff1bc6edec0 1 -- 172.21.15.122:0/4133970406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7869b0 msgr2=0x772e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:53.170 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.167+0000 7ff1bc6edec0 1 --2- 172.21.15.122:0/4133970406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7869b0 0x772e70 crc :-1 s=READY pgs=12876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.170 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.167+0000 7ff1bc6edec0 1 -- 172.21.15.122:0/4133970406 shutdown_connections 2024-09-15T12:38:53.170 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.167+0000 7ff1bc6edec0 1 --2- 172.21.15.122:0/4133970406 >> v2:172.21.15.142:6803/3269009979 conn(0x7874d0 0x81bcf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.170 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.167+0000 7ff1bc6edec0 1 --2- 172.21.15.122:0/4133970406 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7ff19003d170 0x7ff19003f680 unknown :-1 s=CLOSED pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.170 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.167+0000 7ff1bc6edec0 1 --2- 172.21.15.122:0/4133970406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7869b0 0x772e70 unknown :-1 s=CLOSED pgs=12876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.170 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.167+0000 7ff1bc6edec0 1 -- 172.21.15.122:0/4133970406 >> 172.21.15.122:0/4133970406 conn(0x618770 msgr2=0x6efc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:53.171 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.167+0000 7ff1bc6edec0 1 -- 172.21.15.122:0/4133970406 shutdown_connections 2024-09-15T12:38:53.171 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.167+0000 7ff1bc6edec0 1 -- 172.21.15.122:0/4133970406 wait complete. 2024-09-15T12:38:53.172 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -ne 0 ']' 2024-09-15T12:38:53.172 INFO:tasks.workunit.client.0.smithi122.stderr:+ true 2024-09-15T12:38:53.172 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p ed9b5ffb-fd10-45e9-a651-fa504ac931a6 put twomore /etc/passwd 2024-09-15T12:38:53.208 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.205+0000 7f67b4c2bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:53.213 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.210+0000 7f67b4c2bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:53.213 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.210+0000 7f67b4c2bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:53.214 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.211+0000 7f67b4c2bec0 1 Processor -- start 2024-09-15T12:38:53.214 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.211+0000 7f67b4c2bec0 1 -- start start 2024-09-15T12:38:53.215 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.212+0000 7f67b4c2bec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x78afc0 0x895560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:53.216 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.212+0000 7f67b4c2bec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x6f7520 con 0x78afc0 2024-09-15T12:38:53.216 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.212+0000 7f67acd9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x78afc0 0x895560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:53.216 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.212+0000 7f67acd9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x78afc0 0x895560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:55952/0 (socket says 172.21.15.122:55952) 2024-09-15T12:38:53.216 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.212+0000 7f67acd9b640 1 -- 172.21.15.122:0/77979929 learned_addr learned my addr 172.21.15.122:0/77979929 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:53.216 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.212+0000 7f67acd9b640 1 -- 172.21.15.122:0/77979929 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x693e10 con 0x78afc0 2024-09-15T12:38:53.216 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.212+0000 7f67acd9b640 1 --2- 172.21.15.122:0/77979929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x78afc0 0x895560 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918a317bc947646 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:53.216 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.212+0000 7f67a67fc640 1 -- 172.21.15.122:0/77979929 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f679800c5e0 con 0x78afc0 2024-09-15T12:38:53.216 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.212+0000 7f67a67fc640 1 -- 172.21.15.122:0/77979929 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f679800c740 con 0x78afc0 2024-09-15T12:38:53.216 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.212+0000 7f67a67fc640 1 -- 172.21.15.122:0/77979929 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f679800c9e0 con 0x78afc0 2024-09-15T12:38:53.217 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.213+0000 7f67b4c2bec0 1 -- 172.21.15.122:0/77979929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x78afc0 msgr2=0x895560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:53.217 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.213+0000 7f67b4c2bec0 1 --2- 172.21.15.122:0/77979929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x78afc0 0x895560 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.218 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.213+0000 7f67b4c2bec0 1 -- 172.21.15.122:0/77979929 shutdown_connections 2024-09-15T12:38:53.218 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.213+0000 7f67b4c2bec0 1 --2- 172.21.15.122:0/77979929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x78afc0 0x895560 unknown :-1 s=CLOSED pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.218 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.213+0000 7f67b4c2bec0 1 -- 172.21.15.122:0/77979929 >> 172.21.15.122:0/77979929 conn(0x6b7770 msgr2=0x78c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:53.218 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.213+0000 7f67b4c2bec0 1 -- 172.21.15.122:0/77979929 shutdown_connections 2024-09-15T12:38:53.218 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.213+0000 7f67b4c2bec0 1 -- 172.21.15.122:0/77979929 wait complete. 2024-09-15T12:38:53.218 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.214+0000 7f67b4c2bec0 1 Processor -- start 2024-09-15T12:38:53.218 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.214+0000 7f67b4c2bec0 1 -- start start 2024-09-15T12:38:53.220 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.215+0000 7f67b4c2bec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x78afc0 0x8b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:53.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.215+0000 7f67b4c2bec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x6f5280 con 0x78afc0 2024-09-15T12:38:53.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.215+0000 7f67acd9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x78afc0 0x8b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:53.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.215+0000 7f67acd9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x78afc0 0x8b87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:55962/0 (socket says 172.21.15.122:55962) 2024-09-15T12:38:53.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.215+0000 7f67acd9b640 1 -- 172.21.15.122:0/3861854860 learned_addr learned my addr 172.21.15.122:0/3861854860 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:53.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.215+0000 7f67acd9b640 1 -- 172.21.15.122:0/3861854860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x685920 con 0x78afc0 2024-09-15T12:38:53.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.215+0000 7f67acd9b640 1 --2- 172.21.15.122:0/3861854860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x78afc0 0x8b87a0 crc :-1 s=READY pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:53.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.216+0000 7f67a57fa640 1 -- 172.21.15.122:0/3861854860 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f67980139f0 con 0x78afc0 2024-09-15T12:38:53.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.216+0000 7f67a57fa640 1 -- 172.21.15.122:0/3861854860 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6798013b50 con 0x78afc0 2024-09-15T12:38:53.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.216+0000 7f67b4c2bec0 1 -- 172.21.15.122:0/3861854860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x685380 con 0x78afc0 2024-09-15T12:38:53.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.216+0000 7f67a57fa640 1 -- 172.21.15.122:0/3861854860 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6798013df0 con 0x78afc0 2024-09-15T12:38:53.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.216+0000 7f67b4c2bec0 1 -- 172.21.15.122:0/3861854860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x898df0 con 0x78afc0 2024-09-15T12:38:53.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.217+0000 7f67a57fa640 1 -- 172.21.15.122:0/3861854860 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6798010400 con 0x78afc0 2024-09-15T12:38:53.222 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.217+0000 7f67a57fa640 1 --2- 172.21.15.122:0/3861854860 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f679403f3d0 0x7f67940418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:53.222 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.217+0000 7f67a57fa640 1 -- 172.21.15.122:0/3861854860 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(699..699 src has 621..699) ==== 3819+0+0 (crc 0 0 0) 0x7f6798008040 con 0x78afc0 2024-09-15T12:38:53.222 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.217+0000 7f67b4c2bec0 1 --2- 172.21.15.122:0/3861854860 >> v2:172.21.15.142:6811/2150609480 conn(0x793300 0x897ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:53.222 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.217+0000 7f67b4c2bec0 1 -- 172.21.15.122:0/3861854860 --> v2:172.21.15.142:6811/2150609480 -- osd_op(unknown.0.0:1 199.6 199:7019d845:::twomore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e699) -- 0x89ac50 con 0x793300 2024-09-15T12:38:53.222 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.217+0000 7f67a77fe640 1 --2- 172.21.15.122:0/3861854860 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f679403f3d0 0x7f67940418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:53.222 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.218+0000 7f67a77fe640 1 --2- 172.21.15.122:0/3861854860 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f679403f3d0 0x7f67940418e0 crc :-1 s=READY pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:53.222 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.218+0000 7f67ad59c640 1 --2- 172.21.15.122:0/3861854860 >> v2:172.21.15.142:6811/2150609480 conn(0x793300 0x897ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:38:53.223 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.220+0000 7f67ad59c640 1 --2- 172.21.15.122:0/3861854860 >> v2:172.21.15.142:6811/2150609480 conn(0x793300 0x897ab0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:53.238 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.235+0000 7f67ad59c640 1 -- 172.21.15.122:0/3861854860 <== osd.3 v2:172.21.15.142:6811/2150609480 1 ==== osd_op_reply(1 twomore [writefull 0~12875] v699'1 uv1 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f67a000a430 con 0x793300 2024-09-15T12:38:53.238 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.235+0000 7f67b4c2bec0 1 -- 172.21.15.122:0/3861854860 >> v2:172.21.15.142:6811/2150609480 conn(0x793300 msgr2=0x897ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:53.238 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.235+0000 7f67b4c2bec0 1 --2- 172.21.15.122:0/3861854860 >> v2:172.21.15.142:6811/2150609480 conn(0x793300 0x897ab0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.238 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.235+0000 7f67b4c2bec0 1 -- 172.21.15.122:0/3861854860 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f679403f3d0 msgr2=0x7f67940418e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:53.238 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.235+0000 7f67b4c2bec0 1 --2- 172.21.15.122:0/3861854860 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f679403f3d0 0x7f67940418e0 crc :-1 s=READY pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.238 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.235+0000 7f67b4c2bec0 1 -- 172.21.15.122:0/3861854860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x78afc0 msgr2=0x8b87a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:53.238 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.235+0000 7f67b4c2bec0 1 --2- 172.21.15.122:0/3861854860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x78afc0 0x8b87a0 crc :-1 s=READY pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.238 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.235+0000 7f67b4c2bec0 1 -- 172.21.15.122:0/3861854860 shutdown_connections 2024-09-15T12:38:53.238 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.235+0000 7f67b4c2bec0 1 --2- 172.21.15.122:0/3861854860 >> v2:172.21.15.142:6811/2150609480 conn(0x793300 0x897ab0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.239 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.235+0000 7f67b4c2bec0 1 --2- 172.21.15.122:0/3861854860 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f679403f3d0 0x7f67940418e0 unknown :-1 s=CLOSED pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.239 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.235+0000 7f67b4c2bec0 1 --2- 172.21.15.122:0/3861854860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x78afc0 0x8b87a0 unknown :-1 s=CLOSED pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.239 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.235+0000 7f67b4c2bec0 1 -- 172.21.15.122:0/3861854860 >> 172.21.15.122:0/3861854860 conn(0x6b7770 msgr2=0x78c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:53.239 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.235+0000 7f67b4c2bec0 1 -- 172.21.15.122:0/3861854860 shutdown_connections 2024-09-15T12:38:53.239 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.235+0000 7f67b4c2bec0 1 -- 172.21.15.122:0/3861854860 wait complete. 2024-09-15T12:38:53.240 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph osd pool set-quota ed9b5ffb-fd10-45e9-a651-fa504ac931a6 max_bytes 100 2024-09-15T12:38:53.332 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.321+0000 7f7b47751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:53.333 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.330+0000 7f7b47751640 1 Processor -- start 2024-09-15T12:38:53.333 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.330+0000 7f7b47751640 1 -- start start 2024-09-15T12:38:53.335 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.332+0000 7f7b47751640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7b4006f5d0 0x7f7b4013b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:53.335 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.332+0000 7f7b47751640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b40074c40 con 0x7f7b4006eab0 2024-09-15T12:38:53.335 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.332+0000 7f7b47751640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f7b400a5f00 con 0x7f7b4006f5d0 2024-09-15T12:38:53.335 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.332+0000 7f7b44cec640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7b4006f5d0 0x7f7b4013b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:53.335 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.332+0000 7f7b44cec640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7b4006f5d0 0x7f7b4013b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:55976/0 (socket says 172.21.15.122:55976) 2024-09-15T12:38:53.336 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.332+0000 7f7b44cec640 1 -- 172.21.15.122:0/1818310312 learned_addr learned my addr 172.21.15.122:0/1818310312 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:53.336 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.332+0000 7f7b454ed640 1 --1- 172.21.15.122:0/1818310312 >> v1:172.21.15.122:6789/0 conn(0x7f7b4006eab0 0x7f7b4006eec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:59404/0 (socket says 172.21.15.122:59404) 2024-09-15T12:38:53.336 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.332+0000 7f7b44cec640 1 -- 172.21.15.122:0/1818310312 >> v1:172.21.15.122:6789/0 conn(0x7f7b4006eab0 legacy=0x7f7b4006eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:53.336 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.332+0000 7f7b44cec640 1 -- 172.21.15.122:0/1818310312 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b400a6290 con 0x7f7b4006f5d0 2024-09-15T12:38:53.336 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.332+0000 7f7b37fff640 1 -- 172.21.15.122:0/1818310312 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4265523 0 0) 0x7f7b40074c40 con 0x7f7b4006eab0 2024-09-15T12:38:53.336 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.332+0000 7f7b44cec640 1 --2- 172.21.15.122:0/1818310312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4006f5d0 0x7f7b4013b350 crc :-1 s=READY pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc81f488fdb69fbf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:53.336 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.332+0000 7f7b37fff640 1 -- 172.21.15.122:0/1818310312 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7b30009e50 con 0x7f7b4006f5d0 2024-09-15T12:38:53.336 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.332+0000 7f7b37fff640 1 -- 172.21.15.122:0/1818310312 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7b3000e230 con 0x7f7b4006f5d0 2024-09-15T12:38:53.336 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.332+0000 7f7b37fff640 1 -- 172.21.15.122:0/1818310312 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7b3000e4d0 con 0x7f7b4006f5d0 2024-09-15T12:38:53.337 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.333+0000 7f7b47751640 1 -- 172.21.15.122:0/1818310312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4006f5d0 msgr2=0x7f7b4013b350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:53.337 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.333+0000 7f7b47751640 1 --2- 172.21.15.122:0/1818310312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4006f5d0 0x7f7b4013b350 crc :-1 s=READY pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.338 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.333+0000 7f7b47751640 1 -- 172.21.15.122:0/1818310312 shutdown_connections 2024-09-15T12:38:53.338 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.333+0000 7f7b47751640 1 --2- 172.21.15.122:0/1818310312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4006f5d0 0x7f7b4013b350 unknown :-1 s=CLOSED pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:53.338 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.333+0000 7f7b47751640 1 -- 172.21.15.122:0/1818310312 >> 172.21.15.122:0/1818310312 conn(0x7f7b400a43d0 msgr2=0x7f7b400a47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:53.338 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.333+0000 7f7b47751640 1 -- 172.21.15.122:0/1818310312 shutdown_connections 2024-09-15T12:38:53.338 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.333+0000 7f7b47751640 1 -- 172.21.15.122:0/1818310312 wait complete. 2024-09-15T12:38:53.338 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.333+0000 7f7b47751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:38:53.338 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.334+0000 7f7b47751640 1 Processor -- start 2024-09-15T12:38:53.338 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.334+0000 7f7b47751640 1 -- start start 2024-09-15T12:38:53.339 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.336+0000 7f7b47751640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4006eab0 0x7f7b401241e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:53.340 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.336+0000 7f7b47751640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7b40125260 con 0x7f7b4006eab0 2024-09-15T12:38:53.340 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.336+0000 7f7b454ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4006eab0 0x7f7b401241e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:53.340 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.336+0000 7f7b454ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4006eab0 0x7f7b401241e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:55980/0 (socket says 172.21.15.122:55980) 2024-09-15T12:38:53.340 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.336+0000 7f7b454ed640 1 -- 172.21.15.122:0/1846995155 learned_addr learned my addr 172.21.15.122:0/1846995155 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:38:53.340 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.336+0000 7f7b454ed640 1 -- 172.21.15.122:0/1846995155 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b40123e20 con 0x7f7b4006eab0 2024-09-15T12:38:53.340 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.336+0000 7f7b454ed640 1 --2- 172.21.15.122:0/1846995155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4006eab0 0x7f7b401241e0 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:53.340 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.336+0000 7f7b35ffb640 1 -- 172.21.15.122:0/1846995155 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7b3c004b80 con 0x7f7b4006eab0 2024-09-15T12:38:53.340 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.336+0000 7f7b35ffb640 1 -- 172.21.15.122:0/1846995155 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7b3c004ce0 con 0x7f7b4006eab0 2024-09-15T12:38:53.340 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.336+0000 7f7b35ffb640 1 -- 172.21.15.122:0/1846995155 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7b3c007120 con 0x7f7b4006eab0 2024-09-15T12:38:53.340 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.336+0000 7f7b47751640 1 -- 172.21.15.122:0/1846995155 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b401276a0 con 0x7f7b4006eab0 2024-09-15T12:38:53.340 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.336+0000 7f7b47751640 1 -- 172.21.15.122:0/1846995155 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b40126180 con 0x7f7b4006eab0 2024-09-15T12:38:53.341 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.337+0000 7f7b35ffb640 1 -- 172.21.15.122:0/1846995155 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f7b3c007320 con 0x7f7b4006eab0 2024-09-15T12:38:53.341 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.337+0000 7f7b47751640 1 -- 172.21.15.122:0/1846995155 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b40073790 con 0x7f7b4006eab0 2024-09-15T12:38:53.341 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.338+0000 7f7b35ffb640 1 --2- 172.21.15.122:0/1846995155 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f7b2403e910 0x7f7b24040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:38:53.341 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.338+0000 7f7b35ffb640 1 -- 172.21.15.122:0/1846995155 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(699..699 src has 621..699) ==== 3819+0+0 (crc 0 0 0) 0x7f7b3c04fd00 con 0x7f7b4006eab0 2024-09-15T12:38:53.342 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.338+0000 7f7b44cec640 1 --2- 172.21.15.122:0/1846995155 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f7b2403e910 0x7f7b24040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:38:53.342 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.339+0000 7f7b44cec640 1 --2- 172.21.15.122:0/1846995155 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f7b2403e910 0x7f7b24040e20 crc :-1 s=READY pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:38:53.345 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.343+0000 7f7b35ffb640 1 -- 172.21.15.122:0/1846995155 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f7b3c00f230 con 0x7f7b4006eab0 2024-09-15T12:38:53.524 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:53.520+0000 7f7b47751640 1 -- 172.21.15.122:0/1846995155 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_bytes", "val": "100"} v 0) -- 0x7f7b40123770 con 0x7f7b4006eab0 2024-09-15T12:38:54.127 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:54.125+0000 7f7b35ffb640 1 -- 172.21.15.122:0/1846995155 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 v700) ==== 221+0+0 (crc 0 0 0) 0x7f7b3c00a0c0 con 0x7f7b4006eab0 2024-09-15T12:38:54.252 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:54.250+0000 7f7b47751640 1 -- 172.21.15.122:0/1846995155 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_bytes", "val": "100"} v 0) -- 0x7f7b400742e0 con 0x7f7b4006eab0 2024-09-15T12:38:55.134 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:55.131+0000 7f7b35ffb640 1 -- 172.21.15.122:0/1846995155 <== mon.0 v2:172.21.15.122:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 v701) ==== 221+0+0 (crc 0 0 0) 0x7f7b3c00a7b0 con 0x7f7b4006eab0 2024-09-15T12:38:55.134 INFO:tasks.workunit.client.0.smithi122.stderr:set-quota max_bytes = 100 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 2024-09-15T12:38:55.136 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:55.134+0000 7f7b47751640 1 -- 172.21.15.122:0/1846995155 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f7b2403e910 msgr2=0x7f7b24040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:55.136 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:55.134+0000 7f7b47751640 1 --2- 172.21.15.122:0/1846995155 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f7b2403e910 0x7f7b24040e20 crc :-1 s=READY pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:55.137 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:55.134+0000 7f7b47751640 1 -- 172.21.15.122:0/1846995155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4006eab0 msgr2=0x7f7b401241e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:38:55.137 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:55.134+0000 7f7b47751640 1 --2- 172.21.15.122:0/1846995155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4006eab0 0x7f7b401241e0 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:55.137 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:55.134+0000 7f7b47751640 1 -- 172.21.15.122:0/1846995155 shutdown_connections 2024-09-15T12:38:55.137 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:55.134+0000 7f7b47751640 1 --2- 172.21.15.122:0/1846995155 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f7b2403e910 0x7f7b24040e20 unknown :-1 s=CLOSED pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:55.137 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:55.134+0000 7f7b47751640 1 --2- 172.21.15.122:0/1846995155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b4006eab0 0x7f7b401241e0 unknown :-1 s=CLOSED pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:38:55.137 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:55.134+0000 7f7b47751640 1 -- 172.21.15.122:0/1846995155 >> 172.21.15.122:0/1846995155 conn(0x7f7b400a43d0 msgr2=0x7f7b4011cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:38:55.137 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:55.134+0000 7f7b47751640 1 -- 172.21.15.122:0/1846995155 shutdown_connections 2024-09-15T12:38:55.137 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:38:55.134+0000 7f7b47751640 1 -- 172.21.15.122:0/1846995155 wait complete. 2024-09-15T12:38:55.153 INFO:tasks.workunit.client.0.smithi122.stderr:+ sleep 30 2024-09-15T12:39:25.154 INFO:tasks.workunit.client.0.smithi122.stderr:+ pid=96440 2024-09-15T12:39:25.155 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph osd pool set-quota ed9b5ffb-fd10-45e9-a651-fa504ac931a6 max_bytes 0 2024-09-15T12:39:25.155 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p ed9b5ffb-fd10-45e9-a651-fa504ac931a6 put two /etc/passwd 2024-09-15T12:39:25.198 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.196+0000 7fa2cf52dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:39:25.203 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.202+0000 7fa2cf52dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:39:25.204 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.202+0000 7fa2cf52dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:39:25.204 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.202+0000 7fa2cf52dec0 1 Processor -- start 2024-09-15T12:39:25.204 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.202+0000 7fa2cf52dec0 1 -- start start 2024-09-15T12:39:25.205 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.203+0000 7fa2cf52dec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1fa2fc0 0x20c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:25.206 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.204+0000 7fa2cf52dec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x1f0f520 con 0x1fa2fc0 2024-09-15T12:39:25.206 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.204+0000 7fa2c2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1fa2fc0 0x20c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:25.206 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.204+0000 7fa2c2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1fa2fc0 0x20c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52552/0 (socket says 172.21.15.122:52552) 2024-09-15T12:39:25.206 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.204+0000 7fa2c2ffd640 1 -- 172.21.15.122:0/1301459800 learned_addr learned my addr 172.21.15.122:0/1301459800 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:39:25.207 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.204+0000 7fa2c2ffd640 1 -- 172.21.15.122:0/1301459800 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1eabe10 con 0x1fa2fc0 2024-09-15T12:39:25.207 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.204+0000 7fa2c2ffd640 1 --2- 172.21.15.122:0/1301459800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1fa2fc0 0x20c91b0 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e4de52e7ed768c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:25.207 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.204+0000 7fa2c17fa640 1 -- 172.21.15.122:0/1301459800 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa2b400b580 con 0x1fa2fc0 2024-09-15T12:39:25.207 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.204+0000 7fa2c17fa640 1 -- 172.21.15.122:0/1301459800 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa2b400b6e0 con 0x1fa2fc0 2024-09-15T12:39:25.207 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.204+0000 7fa2c17fa640 1 -- 172.21.15.122:0/1301459800 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa2b400b980 con 0x1fa2fc0 2024-09-15T12:39:25.208 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.205+0000 7fa2cf52dec0 1 -- 172.21.15.122:0/1301459800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1fa2fc0 msgr2=0x20c91b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:25.208 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.205+0000 7fa2cf52dec0 1 --2- 172.21.15.122:0/1301459800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1fa2fc0 0x20c91b0 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:25.208 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.206+0000 7fa2cf52dec0 1 -- 172.21.15.122:0/1301459800 shutdown_connections 2024-09-15T12:39:25.208 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.206+0000 7fa2cf52dec0 1 --2- 172.21.15.122:0/1301459800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1fa2fc0 0x20c91b0 unknown :-1 s=CLOSED pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:25.208 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.206+0000 7fa2cf52dec0 1 -- 172.21.15.122:0/1301459800 >> 172.21.15.122:0/1301459800 conn(0x1ecf770 msgr2=0x1fa4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:39:25.208 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.206+0000 7fa2cf52dec0 1 -- 172.21.15.122:0/1301459800 shutdown_connections 2024-09-15T12:39:25.208 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.206+0000 7fa2cf52dec0 1 -- 172.21.15.122:0/1301459800 wait complete. 2024-09-15T12:39:25.209 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.207+0000 7fa2cf52dec0 1 Processor -- start 2024-09-15T12:39:25.209 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.207+0000 7fa2cf52dec0 1 -- start start 2024-09-15T12:39:25.210 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.208+0000 7fa2cf52dec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1fa2fc0 0x20b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:25.210 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.208+0000 7fa2cf52dec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x1f0d280 con 0x1fa2fc0 2024-09-15T12:39:25.210 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.208+0000 7fa2c2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1fa2fc0 0x20b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:25.210 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.208+0000 7fa2c2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1fa2fc0 0x20b1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52564/0 (socket says 172.21.15.122:52564) 2024-09-15T12:39:25.210 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.208+0000 7fa2c2ffd640 1 -- 172.21.15.122:0/3752251335 learned_addr learned my addr 172.21.15.122:0/3752251335 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:39:25.212 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.208+0000 7fa2c2ffd640 1 -- 172.21.15.122:0/3752251335 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e9d920 con 0x1fa2fc0 2024-09-15T12:39:25.212 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.209+0000 7fa2c2ffd640 1 --2- 172.21.15.122:0/3752251335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1fa2fc0 0x20b1ad0 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:25.212 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.209+0000 7fa2abfff640 1 -- 172.21.15.122:0/3752251335 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa2b4012990 con 0x1fa2fc0 2024-09-15T12:39:25.212 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.209+0000 7fa2abfff640 1 -- 172.21.15.122:0/3752251335 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa2b4005040 con 0x1fa2fc0 2024-09-15T12:39:25.212 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.209+0000 7fa2abfff640 1 -- 172.21.15.122:0/3752251335 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa2b4012c20 con 0x1fa2fc0 2024-09-15T12:39:25.212 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.209+0000 7fa2cf52dec0 1 -- 172.21.15.122:0/3752251335 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1e9d380 con 0x1fa2fc0 2024-09-15T12:39:25.212 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.209+0000 7fa2cf52dec0 1 -- 172.21.15.122:0/3752251335 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x20c78c0 con 0x1fa2fc0 2024-09-15T12:39:25.212 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.210+0000 7fa2abfff640 1 -- 172.21.15.122:0/3752251335 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa2b400d040 con 0x1fa2fc0 2024-09-15T12:39:25.213 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.210+0000 7fa2abfff640 1 --2- 172.21.15.122:0/3752251335 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa2b003d170 0x7fa2b003f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:25.213 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.210+0000 7fa2abfff640 1 -- 172.21.15.122:0/3752251335 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(702..702 src has 621..702) ==== 3819+0+0 (crc 0 0 0) 0x7fa2b400a040 con 0x1fa2fc0 2024-09-15T12:39:25.214 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.210+0000 7fa2abfff640 1 -- 172.21.15.122:0/3752251335 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=703}) -- 0x7fa2b0043460 con 0x1fa2fc0 2024-09-15T12:39:25.214 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.210+0000 7fa2cf52dec0 1 --2- 172.21.15.122:0/3752251335 >> v2:172.21.15.142:6811/2150609480 conn(0x1fab300 0x20aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:25.214 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.211+0000 7fa2c27fc640 1 --2- 172.21.15.122:0/3752251335 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa2b003d170 0x7fa2b003f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:25.214 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.211+0000 7fa2c27fc640 1 --2- 172.21.15.122:0/3752251335 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa2b003d170 0x7fa2b003f680 crc :-1 s=READY pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:25.214 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.212+0000 7fa2c37fe640 1 --2- 172.21.15.122:0/3752251335 >> v2:172.21.15.142:6811/2150609480 conn(0x1fab300 0x20aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:39:25.218 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.216+0000 7fa2c37fe640 1 --2- 172.21.15.122:0/3752251335 >> v2:172.21.15.142:6811/2150609480 conn(0x1fab300 0x20aef70 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:25.256 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.246+0000 7f5335d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:39:25.258 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.256+0000 7f5335d91640 1 Processor -- start 2024-09-15T12:39:25.258 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.256+0000 7f5335d91640 1 -- start start 2024-09-15T12:39:25.260 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.257+0000 7f5335d91640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f533009ed30 0x7f53301362c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:25.260 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.257+0000 7f5335d91640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f533009fd50 con 0x7f5330136800 2024-09-15T12:39:25.260 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.257+0000 7f5335d91640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f533009fa40 con 0x7f533009ed30 2024-09-15T12:39:25.260 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.257+0000 7f532f7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f533009ed30 0x7f53301362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:25.260 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.257+0000 7f532f7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f533009ed30 0x7f53301362c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52574/0 (socket says 172.21.15.122:52574) 2024-09-15T12:39:25.260 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.257+0000 7f5327fff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f5330136800 0x7f533006ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:42244/0 (socket says 172.21.15.122:42244) 2024-09-15T12:39:25.260 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.257+0000 7f532f7fe640 1 -- 172.21.15.122:0/367021329 learned_addr learned my addr 172.21.15.122:0/367021329 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:39:25.261 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.257+0000 7f532f7fe640 1 -- 172.21.15.122:0/367021329 >> v1:172.21.15.122:6789/0 conn(0x7f5330136800 legacy=0x7f533006ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:25.261 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.258+0000 7f532effd640 1 -- 172.21.15.122:0/367021329 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 606494227 0 0) 0x7f533009fd50 con 0x7f5330136800 2024-09-15T12:39:25.261 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.258+0000 7f532f7fe640 1 -- 172.21.15.122:0/367021329 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533009ffe0 con 0x7f533009ed30 2024-09-15T12:39:25.261 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.258+0000 7f532f7fe640 1 --2- 172.21.15.122:0/367021329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009ed30 0x7f53301362c0 crc :-1 s=READY pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844ab108f6311ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:25.261 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.258+0000 7f532effd640 1 -- 172.21.15.122:0/367021329 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5320009e50 con 0x7f533009ed30 2024-09-15T12:39:25.261 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.258+0000 7f532effd640 1 -- 172.21.15.122:0/367021329 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f532000e230 con 0x7f533009ed30 2024-09-15T12:39:25.261 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.258+0000 7f532effd640 1 -- 172.21.15.122:0/367021329 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f532000e4d0 con 0x7f533009ed30 2024-09-15T12:39:25.262 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.259+0000 7f5335d91640 1 -- 172.21.15.122:0/367021329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009ed30 msgr2=0x7f53301362c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:25.262 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.259+0000 7f5335d91640 1 --2- 172.21.15.122:0/367021329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009ed30 0x7f53301362c0 crc :-1 s=READY pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:25.262 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.259+0000 7f5335d91640 1 -- 172.21.15.122:0/367021329 shutdown_connections 2024-09-15T12:39:25.262 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.259+0000 7f5335d91640 1 --2- 172.21.15.122:0/367021329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009ed30 0x7f53301362c0 unknown :-1 s=CLOSED pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:25.262 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.259+0000 7f5335d91640 1 -- 172.21.15.122:0/367021329 >> 172.21.15.122:0/367021329 conn(0x7f53300a5350 msgr2=0x7f53300a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:39:25.262 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.259+0000 7f5335d91640 1 -- 172.21.15.122:0/367021329 shutdown_connections 2024-09-15T12:39:25.263 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.259+0000 7f5335d91640 1 -- 172.21.15.122:0/367021329 wait complete. 2024-09-15T12:39:25.263 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.259+0000 7f5335d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:39:25.263 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.260+0000 7f5335d91640 1 Processor -- start 2024-09-15T12:39:25.263 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.260+0000 7f5335d91640 1 -- start start 2024-09-15T12:39:25.264 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.261+0000 7f5335d91640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009ed30 0x7f5330120980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:25.264 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.261+0000 7f5335d91640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5330122400 con 0x7f533009ed30 2024-09-15T12:39:25.264 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.262+0000 7f532f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009ed30 0x7f5330120980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:25.265 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.262+0000 7f532f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009ed30 0x7f5330120980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52576/0 (socket says 172.21.15.122:52576) 2024-09-15T12:39:25.265 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.262+0000 7f532f7fe640 1 -- 172.21.15.122:0/1564710497 learned_addr learned my addr 172.21.15.122:0/1564710497 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:39:25.265 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.262+0000 7f532f7fe640 1 -- 172.21.15.122:0/1564710497 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5330121db0 con 0x7f533009ed30 2024-09-15T12:39:25.265 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.262+0000 7f532f7fe640 1 --2- 172.21.15.122:0/1564710497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009ed30 0x7f5330120980 crc :-1 s=READY pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:25.265 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.262+0000 7f532cff9640 1 -- 172.21.15.122:0/1564710497 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f532000edc0 con 0x7f533009ed30 2024-09-15T12:39:25.265 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.262+0000 7f532cff9640 1 -- 172.21.15.122:0/1564710497 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5320015420 con 0x7f533009ed30 2024-09-15T12:39:25.265 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.262+0000 7f5335d91640 1 -- 172.21.15.122:0/1564710497 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5330121aa0 con 0x7f533009ed30 2024-09-15T12:39:25.265 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.262+0000 7f532cff9640 1 -- 172.21.15.122:0/1564710497 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f53200156c0 con 0x7f533009ed30 2024-09-15T12:39:25.265 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.262+0000 7f5335d91640 1 -- 172.21.15.122:0/1564710497 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5330123220 con 0x7f533009ed30 2024-09-15T12:39:25.266 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.263+0000 7f532cff9640 1 -- 172.21.15.122:0/1564710497 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f5320015870 con 0x7f533009ed30 2024-09-15T12:39:25.266 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.263+0000 7f532cff9640 1 --2- 172.21.15.122:0/1564710497 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f531403e930 0x7f5314040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:25.266 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.263+0000 7f532cff9640 1 -- 172.21.15.122:0/1564710497 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(702..702 src has 621..702) ==== 3819+0+0 (crc 0 0 0) 0x7f5320051150 con 0x7f533009ed30 2024-09-15T12:39:25.266 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.263+0000 7f5335d91640 1 -- 172.21.15.122:0/1564710497 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53301362c0 con 0x7f533009ed30 2024-09-15T12:39:25.266 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.263+0000 7f532cff9640 1 -- 172.21.15.122:0/1564710497 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=703}) -- 0x7f5314044bc0 con 0x7f533009ed30 2024-09-15T12:39:25.267 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.264+0000 7f5327fff640 1 --2- 172.21.15.122:0/1564710497 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f531403e930 0x7f5314040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:25.267 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.264+0000 7f5327fff640 1 --2- 172.21.15.122:0/1564710497 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f531403e930 0x7f5314040e40 crc :-1 s=READY pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:25.271 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.269+0000 7f532cff9640 1 -- 172.21.15.122:0/1564710497 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f5320014c60 con 0x7f533009ed30 2024-09-15T12:39:25.447 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:25.446+0000 7f5335d91640 1 -- 172.21.15.122:0/1564710497 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_bytes", "val": "0"} v 0) -- 0x7f5330124850 con 0x7f533009ed30 2024-09-15T12:39:26.136 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:26.133+0000 7f532cff9640 1 -- 172.21.15.122:0/1564710497 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 v703) ==== 217+0+0 (crc 0 0 0) 0x7f53200109c0 con 0x7f533009ed30 2024-09-15T12:39:26.136 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:26.134+0000 7fa2abfff640 1 -- 172.21.15.122:0/3752251335 <== mon.0 v2:172.21.15.122:3300/0 6 ==== osd_map(703..703 src has 621..703) ==== 628+0+0 (crc 0 0 0) 0x7fa2b4013dc0 con 0x1fa2fc0 2024-09-15T12:39:26.136 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:26.134+0000 7fa2abfff640 1 -- 172.21.15.122:0/3752251335 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=704}) -- 0x7fa2b0043ba0 con 0x1fa2fc0 2024-09-15T12:39:26.136 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:26.134+0000 7f532cff9640 1 -- 172.21.15.122:0/1564710497 <== mon.0 v2:172.21.15.122:3300/0 8 ==== osd_map(703..703 src has 621..703) ==== 628+0+0 (crc 0 0 0) 0x7f5320011e00 con 0x7f533009ed30 2024-09-15T12:39:26.136 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:26.134+0000 7f532cff9640 1 -- 172.21.15.122:0/1564710497 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=704}) -- 0x7f5314045b00 con 0x7f533009ed30 2024-09-15T12:39:26.256 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:26.254+0000 7f5335d91640 1 -- 172.21.15.122:0/1564710497 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_bytes", "val": "0"} v 0) -- 0x7f53300008d0 con 0x7f533009ed30 2024-09-15T12:39:27.143 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.141+0000 7f532cff9640 1 -- 172.21.15.122:0/1564710497 <== mon.0 v2:172.21.15.122:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 v704) ==== 217+0+0 (crc 0 0 0) 0x7f532000f2a0 con 0x7f533009ed30 2024-09-15T12:39:27.143 INFO:tasks.workunit.client.0.smithi122.stderr:set-quota max_bytes = 0 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 2024-09-15T12:39:27.144 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.141+0000 7f532cff9640 1 -- 172.21.15.122:0/1564710497 <== mon.0 v2:172.21.15.122:3300/0 10 ==== osd_map(704..704 src has 621..704) ==== 628+0+0 (crc 0 0 0) 0x7f5320001b50 con 0x7f533009ed30 2024-09-15T12:39:27.144 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.141+0000 7fa2abfff640 1 -- 172.21.15.122:0/3752251335 <== mon.0 v2:172.21.15.122:3300/0 7 ==== osd_map(704..704 src has 621..704) ==== 628+0+0 (crc 0 0 0) 0x7fa2b4010440 con 0x1fa2fc0 2024-09-15T12:39:27.144 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.141+0000 7f532cff9640 1 -- 172.21.15.122:0/1564710497 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=705}) -- 0x7f5314045c20 con 0x7f533009ed30 2024-09-15T12:39:27.144 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.141+0000 7fa2abfff640 1 -- 172.21.15.122:0/3752251335 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=705}) -- 0x7fa2b0043dc0 con 0x1fa2fc0 2024-09-15T12:39:27.147 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.145+0000 7f5335d91640 1 -- 172.21.15.122:0/1564710497 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f531403e930 msgr2=0x7f5314040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:27.147 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.145+0000 7f5335d91640 1 --2- 172.21.15.122:0/1564710497 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f531403e930 0x7f5314040e40 crc :-1 s=READY pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:27.147 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.145+0000 7f5335d91640 1 -- 172.21.15.122:0/1564710497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009ed30 msgr2=0x7f5330120980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:27.147 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.145+0000 7f5335d91640 1 --2- 172.21.15.122:0/1564710497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009ed30 0x7f5330120980 crc :-1 s=READY pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:27.148 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.145+0000 7f5335d91640 1 -- 172.21.15.122:0/1564710497 shutdown_connections 2024-09-15T12:39:27.148 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.145+0000 7f5335d91640 1 --2- 172.21.15.122:0/1564710497 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f531403e930 0x7f5314040e40 unknown :-1 s=CLOSED pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:27.148 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.145+0000 7f5335d91640 1 --2- 172.21.15.122:0/1564710497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009ed30 0x7f5330120980 unknown :-1 s=CLOSED pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:27.148 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.145+0000 7f5335d91640 1 -- 172.21.15.122:0/1564710497 >> 172.21.15.122:0/1564710497 conn(0x7f53300a5350 msgr2=0x7f53300a3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:39:27.148 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.145+0000 7f5335d91640 1 -- 172.21.15.122:0/1564710497 shutdown_connections 2024-09-15T12:39:27.148 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.145+0000 7f5335d91640 1 -- 172.21.15.122:0/1564710497 wait complete. 2024-09-15T12:39:27.166 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph osd pool set-quota ed9b5ffb-fd10-45e9-a651-fa504ac931a6 max_objects 0 2024-09-15T12:39:27.265 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.255+0000 7f007b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:39:27.266 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.265+0000 7f007b191640 1 Processor -- start 2024-09-15T12:39:27.267 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.265+0000 7f007b191640 1 -- start start 2024-09-15T12:39:27.268 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.266+0000 7f007b191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f007409c6a0 0x7f007409cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:27.269 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.266+0000 7f007b191640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f007409eb70 con 0x7f007409cff0 2024-09-15T12:39:27.269 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.266+0000 7f007b191640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f0074076180 con 0x7f007409c6a0 2024-09-15T12:39:27.269 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.266+0000 7f0078f2d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f007409c6a0 0x7f007409cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:27.269 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.266+0000 7f0078f2d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f007409c6a0 0x7f007409cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52592/0 (socket says 172.21.15.122:52592) 2024-09-15T12:39:27.269 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.266+0000 7f0073fff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f007409cff0 0x7f00741332f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:42258/0 (socket says 172.21.15.122:42258) 2024-09-15T12:39:27.269 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.266+0000 7f0078f2d640 1 -- 172.21.15.122:0/99233264 learned_addr learned my addr 172.21.15.122:0/99233264 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:39:27.269 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.266+0000 7f0078f2d640 1 -- 172.21.15.122:0/99233264 >> v1:172.21.15.122:6789/0 conn(0x7f007409cff0 legacy=0x7f00741332f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:27.269 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.266+0000 7f0078f2d640 1 -- 172.21.15.122:0/99233264 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007409e290 con 0x7f007409c6a0 2024-09-15T12:39:27.269 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.266+0000 7f0078f2d640 1 --2- 172.21.15.122:0/99233264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f007409c6a0 0x7f007409cab0 crc :-1 s=READY pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265d0dc334f16e04 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:27.269 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.266+0000 7f00737fe640 1 -- 172.21.15.122:0/99233264 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0064009e50 con 0x7f007409c6a0 2024-09-15T12:39:27.269 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.267+0000 7f00737fe640 1 -- 172.21.15.122:0/99233264 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f006400e230 con 0x7f007409c6a0 2024-09-15T12:39:27.269 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.267+0000 7f00737fe640 1 -- 172.21.15.122:0/99233264 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f006400e4d0 con 0x7f007409c6a0 2024-09-15T12:39:27.270 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.267+0000 7f007b191640 1 -- 172.21.15.122:0/99233264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f007409c6a0 msgr2=0x7f007409cab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:27.270 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.267+0000 7f007b191640 1 --2- 172.21.15.122:0/99233264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f007409c6a0 0x7f007409cab0 crc :-1 s=READY pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:27.270 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.267+0000 7f007b191640 1 -- 172.21.15.122:0/99233264 shutdown_connections 2024-09-15T12:39:27.271 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.267+0000 7f007b191640 1 --2- 172.21.15.122:0/99233264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f007409c6a0 0x7f007409cab0 unknown :-1 s=CLOSED pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:27.271 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.267+0000 7f007b191640 1 -- 172.21.15.122:0/99233264 >> 172.21.15.122:0/99233264 conn(0x7f00740a30a0 msgr2=0x7f00740a34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:39:27.271 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.267+0000 7f007b191640 1 -- 172.21.15.122:0/99233264 shutdown_connections 2024-09-15T12:39:27.271 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.267+0000 7f007b191640 1 -- 172.21.15.122:0/99233264 wait complete. 2024-09-15T12:39:27.271 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.268+0000 7f007b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:39:27.271 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.269+0000 7f007b191640 1 Processor -- start 2024-09-15T12:39:27.271 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.269+0000 7f007b191640 1 -- start start 2024-09-15T12:39:27.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.270+0000 7f007b191640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f007409c6a0 0x7f00741c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:27.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.270+0000 7f007b191640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f00741300c0 con 0x7f007409c6a0 2024-09-15T12:39:27.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.270+0000 7f0078f2d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f007409c6a0 0x7f00741c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:27.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.270+0000 7f0078f2d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f007409c6a0 0x7f00741c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52596/0 (socket says 172.21.15.122:52596) 2024-09-15T12:39:27.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.270+0000 7f0078f2d640 1 -- 172.21.15.122:0/2596330863 learned_addr learned my addr 172.21.15.122:0/2596330863 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:39:27.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.270+0000 7f0078f2d640 1 -- 172.21.15.122:0/2596330863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007406e3d0 con 0x7f007409c6a0 2024-09-15T12:39:27.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.270+0000 7f0078f2d640 1 --2- 172.21.15.122:0/2596330863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f007409c6a0 0x7f00741c89e0 crc :-1 s=READY pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:27.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.271+0000 7f00717fa640 1 -- 172.21.15.122:0/2596330863 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f006400ee20 con 0x7f007409c6a0 2024-09-15T12:39:27.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.271+0000 7f00717fa640 1 -- 172.21.15.122:0/2596330863 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0064015420 con 0x7f007409c6a0 2024-09-15T12:39:27.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.271+0000 7f007b191640 1 -- 172.21.15.122:0/2596330863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0074132ee0 con 0x7f007409c6a0 2024-09-15T12:39:27.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.271+0000 7f00717fa640 1 -- 172.21.15.122:0/2596330863 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f00640156c0 con 0x7f007409c6a0 2024-09-15T12:39:27.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.271+0000 7f007b191640 1 -- 172.21.15.122:0/2596330863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0074132000 con 0x7f007409c6a0 2024-09-15T12:39:27.275 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.272+0000 7f007b191640 1 -- 172.21.15.122:0/2596330863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0074051040 con 0x7f007409c6a0 2024-09-15T12:39:27.275 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.272+0000 7f00717fa640 1 -- 172.21.15.122:0/2596330863 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0064015870 con 0x7f007409c6a0 2024-09-15T12:39:27.275 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.272+0000 7f00717fa640 1 --2- 172.21.15.122:0/2596330863 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f006003e930 0x7f0060040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:27.275 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.272+0000 7f00717fa640 1 -- 172.21.15.122:0/2596330863 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(704..704 src has 621..704) ==== 3819+0+0 (crc 0 0 0) 0x7f00640511b0 con 0x7f007409c6a0 2024-09-15T12:39:27.275 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.272+0000 7f00717fa640 1 -- 172.21.15.122:0/2596330863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=705}) -- 0x7f0060044bc0 con 0x7f007409c6a0 2024-09-15T12:39:27.275 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.273+0000 7f0073fff640 1 --2- 172.21.15.122:0/2596330863 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f006003e930 0x7f0060040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:27.275 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.273+0000 7f0073fff640 1 --2- 172.21.15.122:0/2596330863 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f006003e930 0x7f0060040e40 crc :-1 s=READY pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:27.280 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.277+0000 7f00717fa640 1 -- 172.21.15.122:0/2596330863 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f0064014c60 con 0x7f007409c6a0 2024-09-15T12:39:27.459 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:27.457+0000 7f007b191640 1 -- 172.21.15.122:0/2596330863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_objects", "val": "0"} v 0) -- 0x7f007409da90 con 0x7f007409c6a0 2024-09-15T12:39:28.129 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.126+0000 7f00717fa640 1 -- 172.21.15.122:0/2596330863 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 v705) ==== 221+0+0 (crc 0 0 0) 0x7f0064010310 con 0x7f007409c6a0 2024-09-15T12:39:28.129 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.127+0000 7fa2abfff640 1 -- 172.21.15.122:0/3752251335 <== mon.0 v2:172.21.15.122:3300/0 8 ==== osd_map(705..705 src has 621..705) ==== 628+0+0 (crc 0 0 0) 0x7fa2b400c8e0 con 0x1fa2fc0 2024-09-15T12:39:28.129 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.127+0000 7f00717fa640 1 -- 172.21.15.122:0/2596330863 <== mon.0 v2:172.21.15.122:3300/0 8 ==== osd_map(705..705 src has 621..705) ==== 628+0+0 (crc 0 0 0) 0x7f0064011e30 con 0x7f007409c6a0 2024-09-15T12:39:28.129 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.127+0000 7f00717fa640 1 -- 172.21.15.122:0/2596330863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=706}) -- 0x7f0060045ca0 con 0x7f007409c6a0 2024-09-15T12:39:28.129 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.127+0000 7fa2abfff640 1 -- 172.21.15.122:0/3752251335 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=706}) -- 0x7fa2b0043fb0 con 0x1fa2fc0 2024-09-15T12:39:28.130 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.127+0000 7fa2abfff640 1 -- 172.21.15.122:0/3752251335 --> v2:172.21.15.142:6811/2150609480 -- osd_op(unknown.0.0:1 199.6 199:6b5d76a5:::two:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e705) -- 0x7fa2b00441a0 con 0x1fab300 2024-09-15T12:39:28.177 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.173+0000 7fa2c37fe640 1 -- 172.21.15.122:0/3752251335 <== osd.3 v2:172.21.15.142:6811/2150609480 1 ==== osd_op_reply(1 two [writefull 0~12875] v705'2 uv2 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fa2bc00a430 con 0x1fab300 2024-09-15T12:39:28.177 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.173+0000 7fa2cf52dec0 1 -- 172.21.15.122:0/3752251335 >> v2:172.21.15.142:6811/2150609480 conn(0x1fab300 msgr2=0x20aef70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:28.177 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.173+0000 7fa2cf52dec0 1 --2- 172.21.15.122:0/3752251335 >> v2:172.21.15.142:6811/2150609480 conn(0x1fab300 0x20aef70 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:28.177 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.173+0000 7fa2cf52dec0 1 -- 172.21.15.122:0/3752251335 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa2b003d170 msgr2=0x7fa2b003f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:28.177 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.173+0000 7fa2cf52dec0 1 --2- 172.21.15.122:0/3752251335 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa2b003d170 0x7fa2b003f680 crc :-1 s=READY pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:28.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.173+0000 7fa2cf52dec0 1 -- 172.21.15.122:0/3752251335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1fa2fc0 msgr2=0x20b1ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:28.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.173+0000 7fa2cf52dec0 1 --2- 172.21.15.122:0/3752251335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1fa2fc0 0x20b1ad0 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:28.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.173+0000 7fa2cf52dec0 1 -- 172.21.15.122:0/3752251335 shutdown_connections 2024-09-15T12:39:28.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.173+0000 7fa2cf52dec0 1 --2- 172.21.15.122:0/3752251335 >> v2:172.21.15.142:6811/2150609480 conn(0x1fab300 0x20aef70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:28.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.173+0000 7fa2cf52dec0 1 --2- 172.21.15.122:0/3752251335 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa2b003d170 0x7fa2b003f680 unknown :-1 s=CLOSED pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:28.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.173+0000 7fa2cf52dec0 1 --2- 172.21.15.122:0/3752251335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1fa2fc0 0x20b1ad0 unknown :-1 s=CLOSED pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:28.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.173+0000 7fa2cf52dec0 1 -- 172.21.15.122:0/3752251335 >> 172.21.15.122:0/3752251335 conn(0x1ecf770 msgr2=0x1f7ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:39:28.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.173+0000 7fa2cf52dec0 1 -- 172.21.15.122:0/3752251335 shutdown_connections 2024-09-15T12:39:28.178 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.173+0000 7fa2cf52dec0 1 -- 172.21.15.122:0/3752251335 wait complete. 2024-09-15T12:39:28.257 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:28.255+0000 7f007b191640 1 -- 172.21.15.122:0/2596330863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_objects", "val": "0"} v 0) -- 0x7f0074074650 con 0x7f007409c6a0 2024-09-15T12:39:29.148 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.146+0000 7f00717fa640 1 -- 172.21.15.122:0/2596330863 <== mon.0 v2:172.21.15.122:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 v706) ==== 221+0+0 (crc 0 0 0) 0x7f0064010a00 con 0x7f007409c6a0 2024-09-15T12:39:29.148 INFO:tasks.workunit.client.0.smithi122.stderr:set-quota max_objects = 0 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 2024-09-15T12:39:29.148 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.146+0000 7f00717fa640 1 -- 172.21.15.122:0/2596330863 <== mon.0 v2:172.21.15.122:3300/0 10 ==== osd_map(706..706 src has 621..706) ==== 628+0+0 (crc 0 0 0) 0x7f006400f2a0 con 0x7f007409c6a0 2024-09-15T12:39:29.152 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.150+0000 7f007b191640 1 -- 172.21.15.122:0/2596330863 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f006003e930 msgr2=0x7f0060040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:29.152 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.150+0000 7f007b191640 1 --2- 172.21.15.122:0/2596330863 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f006003e930 0x7f0060040e40 crc :-1 s=READY pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:29.153 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.150+0000 7f007b191640 1 -- 172.21.15.122:0/2596330863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f007409c6a0 msgr2=0x7f00741c89e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:29.153 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.150+0000 7f007b191640 1 --2- 172.21.15.122:0/2596330863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f007409c6a0 0x7f00741c89e0 crc :-1 s=READY pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:29.153 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.150+0000 7f007b191640 1 -- 172.21.15.122:0/2596330863 shutdown_connections 2024-09-15T12:39:29.153 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.150+0000 7f007b191640 1 --2- 172.21.15.122:0/2596330863 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f006003e930 0x7f0060040e40 unknown :-1 s=CLOSED pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:29.153 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.150+0000 7f007b191640 1 --2- 172.21.15.122:0/2596330863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f007409c6a0 0x7f00741c89e0 unknown :-1 s=CLOSED pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:29.153 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.150+0000 7f007b191640 1 -- 172.21.15.122:0/2596330863 >> 172.21.15.122:0/2596330863 conn(0x7f00740a30a0 msgr2=0x7f0074071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:39:29.153 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.151+0000 7f007b191640 1 -- 172.21.15.122:0/2596330863 shutdown_connections 2024-09-15T12:39:29.153 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.151+0000 7f007b191640 1 -- 172.21.15.122:0/2596330863 wait complete. 2024-09-15T12:39:29.167 INFO:tasks.workunit.client.0.smithi122.stderr:+ wait 96440 2024-09-15T12:39:29.167 INFO:tasks.workunit.client.0.smithi122.stderr:+ '[' 0 -ne 0 ']' 2024-09-15T12:39:29.167 INFO:tasks.workunit.client.0.smithi122.stderr:+ true 2024-09-15T12:39:29.167 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p ed9b5ffb-fd10-45e9-a651-fa504ac931a6 put three /etc/passwd 2024-09-15T12:39:29.208 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.206+0000 7f8d7f576ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:39:29.213 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.211+0000 7f8d7f576ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:39:29.213 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.211+0000 7f8d7f576ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:39:29.214 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.212+0000 7f8d7f576ec0 1 Processor -- start 2024-09-15T12:39:29.214 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.212+0000 7f8d7f576ec0 1 -- start start 2024-09-15T12:39:29.215 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.213+0000 7f8d7f576ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x25d69b0 0x25c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:29.215 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.213+0000 7f8d7f576ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x24a8520 con 0x25d69b0 2024-09-15T12:39:29.215 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.213+0000 7f8d737fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x25d69b0 0x25c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:29.215 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.213+0000 7f8d737fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x25d69b0 0x25c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52616/0 (socket says 172.21.15.122:52616) 2024-09-15T12:39:29.215 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.213+0000 7f8d737fe640 1 -- 172.21.15.122:0/2397087532 learned_addr learned my addr 172.21.15.122:0/2397087532 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:39:29.216 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.213+0000 7f8d737fe640 1 -- 172.21.15.122:0/2397087532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2444e10 con 0x25d69b0 2024-09-15T12:39:29.216 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.213+0000 7f8d737fe640 1 --2- 172.21.15.122:0/2397087532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x25d69b0 0x25c1850 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bdf008eebf5afa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:29.216 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.213+0000 7f8d71ffb640 1 -- 172.21.15.122:0/2397087532 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8d6002db60 con 0x25d69b0 2024-09-15T12:39:29.216 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.213+0000 7f8d71ffb640 1 -- 172.21.15.122:0/2397087532 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8d60037370 con 0x25d69b0 2024-09-15T12:39:29.216 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.213+0000 7f8d71ffb640 1 -- 172.21.15.122:0/2397087532 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8d60037610 con 0x25d69b0 2024-09-15T12:39:29.217 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.214+0000 7f8d7f576ec0 1 -- 172.21.15.122:0/2397087532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x25d69b0 msgr2=0x25c1850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:29.217 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.214+0000 7f8d7f576ec0 1 --2- 172.21.15.122:0/2397087532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x25d69b0 0x25c1850 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:29.217 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.214+0000 7f8d7f576ec0 1 -- 172.21.15.122:0/2397087532 shutdown_connections 2024-09-15T12:39:29.217 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.214+0000 7f8d7f576ec0 1 --2- 172.21.15.122:0/2397087532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x25d69b0 0x25c1850 unknown :-1 s=CLOSED pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:29.217 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.214+0000 7f8d7f576ec0 1 -- 172.21.15.122:0/2397087532 >> 172.21.15.122:0/2397087532 conn(0x2468770 msgr2=0x2541230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:39:29.217 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.214+0000 7f8d7f576ec0 1 -- 172.21.15.122:0/2397087532 shutdown_connections 2024-09-15T12:39:29.217 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.214+0000 7f8d7f576ec0 1 -- 172.21.15.122:0/2397087532 wait complete. 2024-09-15T12:39:29.217 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.215+0000 7f8d7f576ec0 1 Processor -- start 2024-09-15T12:39:29.217 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.215+0000 7f8d7f576ec0 1 -- start start 2024-09-15T12:39:29.219 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.216+0000 7f8d7f576ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x25d69b0 0x25c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:29.219 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.216+0000 7f8d7f576ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x24a6280 con 0x25d69b0 2024-09-15T12:39:29.219 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.216+0000 7f8d737fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x25d69b0 0x25c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:29.219 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.216+0000 7f8d737fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x25d69b0 0x25c4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52632/0 (socket says 172.21.15.122:52632) 2024-09-15T12:39:29.219 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.216+0000 7f8d737fe640 1 -- 172.21.15.122:0/4083900679 learned_addr learned my addr 172.21.15.122:0/4083900679 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:39:29.219 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.216+0000 7f8d737fe640 1 -- 172.21.15.122:0/4083900679 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2436920 con 0x25d69b0 2024-09-15T12:39:29.219 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.216+0000 7f8d737fe640 1 --2- 172.21.15.122:0/4083900679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x25d69b0 0x25c4b50 crc :-1 s=READY pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:29.219 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.216+0000 7f8d70ff9640 1 -- 172.21.15.122:0/4083900679 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8d6003e040 con 0x25d69b0 2024-09-15T12:39:29.219 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.216+0000 7f8d70ff9640 1 -- 172.21.15.122:0/4083900679 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8d60037c70 con 0x25d69b0 2024-09-15T12:39:29.219 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.216+0000 7f8d7f576ec0 1 -- 172.21.15.122:0/4083900679 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2436380 con 0x25d69b0 2024-09-15T12:39:29.220 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.216+0000 7f8d70ff9640 1 -- 172.21.15.122:0/4083900679 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8d60039450 con 0x25d69b0 2024-09-15T12:39:29.220 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.216+0000 7f8d7f576ec0 1 -- 172.21.15.122:0/4083900679 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x25c7b10 con 0x25d69b0 2024-09-15T12:39:29.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.217+0000 7f8d70ff9640 1 -- 172.21.15.122:0/4083900679 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8d60041040 con 0x25d69b0 2024-09-15T12:39:29.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.218+0000 7f8d70ff9640 1 --2- 172.21.15.122:0/4083900679 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8d5c03d170 0x7f8d5c03f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:29.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.218+0000 7f8d70ff9640 1 -- 172.21.15.122:0/4083900679 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(706..706 src has 621..706) ==== 3819+0+0 (crc 0 0 0) 0x7f8d60032040 con 0x25d69b0 2024-09-15T12:39:29.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.218+0000 7f8d7f576ec0 1 --2- 172.21.15.122:0/4083900679 >> v2:172.21.15.142:6811/2150609480 conn(0x25d7300 0x2a6fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:29.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.218+0000 7f8d7f576ec0 1 -- 172.21.15.122:0/4083900679 --> v2:172.21.15.142:6811/2150609480 -- osd_op(unknown.0.0:1 199.3 199:c57798d7:::three:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x25c85c0 con 0x25d7300 2024-09-15T12:39:29.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.218+0000 7f8d72ffd640 1 --2- 172.21.15.122:0/4083900679 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8d5c03d170 0x7f8d5c03f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:29.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.219+0000 7f8d72ffd640 1 --2- 172.21.15.122:0/4083900679 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8d5c03d170 0x7f8d5c03f680 crc :-1 s=READY pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:29.221 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.219+0000 7f8d73fff640 1 --2- 172.21.15.122:0/4083900679 >> v2:172.21.15.142:6811/2150609480 conn(0x25d7300 0x2a6fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:39:29.224 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.223+0000 7f8d73fff640 1 --2- 172.21.15.122:0/4083900679 >> v2:172.21.15.142:6811/2150609480 conn(0x25d7300 0x2a6fa00 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:29.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.239+0000 7f8d73fff640 1 -- 172.21.15.122:0/4083900679 <== osd.3 v2:172.21.15.142:6811/2150609480 1 ==== osd_op_reply(1 three [writefull 0~12875] v706'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8d6800a430 con 0x25d7300 2024-09-15T12:39:29.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.239+0000 7f8d7f576ec0 1 -- 172.21.15.122:0/4083900679 >> v2:172.21.15.142:6811/2150609480 conn(0x25d7300 msgr2=0x2a6fa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:29.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.239+0000 7f8d7f576ec0 1 --2- 172.21.15.122:0/4083900679 >> v2:172.21.15.142:6811/2150609480 conn(0x25d7300 0x2a6fa00 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:29.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.239+0000 7f8d7f576ec0 1 -- 172.21.15.122:0/4083900679 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8d5c03d170 msgr2=0x7f8d5c03f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:29.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.239+0000 7f8d7f576ec0 1 --2- 172.21.15.122:0/4083900679 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8d5c03d170 0x7f8d5c03f680 crc :-1 s=READY pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:29.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.239+0000 7f8d7f576ec0 1 -- 172.21.15.122:0/4083900679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x25d69b0 msgr2=0x25c4b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:29.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.239+0000 7f8d7f576ec0 1 --2- 172.21.15.122:0/4083900679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x25d69b0 0x25c4b50 crc :-1 s=READY pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:29.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.239+0000 7f8d7f576ec0 1 -- 172.21.15.122:0/4083900679 shutdown_connections 2024-09-15T12:39:29.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.239+0000 7f8d7f576ec0 1 --2- 172.21.15.122:0/4083900679 >> v2:172.21.15.142:6811/2150609480 conn(0x25d7300 0x2a6fa00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:29.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.239+0000 7f8d7f576ec0 1 --2- 172.21.15.122:0/4083900679 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8d5c03d170 0x7f8d5c03f680 unknown :-1 s=CLOSED pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:29.241 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.239+0000 7f8d7f576ec0 1 --2- 172.21.15.122:0/4083900679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x25d69b0 0x25c4b50 unknown :-1 s=CLOSED pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:29.242 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.239+0000 7f8d7f576ec0 1 -- 172.21.15.122:0/4083900679 >> 172.21.15.122:0/4083900679 conn(0x2468770 msgr2=0x2541230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:39:29.242 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.239+0000 7f8d7f576ec0 1 -- 172.21.15.122:0/4083900679 shutdown_connections 2024-09-15T12:39:29.242 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.239+0000 7f8d7f576ec0 1 -- 172.21.15.122:0/4083900679 wait complete. 2024-09-15T12:39:29.243 INFO:tasks.workunit.client.0.smithi122.stderr:++ uuidgen 2024-09-15T12:39:29.243 INFO:tasks.workunit.client.0.smithi122.stderr:+ pp=1c731143-9d61-4faf-9b5c-31d38aecd147 2024-09-15T12:39:29.243 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph osd pool create 1c731143-9d61-4faf-9b5c-31d38aecd147 12 2024-09-15T12:39:29.350 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.338+0000 7effedea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:39:29.352 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.350+0000 7effedea3640 1 Processor -- start 2024-09-15T12:39:29.352 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.350+0000 7effedea3640 1 -- start start 2024-09-15T12:39:29.354 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.352+0000 7effedea3640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7effe8074990 0x7effe80a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:29.354 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.352+0000 7effedea3640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effe806a530 con 0x7effe80a2b10 2024-09-15T12:39:29.354 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.352+0000 7effedea3640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7effe8073a20 con 0x7effe8074990 2024-09-15T12:39:29.355 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.352+0000 7effe77fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7effe8074990 0x7effe80a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:29.355 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.352+0000 7effe77fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7effe8074990 0x7effe80a25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52642/0 (socket says 172.21.15.122:52642) 2024-09-15T12:39:29.355 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.352+0000 7effe77fe640 1 -- 172.21.15.122:0/1604754209 learned_addr learned my addr 172.21.15.122:0/1604754209 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:39:29.355 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.352+0000 7effe6ffd640 1 --1- 172.21.15.122:0/1604754209 >> v1:172.21.15.122:6789/0 conn(0x7effe80a2b10 0x7effe8132bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:42270/0 (socket says 172.21.15.122:42270) 2024-09-15T12:39:29.355 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.352+0000 7effe77fe640 1 -- 172.21.15.122:0/1604754209 >> v1:172.21.15.122:6789/0 conn(0x7effe80a2b10 legacy=0x7effe8132bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:29.355 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.352+0000 7effe77fe640 1 -- 172.21.15.122:0/1604754209 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe8074f60 con 0x7effe8074990 2024-09-15T12:39:29.355 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.352+0000 7effe77fe640 1 --2- 172.21.15.122:0/1604754209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effe8074990 0x7effe80a25d0 crc :-1 s=READY pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca74e720581b40e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:29.355 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.352+0000 7effe67fc640 1 -- 172.21.15.122:0/1604754209 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7effd8010570 con 0x7effe8074990 2024-09-15T12:39:29.355 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.353+0000 7effe67fc640 1 -- 172.21.15.122:0/1604754209 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7effd80106d0 con 0x7effe8074990 2024-09-15T12:39:29.355 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.353+0000 7effe67fc640 1 -- 172.21.15.122:0/1604754209 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7effd8010970 con 0x7effe8074990 2024-09-15T12:39:29.356 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.353+0000 7effedea3640 1 -- 172.21.15.122:0/1604754209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effe8074990 msgr2=0x7effe80a25d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:29.356 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.353+0000 7effedea3640 1 --2- 172.21.15.122:0/1604754209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effe8074990 0x7effe80a25d0 crc :-1 s=READY pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:29.356 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.354+0000 7effedea3640 1 -- 172.21.15.122:0/1604754209 shutdown_connections 2024-09-15T12:39:29.356 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.354+0000 7effedea3640 1 --2- 172.21.15.122:0/1604754209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effe8074990 0x7effe80a25d0 unknown :-1 s=CLOSED pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:29.356 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.354+0000 7effedea3640 1 -- 172.21.15.122:0/1604754209 >> 172.21.15.122:0/1604754209 conn(0x7effe80a4390 msgr2=0x7effe80a47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:39:29.356 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.354+0000 7effedea3640 1 -- 172.21.15.122:0/1604754209 shutdown_connections 2024-09-15T12:39:29.357 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.354+0000 7effedea3640 1 -- 172.21.15.122:0/1604754209 wait complete. 2024-09-15T12:39:29.357 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.354+0000 7effedea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:39:29.357 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.355+0000 7effedea3640 1 Processor -- start 2024-09-15T12:39:29.357 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.356+0000 7effedea3640 1 -- start start 2024-09-15T12:39:29.359 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.357+0000 7effedea3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effe8074990 0x7effe812ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:29.359 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.357+0000 7effedea3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7effe812f090 con 0x7effe8074990 2024-09-15T12:39:29.359 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.357+0000 7effe77fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effe8074990 0x7effe812ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:29.359 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.357+0000 7effe77fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effe8074990 0x7effe812ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52654/0 (socket says 172.21.15.122:52654) 2024-09-15T12:39:29.360 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.357+0000 7effe77fe640 1 -- 172.21.15.122:0/3391365170 learned_addr learned my addr 172.21.15.122:0/3391365170 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:39:29.360 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.357+0000 7effe77fe640 1 -- 172.21.15.122:0/3391365170 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe812f770 con 0x7effe8074990 2024-09-15T12:39:29.360 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.357+0000 7effe77fe640 1 --2- 172.21.15.122:0/3391365170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effe8074990 0x7effe812ff40 crc :-1 s=READY pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:29.360 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.357+0000 7effcffff640 1 -- 172.21.15.122:0/3391365170 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7effd8017040 con 0x7effe8074990 2024-09-15T12:39:29.360 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.357+0000 7effcffff640 1 -- 172.21.15.122:0/3391365170 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7effd8010b80 con 0x7effe8074990 2024-09-15T12:39:29.360 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.357+0000 7effedea3640 1 -- 172.21.15.122:0/3391365170 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe812fa10 con 0x7effe8074990 2024-09-15T12:39:29.360 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.357+0000 7effcffff640 1 -- 172.21.15.122:0/3391365170 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7effd8010e20 con 0x7effe8074990 2024-09-15T12:39:29.360 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.357+0000 7effedea3640 1 -- 172.21.15.122:0/3391365170 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe80a1530 con 0x7effe8074990 2024-09-15T12:39:29.361 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.358+0000 7effedea3640 1 -- 172.21.15.122:0/3391365170 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe80a25d0 con 0x7effe8074990 2024-09-15T12:39:29.361 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.359+0000 7effcffff640 1 -- 172.21.15.122:0/3391365170 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7effd80120b0 con 0x7effe8074990 2024-09-15T12:39:29.361 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.359+0000 7effcffff640 1 --2- 172.21.15.122:0/3391365170 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7effd403e930 0x7effd4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:29.361 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.359+0000 7effcffff640 1 -- 172.21.15.122:0/3391365170 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(706..706 src has 621..706) ==== 3819+0+0 (crc 0 0 0) 0x7effd8053570 con 0x7effe8074990 2024-09-15T12:39:29.361 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.359+0000 7effe6ffd640 1 --2- 172.21.15.122:0/3391365170 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7effd403e930 0x7effd4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:29.362 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.360+0000 7effe6ffd640 1 --2- 172.21.15.122:0/3391365170 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7effd403e930 0x7effd4040e40 crc :-1 s=READY pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:29.366 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.364+0000 7effcffff640 1 -- 172.21.15.122:0/3391365170 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7effd8009480 con 0x7effe8074990 2024-09-15T12:39:29.542 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:29.541+0000 7effedea3640 1 -- 172.21.15.122:0/3391365170 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "1c731143-9d61-4faf-9b5c-31d38aecd147", "pg_num": 12} v 0) -- 0x7effe809ff30 con 0x7effe8074990 2024-09-15T12:39:30.150 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.148+0000 7effcffff640 1 -- 172.21.15.122:0/3391365170 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "1c731143-9d61-4faf-9b5c-31d38aecd147", "pg_num": 12}]=0 pool '1c731143-9d61-4faf-9b5c-31d38aecd147' created v707) ==== 176+0+0 (crc 0 0 0) 0x7effd800cb70 con 0x7effe8074990 2024-09-15T12:39:30.288 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.286+0000 7effedea3640 1 -- 172.21.15.122:0/3391365170 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "1c731143-9d61-4faf-9b5c-31d38aecd147", "pg_num": 12} v 0) -- 0x7effe80008d0 con 0x7effe8074990 2024-09-15T12:39:30.289 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.287+0000 7effcffff640 1 -- 172.21.15.122:0/3391365170 <== mon.0 v2:172.21.15.122:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "1c731143-9d61-4faf-9b5c-31d38aecd147", "pg_num": 12}]=0 pool '1c731143-9d61-4faf-9b5c-31d38aecd147' already exists v707) ==== 183+0+0 (crc 0 0 0) 0x7effd800cd50 con 0x7effe8074990 2024-09-15T12:39:30.289 INFO:tasks.workunit.client.0.smithi122.stderr:pool '1c731143-9d61-4faf-9b5c-31d38aecd147' already exists 2024-09-15T12:39:30.291 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.289+0000 7effedea3640 1 -- 172.21.15.122:0/3391365170 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7effd403e930 msgr2=0x7effd4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:30.291 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.289+0000 7effedea3640 1 --2- 172.21.15.122:0/3391365170 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7effd403e930 0x7effd4040e40 crc :-1 s=READY pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:30.291 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.289+0000 7effedea3640 1 -- 172.21.15.122:0/3391365170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effe8074990 msgr2=0x7effe812ff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:30.291 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.289+0000 7effedea3640 1 --2- 172.21.15.122:0/3391365170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effe8074990 0x7effe812ff40 crc :-1 s=READY pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:30.291 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.289+0000 7effedea3640 1 -- 172.21.15.122:0/3391365170 shutdown_connections 2024-09-15T12:39:30.291 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.289+0000 7effedea3640 1 --2- 172.21.15.122:0/3391365170 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7effd403e930 0x7effd4040e40 unknown :-1 s=CLOSED pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:30.291 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.289+0000 7effedea3640 1 --2- 172.21.15.122:0/3391365170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effe8074990 0x7effe812ff40 unknown :-1 s=CLOSED pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:30.292 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.289+0000 7effedea3640 1 -- 172.21.15.122:0/3391365170 >> 172.21.15.122:0/3391365170 conn(0x7effe80a4390 msgr2=0x7effe8130990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:39:30.292 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.289+0000 7effedea3640 1 -- 172.21.15.122:0/3391365170 shutdown_connections 2024-09-15T12:39:30.292 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.289+0000 7effedea3640 1 -- 172.21.15.122:0/3391365170 wait complete. 2024-09-15T12:39:30.300 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph osd pool application enable 1c731143-9d61-4faf-9b5c-31d38aecd147 rados 2024-09-15T12:39:30.392 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.381+0000 7f6e35e5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:39:30.393 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.391+0000 7f6e35e5c640 1 Processor -- start 2024-09-15T12:39:30.393 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.391+0000 7f6e35e5c640 1 -- start start 2024-09-15T12:39:30.395 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.392+0000 7f6e35e5c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6e301393c0 0x7f6e3013b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:30.395 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.392+0000 7f6e35e5c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3006dd50 con 0x7f6e3006e6e0 2024-09-15T12:39:30.395 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.392+0000 7f6e35e5c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f6e3006f200 con 0x7f6e301393c0 2024-09-15T12:39:30.395 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.392+0000 7f6e2effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6e301393c0 0x7f6e3013b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:30.395 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.392+0000 7f6e2effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6e301393c0 0x7f6e3013b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52670/0 (socket says 172.21.15.122:52670) 2024-09-15T12:39:30.395 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.392+0000 7f6e2f7fe640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f6e3006e6e0 0x7f6e3006eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:42286/0 (socket says 172.21.15.122:42286) 2024-09-15T12:39:30.395 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.392+0000 7f6e2effd640 1 -- 172.21.15.122:0/2525801055 learned_addr learned my addr 172.21.15.122:0/2525801055 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:39:30.395 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.392+0000 7f6e2effd640 1 -- 172.21.15.122:0/2525801055 >> v1:172.21.15.122:6789/0 conn(0x7f6e3006e6e0 legacy=0x7f6e3006eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:30.395 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.392+0000 7f6e2effd640 1 -- 172.21.15.122:0/2525801055 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3006f590 con 0x7f6e301393c0 2024-09-15T12:39:30.395 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.392+0000 7f6e2e7fc640 1 -- 172.21.15.122:0/2525801055 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 770185785 0 0) 0x7f6e3006dd50 con 0x7f6e3006e6e0 2024-09-15T12:39:30.395 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.393+0000 7f6e2effd640 1 --2- 172.21.15.122:0/2525801055 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e301393c0 0x7f6e3013b7e0 crc :-1 s=READY pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc47be70233472ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:30.395 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.393+0000 7f6e2e7fc640 1 -- 172.21.15.122:0/2525801055 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6e24009e40 con 0x7f6e301393c0 2024-09-15T12:39:30.396 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.393+0000 7f6e2e7fc640 1 -- 172.21.15.122:0/2525801055 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6e2400e230 con 0x7f6e301393c0 2024-09-15T12:39:30.396 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.393+0000 7f6e2e7fc640 1 -- 172.21.15.122:0/2525801055 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6e2400e4d0 con 0x7f6e301393c0 2024-09-15T12:39:30.396 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.394+0000 7f6e35e5c640 1 -- 172.21.15.122:0/2525801055 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e301393c0 msgr2=0x7f6e3013b7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:30.396 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.394+0000 7f6e35e5c640 1 --2- 172.21.15.122:0/2525801055 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e301393c0 0x7f6e3013b7e0 crc :-1 s=READY pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:30.397 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.394+0000 7f6e35e5c640 1 -- 172.21.15.122:0/2525801055 shutdown_connections 2024-09-15T12:39:30.397 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.394+0000 7f6e35e5c640 1 --2- 172.21.15.122:0/2525801055 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e301393c0 0x7f6e3013b7e0 unknown :-1 s=CLOSED pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:30.397 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.394+0000 7f6e35e5c640 1 -- 172.21.15.122:0/2525801055 >> 172.21.15.122:0/2525801055 conn(0x7f6e300a31b0 msgr2=0x7f6e300a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:39:30.397 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.394+0000 7f6e35e5c640 1 -- 172.21.15.122:0/2525801055 shutdown_connections 2024-09-15T12:39:30.397 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.394+0000 7f6e35e5c640 1 -- 172.21.15.122:0/2525801055 wait complete. 2024-09-15T12:39:30.399 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.394+0000 7f6e35e5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:39:30.401 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.395+0000 7f6e35e5c640 1 Processor -- start 2024-09-15T12:39:30.402 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.395+0000 7f6e35e5c640 1 -- start start 2024-09-15T12:39:30.402 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.396+0000 7f6e35e5c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e3006e6e0 0x7f6e30125f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:30.402 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.396+0000 7f6e35e5c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6e300a6e40 con 0x7f6e3006e6e0 2024-09-15T12:39:30.402 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.396+0000 7f6e2f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e3006e6e0 0x7f6e30125f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:30.402 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.397+0000 7f6e2f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e3006e6e0 0x7f6e30125f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52678/0 (socket says 172.21.15.122:52678) 2024-09-15T12:39:30.402 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.397+0000 7f6e2f7fe640 1 -- 172.21.15.122:0/4289427033 learned_addr learned my addr 172.21.15.122:0/4289427033 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:39:30.402 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.397+0000 7f6e2f7fe640 1 -- 172.21.15.122:0/4289427033 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e30125b20 con 0x7f6e3006e6e0 2024-09-15T12:39:30.402 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.397+0000 7f6e2f7fe640 1 --2- 172.21.15.122:0/4289427033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e3006e6e0 0x7f6e30125f50 crc :-1 s=READY pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:30.402 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.397+0000 7f6e17fff640 1 -- 172.21.15.122:0/4289427033 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6e20004b80 con 0x7f6e3006e6e0 2024-09-15T12:39:30.402 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.397+0000 7f6e17fff640 1 -- 172.21.15.122:0/4289427033 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6e20004ce0 con 0x7f6e3006e6e0 2024-09-15T12:39:30.402 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.397+0000 7f6e35e5c640 1 -- 172.21.15.122:0/4289427033 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e30127140 con 0x7f6e3006e6e0 2024-09-15T12:39:30.402 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.397+0000 7f6e17fff640 1 -- 172.21.15.122:0/4289427033 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6e20007120 con 0x7f6e3006e6e0 2024-09-15T12:39:30.403 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.397+0000 7f6e35e5c640 1 -- 172.21.15.122:0/4289427033 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e30125810 con 0x7f6e3006e6e0 2024-09-15T12:39:30.403 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.398+0000 7f6e35e5c640 1 -- 172.21.15.122:0/4289427033 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e30129590 con 0x7f6e3006e6e0 2024-09-15T12:39:30.403 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.398+0000 7f6e17fff640 1 -- 172.21.15.122:0/4289427033 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6e200072d0 con 0x7f6e3006e6e0 2024-09-15T12:39:30.403 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.399+0000 7f6e17fff640 1 --2- 172.21.15.122:0/4289427033 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6e1c03e930 0x7f6e1c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:30.403 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.399+0000 7f6e17fff640 1 -- 172.21.15.122:0/4289427033 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(707..707 src has 621..707) ==== 4194+0+0 (crc 0 0 0) 0x7f6e2004fe40 con 0x7f6e3006e6e0 2024-09-15T12:39:30.403 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.399+0000 7f6e2effd640 1 --2- 172.21.15.122:0/4289427033 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6e1c03e930 0x7f6e1c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:30.403 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.399+0000 7f6e2effd640 1 --2- 172.21.15.122:0/4289427033 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6e1c03e930 0x7f6e1c040e40 crc :-1 s=READY pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:30.406 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.404+0000 7f6e17fff640 1 -- 172.21.15.122:0/4289427033 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f6e2000f230 con 0x7f6e3006e6e0 2024-09-15T12:39:30.582 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:30.580+0000 7f6e35e5c640 1 -- 172.21.15.122:0/4289427033 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "1c731143-9d61-4faf-9b5c-31d38aecd147", "app": "rados"} v 0) -- 0x7f6e3006fe30 con 0x7f6e3006e6e0 2024-09-15T12:39:31.154 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:31.152+0000 7f6e17fff640 1 -- 172.21.15.122:0/4289427033 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "1c731143-9d61-4faf-9b5c-31d38aecd147", "app": "rados"}]=0 enabled application 'rados' on pool '1c731143-9d61-4faf-9b5c-31d38aecd147' v708) ==== 213+0+0 (crc 0 0 0) 0x7f6e2000a0c0 con 0x7f6e3006e6e0 2024-09-15T12:39:31.316 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:31.314+0000 7f6e35e5c640 1 -- 172.21.15.122:0/4289427033 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "1c731143-9d61-4faf-9b5c-31d38aecd147", "app": "rados"} v 0) -- 0x7f6e300008d0 con 0x7f6e3006e6e0 2024-09-15T12:39:32.155 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.153+0000 7f6e17fff640 1 -- 172.21.15.122:0/4289427033 <== mon.0 v2:172.21.15.122:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "1c731143-9d61-4faf-9b5c-31d38aecd147", "app": "rados"}]=0 enabled application 'rados' on pool '1c731143-9d61-4faf-9b5c-31d38aecd147' v709) ==== 213+0+0 (crc 0 0 0) 0x7f6e2000a7b0 con 0x7f6e3006e6e0 2024-09-15T12:39:32.155 INFO:tasks.workunit.client.0.smithi122.stderr:enabled application 'rados' on pool '1c731143-9d61-4faf-9b5c-31d38aecd147' 2024-09-15T12:39:32.157 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.155+0000 7f6e35e5c640 1 -- 172.21.15.122:0/4289427033 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6e1c03e930 msgr2=0x7f6e1c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:32.158 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.155+0000 7f6e35e5c640 1 --2- 172.21.15.122:0/4289427033 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6e1c03e930 0x7f6e1c040e40 crc :-1 s=READY pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:32.158 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.155+0000 7f6e35e5c640 1 -- 172.21.15.122:0/4289427033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e3006e6e0 msgr2=0x7f6e30125f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:32.158 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.155+0000 7f6e35e5c640 1 --2- 172.21.15.122:0/4289427033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e3006e6e0 0x7f6e30125f50 crc :-1 s=READY pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:32.158 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.155+0000 7f6e35e5c640 1 -- 172.21.15.122:0/4289427033 shutdown_connections 2024-09-15T12:39:32.158 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.155+0000 7f6e35e5c640 1 --2- 172.21.15.122:0/4289427033 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6e1c03e930 0x7f6e1c040e40 unknown :-1 s=CLOSED pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:32.158 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.155+0000 7f6e35e5c640 1 --2- 172.21.15.122:0/4289427033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e3006e6e0 0x7f6e30125f50 unknown :-1 s=CLOSED pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:32.158 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.155+0000 7f6e35e5c640 1 -- 172.21.15.122:0/4289427033 >> 172.21.15.122:0/4289427033 conn(0x7f6e300a31b0 msgr2=0x7f6e3009ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:39:32.158 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.155+0000 7f6e35e5c640 1 -- 172.21.15.122:0/4289427033 shutdown_connections 2024-09-15T12:39:32.158 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.155+0000 7f6e35e5c640 1 -- 172.21.15.122:0/4289427033 wait complete. 2024-09-15T12:39:32.172 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph osd pool set-quota 1c731143-9d61-4faf-9b5c-31d38aecd147 max_objects 10 2024-09-15T12:39:32.275 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.264+0000 7fb183911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:39:32.276 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.274+0000 7fb183911640 1 Processor -- start 2024-09-15T12:39:32.276 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.274+0000 7fb183911640 1 -- start start 2024-09-15T12:39:32.278 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.275+0000 7fb183911640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb17c09c920 0x7fb17c09cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:32.278 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.275+0000 7fb183911640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb17c09be90 con 0x7fb17c1322c0 2024-09-15T12:39:32.278 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.275+0000 7fb183911640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb17c09b230 con 0x7fb17c09c920 2024-09-15T12:39:32.278 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.276+0000 7fb1816ad640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb17c09c920 0x7fb17c09cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:32.278 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.276+0000 7fb180eac640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fb17c1322c0 0x7fb17c1326d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:42292/0 (socket says 172.21.15.122:42292) 2024-09-15T12:39:32.278 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.276+0000 7fb180eac640 1 -- 172.21.15.122:0/1945648962 learned_addr learned my addr 172.21.15.122:0/1945648962 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:39:32.278 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.276+0000 7fb1816ad640 1 -- 172.21.15.122:0/1945648962 >> v1:172.21.15.122:6789/0 conn(0x7fb17c1322c0 legacy=0x7fb17c1326d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:32.279 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.276+0000 7fb1816ad640 1 -- 172.21.15.122:0/1945648962 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17c09c440 con 0x7fb17c09c920 2024-09-15T12:39:32.279 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.276+0000 7fb1816ad640 1 --2- 172.21.15.122:0/1945648962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb17c09c920 0x7fb17c09cd30 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9740d003e367330 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:32.279 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.276+0000 7fb173fff640 1 -- 172.21.15.122:0/1945648962 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb178009d90 con 0x7fb17c09c920 2024-09-15T12:39:32.279 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.276+0000 7fb173fff640 1 -- 172.21.15.122:0/1945648962 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb17800e230 con 0x7fb17c09c920 2024-09-15T12:39:32.279 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.276+0000 7fb173fff640 1 -- 172.21.15.122:0/1945648962 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb17800e4d0 con 0x7fb17c09c920 2024-09-15T12:39:32.280 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.277+0000 7fb183911640 1 -- 172.21.15.122:0/1945648962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb17c09c920 msgr2=0x7fb17c09cd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:32.280 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.277+0000 7fb183911640 1 --2- 172.21.15.122:0/1945648962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb17c09c920 0x7fb17c09cd30 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:32.280 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.277+0000 7fb183911640 1 -- 172.21.15.122:0/1945648962 shutdown_connections 2024-09-15T12:39:32.280 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.277+0000 7fb183911640 1 --2- 172.21.15.122:0/1945648962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb17c09c920 0x7fb17c09cd30 unknown :-1 s=CLOSED pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:32.280 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.277+0000 7fb183911640 1 -- 172.21.15.122:0/1945648962 >> 172.21.15.122:0/1945648962 conn(0x7fb17c0a2000 msgr2=0x7fb17c0a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:39:32.280 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.277+0000 7fb183911640 1 -- 172.21.15.122:0/1945648962 shutdown_connections 2024-09-15T12:39:32.280 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.277+0000 7fb183911640 1 -- 172.21.15.122:0/1945648962 wait complete. 2024-09-15T12:39:32.280 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.277+0000 7fb183911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:39:32.281 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.278+0000 7fb183911640 1 Processor -- start 2024-09-15T12:39:32.281 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.279+0000 7fb183911640 1 -- start start 2024-09-15T12:39:32.282 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.280+0000 7fb183911640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb17c09c920 0x7fb17c1c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:32.282 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.280+0000 7fb183911640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c12e200 con 0x7fb17c09c920 2024-09-15T12:39:32.283 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.280+0000 7fb1816ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb17c09c920 0x7fb17c1c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:32.283 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.280+0000 7fb1816ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb17c09c920 0x7fb17c1c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52702/0 (socket says 172.21.15.122:52702) 2024-09-15T12:39:32.283 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.280+0000 7fb1816ad640 1 -- 172.21.15.122:0/1022979887 learned_addr learned my addr 172.21.15.122:0/1022979887 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:39:32.283 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.280+0000 7fb1816ad640 1 -- 172.21.15.122:0/1022979887 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17c130520 con 0x7fb17c09c920 2024-09-15T12:39:32.283 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.280+0000 7fb1816ad640 1 --2- 172.21.15.122:0/1022979887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb17c09c920 0x7fb17c1c7780 crc :-1 s=READY pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:32.283 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.280+0000 7fb171ffb640 1 -- 172.21.15.122:0/1022979887 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb178014620 con 0x7fb17c09c920 2024-09-15T12:39:32.283 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.280+0000 7fb171ffb640 1 -- 172.21.15.122:0/1022979887 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb178014780 con 0x7fb17c09c920 2024-09-15T12:39:32.283 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.280+0000 7fb183911640 1 -- 172.21.15.122:0/1022979887 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17c132000 con 0x7fb17c09c920 2024-09-15T12:39:32.283 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.280+0000 7fb171ffb640 1 -- 172.21.15.122:0/1022979887 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb178014a20 con 0x7fb17c09c920 2024-09-15T12:39:32.283 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.280+0000 7fb183911640 1 -- 172.21.15.122:0/1022979887 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb17c131910 con 0x7fb17c09c920 2024-09-15T12:39:32.284 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.281+0000 7fb171ffb640 1 -- 172.21.15.122:0/1022979887 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb178014b80 con 0x7fb17c09c920 2024-09-15T12:39:32.284 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.282+0000 7fb171ffb640 1 --2- 172.21.15.122:0/1022979887 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb16003e960 0x7fb160040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:39:32.284 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.282+0000 7fb171ffb640 1 -- 172.21.15.122:0/1022979887 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(709..709 src has 621..709) ==== 4207+0+0 (crc 0 0 0) 0x7fb178019040 con 0x7fb17c09c920 2024-09-15T12:39:32.285 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.282+0000 7fb183911640 1 -- 172.21.15.122:0/1022979887 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb17c06a0b0 con 0x7fb17c09c920 2024-09-15T12:39:32.285 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.282+0000 7fb180eac640 1 --2- 172.21.15.122:0/1022979887 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb16003e960 0x7fb160040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:39:32.285 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.282+0000 7fb180eac640 1 --2- 172.21.15.122:0/1022979887 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb16003e960 0x7fb160040e70 crc :-1 s=READY pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:39:32.289 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.287+0000 7fb171ffb640 1 -- 172.21.15.122:0/1022979887 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fb178011570 con 0x7fb17c09c920 2024-09-15T12:39:32.468 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:32.466+0000 7fb183911640 1 -- 172.21.15.122:0/1022979887 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "1c731143-9d61-4faf-9b5c-31d38aecd147", "field": "max_objects", "val": "10"} v 0) -- 0x7fb17c1306d0 con 0x7fb17c09c920 2024-09-15T12:39:33.129 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:33.127+0000 7fb171ffb640 1 -- 172.21.15.122:0/1022979887 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1c731143-9d61-4faf-9b5c-31d38aecd147", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 1c731143-9d61-4faf-9b5c-31d38aecd147 v710) ==== 223+0+0 (crc 0 0 0) 0x7fb178018190 con 0x7fb17c09c920 2024-09-15T12:39:33.252 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:33.250+0000 7fb183911640 1 -- 172.21.15.122:0/1022979887 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "1c731143-9d61-4faf-9b5c-31d38aecd147", "field": "max_objects", "val": "10"} v 0) -- 0x7fb17c0752c0 con 0x7fb17c09c920 2024-09-15T12:39:34.173 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:34.171+0000 7fb171ffb640 1 -- 172.21.15.122:0/1022979887 <== mon.0 v2:172.21.15.122:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "1c731143-9d61-4faf-9b5c-31d38aecd147", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 1c731143-9d61-4faf-9b5c-31d38aecd147 v711) ==== 223+0+0 (crc 0 0 0) 0x7fb178018370 con 0x7fb17c09c920 2024-09-15T12:39:34.173 INFO:tasks.workunit.client.0.smithi122.stderr:set-quota max_objects = 10 for pool 1c731143-9d61-4faf-9b5c-31d38aecd147 2024-09-15T12:39:34.176 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:34.173+0000 7fb183911640 1 -- 172.21.15.122:0/1022979887 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb16003e960 msgr2=0x7fb160040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:34.176 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:34.173+0000 7fb183911640 1 --2- 172.21.15.122:0/1022979887 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb16003e960 0x7fb160040e70 crc :-1 s=READY pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:34.176 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:34.174+0000 7fb183911640 1 -- 172.21.15.122:0/1022979887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb17c09c920 msgr2=0x7fb17c1c7780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:39:34.176 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:34.174+0000 7fb183911640 1 --2- 172.21.15.122:0/1022979887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb17c09c920 0x7fb17c1c7780 crc :-1 s=READY pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:34.176 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:34.174+0000 7fb183911640 1 -- 172.21.15.122:0/1022979887 shutdown_connections 2024-09-15T12:39:34.176 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:34.174+0000 7fb183911640 1 --2- 172.21.15.122:0/1022979887 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb16003e960 0x7fb160040e70 unknown :-1 s=CLOSED pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:34.176 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:34.174+0000 7fb183911640 1 --2- 172.21.15.122:0/1022979887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb17c09c920 0x7fb17c1c7780 unknown :-1 s=CLOSED pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:39:34.176 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:34.174+0000 7fb183911640 1 -- 172.21.15.122:0/1022979887 >> 172.21.15.122:0/1022979887 conn(0x7fb17c0a2000 msgr2=0x7fb17c072810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:39:34.177 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:34.174+0000 7fb183911640 1 -- 172.21.15.122:0/1022979887 shutdown_connections 2024-09-15T12:39:34.177 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:39:34.174+0000 7fb183911640 1 -- 172.21.15.122:0/1022979887 wait complete. 2024-09-15T12:39:34.191 INFO:tasks.workunit.client.0.smithi122.stderr:+ sleep 30 2024-09-15T12:40:04.193 INFO:tasks.workunit.client.0.smithi122.stderr:++ seq 1 10 2024-09-15T12:40:04.194 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:40:04.194 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p 1c731143-9d61-4faf-9b5c-31d38aecd147 put obj1 /etc/passwd 2024-09-15T12:40:04.236 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.234+0000 7f6f8905aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.242 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.240+0000 7f6f8905aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.242 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.240+0000 7f6f8905aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.243 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.241+0000 7f6f8905aec0 1 Processor -- start 2024-09-15T12:40:04.243 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.241+0000 7f6f8905aec0 1 -- start start 2024-09-15T12:40:04.245 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.242+0000 7f6f8905aec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x14aea60 0x1418810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.245 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.242+0000 7f6f8905aec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x1380520 con 0x14aea60 2024-09-15T12:40:04.245 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.242+0000 7f6f8119b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x14aea60 0x1418810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.245 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.242+0000 7f6f8119b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x14aea60 0x1418810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51978/0 (socket says 172.21.15.122:51978) 2024-09-15T12:40:04.245 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.242+0000 7f6f8119b640 1 -- 172.21.15.122:0/3176791726 learned_addr learned my addr 172.21.15.122:0/3176791726 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.245 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.242+0000 7f6f8119b640 1 -- 172.21.15.122:0/3176791726 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x131ce10 con 0x14aea60 2024-09-15T12:40:04.245 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.242+0000 7f6f8119b640 1 --2- 172.21.15.122:0/3176791726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x14aea60 0x1418810 crc :-1 s=READY pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b5072b0102dd7f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.245 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.243+0000 7f6f7affd640 1 -- 172.21.15.122:0/3176791726 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f6c0061e0 con 0x14aea60 2024-09-15T12:40:04.245 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.243+0000 7f6f7affd640 1 -- 172.21.15.122:0/3176791726 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6f6c006340 con 0x14aea60 2024-09-15T12:40:04.245 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.243+0000 7f6f7affd640 1 -- 172.21.15.122:0/3176791726 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f6c001b00 con 0x14aea60 2024-09-15T12:40:04.246 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.243+0000 7f6f8905aec0 1 -- 172.21.15.122:0/3176791726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x14aea60 msgr2=0x1418810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.247 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.243+0000 7f6f8905aec0 1 --2- 172.21.15.122:0/3176791726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x14aea60 0x1418810 crc :-1 s=READY pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.247 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.243+0000 7f6f8905aec0 1 -- 172.21.15.122:0/3176791726 shutdown_connections 2024-09-15T12:40:04.247 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.243+0000 7f6f8905aec0 1 --2- 172.21.15.122:0/3176791726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x14aea60 0x1418810 unknown :-1 s=CLOSED pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.247 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.243+0000 7f6f8905aec0 1 -- 172.21.15.122:0/3176791726 >> 172.21.15.122:0/3176791726 conn(0x1340770 msgr2=0x14ac380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.247 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.243+0000 7f6f8905aec0 1 -- 172.21.15.122:0/3176791726 shutdown_connections 2024-09-15T12:40:04.247 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.243+0000 7f6f8905aec0 1 -- 172.21.15.122:0/3176791726 wait complete. 2024-09-15T12:40:04.247 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.244+0000 7f6f8905aec0 1 Processor -- start 2024-09-15T12:40:04.247 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.244+0000 7f6f8905aec0 1 -- start start 2024-09-15T12:40:04.250 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.245+0000 7f6f8905aec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x14aea60 0x1499280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.250 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.245+0000 7f6f8905aec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x137e280 con 0x14aea60 2024-09-15T12:40:04.250 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.245+0000 7f6f8119b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x14aea60 0x1499280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.250 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.245+0000 7f6f8119b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x14aea60 0x1499280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51992/0 (socket says 172.21.15.122:51992) 2024-09-15T12:40:04.250 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.245+0000 7f6f8119b640 1 -- 172.21.15.122:0/2870468124 learned_addr learned my addr 172.21.15.122:0/2870468124 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.250 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.246+0000 7f6f8119b640 1 -- 172.21.15.122:0/2870468124 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x130e920 con 0x14aea60 2024-09-15T12:40:04.250 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.246+0000 7f6f8119b640 1 --2- 172.21.15.122:0/2870468124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x14aea60 0x1499280 crc :-1 s=READY pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.250 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.246+0000 7f6f79ffb640 1 -- 172.21.15.122:0/2870468124 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f6c004a30 con 0x14aea60 2024-09-15T12:40:04.251 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.246+0000 7f6f79ffb640 1 -- 172.21.15.122:0/2870468124 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6f6c004b90 con 0x14aea60 2024-09-15T12:40:04.251 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.246+0000 7f6f8905aec0 1 -- 172.21.15.122:0/2870468124 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x130e380 con 0x14aea60 2024-09-15T12:40:04.251 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.246+0000 7f6f79ffb640 1 -- 172.21.15.122:0/2870468124 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f6c004e30 con 0x14aea60 2024-09-15T12:40:04.251 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.246+0000 7f6f8905aec0 1 -- 172.21.15.122:0/2870468124 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x149c1c0 con 0x14aea60 2024-09-15T12:40:04.251 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.247+0000 7f6f79ffb640 1 -- 172.21.15.122:0/2870468124 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6f6c014410 con 0x14aea60 2024-09-15T12:40:04.251 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.247+0000 7f6f79ffb640 1 --2- 172.21.15.122:0/2870468124 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6f5c03d1c0 0x7f6f5c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.251 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.247+0000 7f6f79ffb640 1 -- 172.21.15.122:0/2870468124 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(712..712 src has 621..712) ==== 4207+0+0 (crc 0 0 0) 0x7f6f6c04fde0 con 0x14aea60 2024-09-15T12:40:04.251 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.248+0000 7f6f8905aec0 1 --2- 172.21.15.122:0/2870468124 >> v2:172.21.15.142:6811/2150609480 conn(0x14b1890 0x1947ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.251 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.248+0000 7f6f8905aec0 1 -- 172.21.15.122:0/2870468124 --> v2:172.21.15.142:6811/2150609480 -- osd_op(unknown.0.0:1 200.7 200:ff7b1f36:::obj1:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x149cca0 con 0x14b1890 2024-09-15T12:40:04.251 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.248+0000 7f6f8099a640 1 --2- 172.21.15.122:0/2870468124 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6f5c03d1c0 0x7f6f5c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.252 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.248+0000 7f6f8099a640 1 --2- 172.21.15.122:0/2870468124 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6f5c03d1c0 0x7f6f5c03f6d0 crc :-1 s=READY pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.252 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.249+0000 7f6f8199c640 1 --2- 172.21.15.122:0/2870468124 >> v2:172.21.15.142:6811/2150609480 conn(0x14b1890 0x1947ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:40:04.254 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.252+0000 7f6f8199c640 1 --2- 172.21.15.122:0/2870468124 >> v2:172.21.15.142:6811/2150609480 conn(0x14b1890 0x1947ab0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.272 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.270+0000 7f6f8199c640 1 -- 172.21.15.122:0/2870468124 <== osd.3 v2:172.21.15.142:6811/2150609480 1 ==== osd_op_reply(1 obj1 [writefull 0~12875] v712'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6f7400c430 con 0x14b1890 2024-09-15T12:40:04.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.270+0000 7f6f8905aec0 1 -- 172.21.15.122:0/2870468124 >> v2:172.21.15.142:6811/2150609480 conn(0x14b1890 msgr2=0x1947ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.270+0000 7f6f8905aec0 1 --2- 172.21.15.122:0/2870468124 >> v2:172.21.15.142:6811/2150609480 conn(0x14b1890 0x1947ab0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.270+0000 7f6f8905aec0 1 -- 172.21.15.122:0/2870468124 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6f5c03d1c0 msgr2=0x7f6f5c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.270+0000 7f6f8905aec0 1 --2- 172.21.15.122:0/2870468124 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6f5c03d1c0 0x7f6f5c03f6d0 crc :-1 s=READY pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.270+0000 7f6f8905aec0 1 -- 172.21.15.122:0/2870468124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x14aea60 msgr2=0x1499280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.270+0000 7f6f8905aec0 1 --2- 172.21.15.122:0/2870468124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x14aea60 0x1499280 crc :-1 s=READY pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.270+0000 7f6f8905aec0 1 -- 172.21.15.122:0/2870468124 shutdown_connections 2024-09-15T12:40:04.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.270+0000 7f6f8905aec0 1 --2- 172.21.15.122:0/2870468124 >> v2:172.21.15.142:6811/2150609480 conn(0x14b1890 0x1947ab0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.270+0000 7f6f8905aec0 1 --2- 172.21.15.122:0/2870468124 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6f5c03d1c0 0x7f6f5c03f6d0 unknown :-1 s=CLOSED pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.270+0000 7f6f8905aec0 1 --2- 172.21.15.122:0/2870468124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x14aea60 0x1499280 unknown :-1 s=CLOSED pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.273 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.270+0000 7f6f8905aec0 1 -- 172.21.15.122:0/2870468124 >> 172.21.15.122:0/2870468124 conn(0x1340770 msgr2=0x14ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.274 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.270+0000 7f6f8905aec0 1 -- 172.21.15.122:0/2870468124 shutdown_connections 2024-09-15T12:40:04.274 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.270+0000 7f6f8905aec0 1 -- 172.21.15.122:0/2870468124 wait complete. 2024-09-15T12:40:04.275 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:40:04.275 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p 1c731143-9d61-4faf-9b5c-31d38aecd147 put obj2 /etc/passwd 2024-09-15T12:40:04.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.311+0000 7fcf12122ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.316+0000 7fcf12122ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.316+0000 7fcf12122ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.319 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.317+0000 7fcf12122ec0 1 Processor -- start 2024-09-15T12:40:04.319 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.317+0000 7fcf12122ec0 1 -- start start 2024-09-15T12:40:04.320 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.318+0000 7fcf12122ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1f4ce30 0x206c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.321 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.318+0000 7fcf12122ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x1eb7520 con 0x1f4ce30 2024-09-15T12:40:04.321 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.318+0000 7fcf0a59b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1f4ce30 0x206c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.321 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.318+0000 7fcf0a59b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1f4ce30 0x206c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52010/0 (socket says 172.21.15.122:52010) 2024-09-15T12:40:04.321 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.318+0000 7fcf0a59b640 1 -- 172.21.15.122:0/373339488 learned_addr learned my addr 172.21.15.122:0/373339488 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.321 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.318+0000 7fcf0a59b640 1 -- 172.21.15.122:0/373339488 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e53e10 con 0x1f4ce30 2024-09-15T12:40:04.321 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.318+0000 7fcf0a59b640 1 --2- 172.21.15.122:0/373339488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1f4ce30 0x206c6d0 crc :-1 s=READY pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30bbc5fa2cd0d22 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.321 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.318+0000 7fcf08d98640 1 -- 172.21.15.122:0/373339488 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcef402db90 con 0x1f4ce30 2024-09-15T12:40:04.321 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.318+0000 7fcf08d98640 1 -- 172.21.15.122:0/373339488 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcef4037370 con 0x1f4ce30 2024-09-15T12:40:04.321 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.318+0000 7fcf08d98640 1 -- 172.21.15.122:0/373339488 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcef40374e0 con 0x1f4ce30 2024-09-15T12:40:04.322 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.319+0000 7fcf12122ec0 1 -- 172.21.15.122:0/373339488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1f4ce30 msgr2=0x206c6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.322 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.319+0000 7fcf12122ec0 1 --2- 172.21.15.122:0/373339488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1f4ce30 0x206c6d0 crc :-1 s=READY pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.323 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.319+0000 7fcf12122ec0 1 -- 172.21.15.122:0/373339488 shutdown_connections 2024-09-15T12:40:04.323 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.319+0000 7fcf12122ec0 1 --2- 172.21.15.122:0/373339488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1f4ce30 0x206c6d0 unknown :-1 s=CLOSED pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.323 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.319+0000 7fcf12122ec0 1 -- 172.21.15.122:0/373339488 >> 172.21.15.122:0/373339488 conn(0x1e77770 msgr2=0x1f55370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.323 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.319+0000 7fcf12122ec0 1 -- 172.21.15.122:0/373339488 shutdown_connections 2024-09-15T12:40:04.323 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.319+0000 7fcf12122ec0 1 -- 172.21.15.122:0/373339488 wait complete. 2024-09-15T12:40:04.323 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.320+0000 7fcf12122ec0 1 Processor -- start 2024-09-15T12:40:04.323 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.320+0000 7fcf12122ec0 1 -- start start 2024-09-15T12:40:04.325 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.321+0000 7fcf12122ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1f4ce30 0x207a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.325 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.321+0000 7fcf12122ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x1eb5280 con 0x1f4ce30 2024-09-15T12:40:04.325 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.321+0000 7fcf0a59b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1f4ce30 0x207a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.325 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.321+0000 7fcf0a59b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1f4ce30 0x207a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52026/0 (socket says 172.21.15.122:52026) 2024-09-15T12:40:04.325 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.321+0000 7fcf0a59b640 1 -- 172.21.15.122:0/682729817 learned_addr learned my addr 172.21.15.122:0/682729817 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.326 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.321+0000 7fcf0a59b640 1 -- 172.21.15.122:0/682729817 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e45920 con 0x1f4ce30 2024-09-15T12:40:04.326 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.321+0000 7fcf0a59b640 1 --2- 172.21.15.122:0/682729817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1f4ce30 0x207a900 crc :-1 s=READY pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.326 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.322+0000 7fcf037fe640 1 -- 172.21.15.122:0/682729817 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcef40057c0 con 0x1f4ce30 2024-09-15T12:40:04.326 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.322+0000 7fcf037fe640 1 -- 172.21.15.122:0/682729817 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcef4037df0 con 0x1f4ce30 2024-09-15T12:40:04.326 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.322+0000 7fcf12122ec0 1 -- 172.21.15.122:0/682729817 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1e45380 con 0x1f4ce30 2024-09-15T12:40:04.326 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.322+0000 7fcf037fe640 1 -- 172.21.15.122:0/682729817 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcef402dcc0 con 0x1f4ce30 2024-09-15T12:40:04.326 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.322+0000 7fcf12122ec0 1 -- 172.21.15.122:0/682729817 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x206f530 con 0x1f4ce30 2024-09-15T12:40:04.326 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.323+0000 7fcf037fe640 1 -- 172.21.15.122:0/682729817 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fcef4039450 con 0x1f4ce30 2024-09-15T12:40:04.326 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.323+0000 7fcf037fe640 1 --2- 172.21.15.122:0/682729817 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fcef003d1c0 0x7fcef003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.326 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.323+0000 7fcf037fe640 1 -- 172.21.15.122:0/682729817 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(712..712 src has 621..712) ==== 4207+0+0 (crc 0 0 0) 0x7fcef4032040 con 0x1f4ce30 2024-09-15T12:40:04.326 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.323+0000 7fcf12122ec0 1 --2- 172.21.15.122:0/682729817 >> v2:172.21.15.142:6811/2150609480 conn(0x1fe5df0 0x1f4f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.326 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.323+0000 7fcf12122ec0 1 -- 172.21.15.122:0/682729817 --> v2:172.21.15.142:6811/2150609480 -- osd_op(unknown.0.0:1 200.8 200:104778fc:::obj2:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x1fced40 con 0x1fe5df0 2024-09-15T12:40:04.327 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.323+0000 7fcf09d9a640 1 --2- 172.21.15.122:0/682729817 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fcef003d1c0 0x7fcef003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.327 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.324+0000 7fcf09d9a640 1 --2- 172.21.15.122:0/682729817 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fcef003d1c0 0x7fcef003f6d0 crc :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.327 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.324+0000 7fcf0ad9c640 1 --2- 172.21.15.122:0/682729817 >> v2:172.21.15.142:6811/2150609480 conn(0x1fe5df0 0x1f4f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:40:04.330 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.328+0000 7fcf0ad9c640 1 --2- 172.21.15.122:0/682729817 >> v2:172.21.15.142:6811/2150609480 conn(0x1fe5df0 0x1f4f510 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.346 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.343+0000 7fcf0ad9c640 1 -- 172.21.15.122:0/682729817 <== osd.3 v2:172.21.15.142:6811/2150609480 1 ==== osd_op_reply(1 obj2 [writefull 0~12875] v712'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcefc00a430 con 0x1fe5df0 2024-09-15T12:40:04.346 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.343+0000 7fcf12122ec0 1 -- 172.21.15.122:0/682729817 >> v2:172.21.15.142:6811/2150609480 conn(0x1fe5df0 msgr2=0x1f4f510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.346 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.343+0000 7fcf12122ec0 1 --2- 172.21.15.122:0/682729817 >> v2:172.21.15.142:6811/2150609480 conn(0x1fe5df0 0x1f4f510 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.346 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.343+0000 7fcf12122ec0 1 -- 172.21.15.122:0/682729817 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fcef003d1c0 msgr2=0x7fcef003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.346 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.343+0000 7fcf12122ec0 1 --2- 172.21.15.122:0/682729817 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fcef003d1c0 0x7fcef003f6d0 crc :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.346 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.343+0000 7fcf12122ec0 1 -- 172.21.15.122:0/682729817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1f4ce30 msgr2=0x207a900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.346 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.343+0000 7fcf12122ec0 1 --2- 172.21.15.122:0/682729817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1f4ce30 0x207a900 crc :-1 s=READY pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.346 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.343+0000 7fcf12122ec0 1 -- 172.21.15.122:0/682729817 shutdown_connections 2024-09-15T12:40:04.346 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.343+0000 7fcf12122ec0 1 --2- 172.21.15.122:0/682729817 >> v2:172.21.15.142:6811/2150609480 conn(0x1fe5df0 0x1f4f510 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.346 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.343+0000 7fcf12122ec0 1 --2- 172.21.15.122:0/682729817 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fcef003d1c0 0x7fcef003f6d0 unknown :-1 s=CLOSED pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.346 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.343+0000 7fcf12122ec0 1 --2- 172.21.15.122:0/682729817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1f4ce30 0x207a900 unknown :-1 s=CLOSED pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.346 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.343+0000 7fcf12122ec0 1 -- 172.21.15.122:0/682729817 >> 172.21.15.122:0/682729817 conn(0x1e77770 msgr2=0x1f55370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.347 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.343+0000 7fcf12122ec0 1 -- 172.21.15.122:0/682729817 shutdown_connections 2024-09-15T12:40:04.347 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.343+0000 7fcf12122ec0 1 -- 172.21.15.122:0/682729817 wait complete. 2024-09-15T12:40:04.348 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:40:04.348 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p 1c731143-9d61-4faf-9b5c-31d38aecd147 put obj3 /etc/passwd 2024-09-15T12:40:04.384 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.382+0000 7f92306e7ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.389 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.387+0000 7f92306e7ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.389 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.387+0000 7f92306e7ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.390 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.388+0000 7f92306e7ec0 1 Processor -- start 2024-09-15T12:40:04.390 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.388+0000 7f92306e7ec0 1 -- start start 2024-09-15T12:40:04.392 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.389+0000 7f92306e7ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15a2fc0 0x16c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.392 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.389+0000 7f92306e7ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x150f520 con 0x15a2fc0 2024-09-15T12:40:04.392 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.389+0000 7f9228a3f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15a2fc0 0x16c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.392 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.389+0000 7f9228a3f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15a2fc0 0x16c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52044/0 (socket says 172.21.15.122:52044) 2024-09-15T12:40:04.392 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.389+0000 7f9228a3f640 1 -- 172.21.15.122:0/73841852 learned_addr learned my addr 172.21.15.122:0/73841852 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.392 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.389+0000 7f9228a3f640 1 -- 172.21.15.122:0/73841852 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x14abe10 con 0x15a2fc0 2024-09-15T12:40:04.392 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.390+0000 7f9228a3f640 1 --2- 172.21.15.122:0/73841852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15a2fc0 0x16c5d50 crc :-1 s=READY pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1cf80f334faf688 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.392 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.390+0000 7f92227fc640 1 -- 172.21.15.122:0/73841852 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f921c00c5e0 con 0x15a2fc0 2024-09-15T12:40:04.393 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.390+0000 7f92227fc640 1 -- 172.21.15.122:0/73841852 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f921c00c740 con 0x15a2fc0 2024-09-15T12:40:04.393 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.390+0000 7f92227fc640 1 -- 172.21.15.122:0/73841852 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f921c00c9e0 con 0x15a2fc0 2024-09-15T12:40:04.394 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.390+0000 7f92306e7ec0 1 -- 172.21.15.122:0/73841852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15a2fc0 msgr2=0x16c5d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.394 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.390+0000 7f92306e7ec0 1 --2- 172.21.15.122:0/73841852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15a2fc0 0x16c5d50 crc :-1 s=READY pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.394 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.390+0000 7f92306e7ec0 1 -- 172.21.15.122:0/73841852 shutdown_connections 2024-09-15T12:40:04.394 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.390+0000 7f92306e7ec0 1 --2- 172.21.15.122:0/73841852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15a2fc0 0x16c5d50 unknown :-1 s=CLOSED pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.394 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.390+0000 7f92306e7ec0 1 -- 172.21.15.122:0/73841852 >> 172.21.15.122:0/73841852 conn(0x14cf770 msgr2=0x15ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.394 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.391+0000 7f92306e7ec0 1 -- 172.21.15.122:0/73841852 shutdown_connections 2024-09-15T12:40:04.394 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.391+0000 7f92306e7ec0 1 -- 172.21.15.122:0/73841852 wait complete. 2024-09-15T12:40:04.394 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.391+0000 7f92306e7ec0 1 Processor -- start 2024-09-15T12:40:04.395 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.391+0000 7f92306e7ec0 1 -- start start 2024-09-15T12:40:04.397 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.392+0000 7f92306e7ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15a2fc0 0x16c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.397 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.392+0000 7f92306e7ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x150d280 con 0x15a2fc0 2024-09-15T12:40:04.397 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.392+0000 7f9228a3f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15a2fc0 0x16c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.397 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.392+0000 7f9228a3f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15a2fc0 0x16c7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52054/0 (socket says 172.21.15.122:52054) 2024-09-15T12:40:04.397 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.392+0000 7f9228a3f640 1 -- 172.21.15.122:0/360274507 learned_addr learned my addr 172.21.15.122:0/360274507 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.398 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.393+0000 7f9228a3f640 1 -- 172.21.15.122:0/360274507 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x149d920 con 0x15a2fc0 2024-09-15T12:40:04.398 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.393+0000 7f9228a3f640 1 --2- 172.21.15.122:0/360274507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15a2fc0 0x16c7950 crc :-1 s=READY pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.398 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.393+0000 7f92217fa640 1 -- 172.21.15.122:0/360274507 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f921c013a40 con 0x15a2fc0 2024-09-15T12:40:04.398 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.393+0000 7f92217fa640 1 -- 172.21.15.122:0/360274507 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f921c013ba0 con 0x15a2fc0 2024-09-15T12:40:04.398 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.393+0000 7f92306e7ec0 1 -- 172.21.15.122:0/360274507 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x149d380 con 0x15a2fc0 2024-09-15T12:40:04.398 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.393+0000 7f92217fa640 1 -- 172.21.15.122:0/360274507 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f921c013e40 con 0x15a2fc0 2024-09-15T12:40:04.398 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.393+0000 7f92306e7ec0 1 -- 172.21.15.122:0/360274507 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x16c7360 con 0x15a2fc0 2024-09-15T12:40:04.398 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.394+0000 7f92217fa640 1 -- 172.21.15.122:0/360274507 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f921c010400 con 0x15a2fc0 2024-09-15T12:40:04.398 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.394+0000 7f92217fa640 1 --2- 172.21.15.122:0/360274507 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f920403d160 0x7f920403f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.398 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.394+0000 7f92217fa640 1 -- 172.21.15.122:0/360274507 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(712..712 src has 621..712) ==== 4207+0+0 (crc 0 0 0) 0x7f921c008040 con 0x15a2fc0 2024-09-15T12:40:04.398 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.394+0000 7f92306e7ec0 1 --2- 172.21.15.122:0/360274507 >> v2:172.21.15.122:6803/3904627990 conn(0x15ab300 0x16c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.399 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.394+0000 7f92306e7ec0 1 -- 172.21.15.122:0/360274507 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:1 200.1 200:8dd16f86:::obj3:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x16d0290 con 0x15ab300 2024-09-15T12:40:04.399 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.395+0000 7f92237fe640 1 --2- 172.21.15.122:0/360274507 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f920403d160 0x7f920403f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.399 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.395+0000 7f92237fe640 1 --2- 172.21.15.122:0/360274507 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f920403d160 0x7f920403f670 crc :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.399 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.395+0000 7f9229240640 1 --2- 172.21.15.122:0/360274507 >> v2:172.21.15.122:6803/3904627990 conn(0x15ab300 0x16c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:40:04.401 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.399+0000 7f9229240640 1 --2- 172.21.15.122:0/360274507 >> v2:172.21.15.122:6803/3904627990 conn(0x15ab300 0x16c7e90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.415 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.412+0000 7f9229240640 1 -- 172.21.15.122:0/360274507 <== osd.1 v2:172.21.15.122:6803/3904627990 1 ==== osd_op_reply(1 obj3 [writefull 0~12875] v712'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f921400a430 con 0x15ab300 2024-09-15T12:40:04.415 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.412+0000 7f92306e7ec0 1 -- 172.21.15.122:0/360274507 >> v2:172.21.15.122:6803/3904627990 conn(0x15ab300 msgr2=0x16c7e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.415 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.413+0000 7f92306e7ec0 1 --2- 172.21.15.122:0/360274507 >> v2:172.21.15.122:6803/3904627990 conn(0x15ab300 0x16c7e90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.415 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.413+0000 7f92306e7ec0 1 -- 172.21.15.122:0/360274507 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f920403d160 msgr2=0x7f920403f670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.416 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.413+0000 7f92306e7ec0 1 --2- 172.21.15.122:0/360274507 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f920403d160 0x7f920403f670 crc :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.416 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.413+0000 7f92306e7ec0 1 -- 172.21.15.122:0/360274507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15a2fc0 msgr2=0x16c7950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.416 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.413+0000 7f92306e7ec0 1 --2- 172.21.15.122:0/360274507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15a2fc0 0x16c7950 crc :-1 s=READY pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.416 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.413+0000 7f92306e7ec0 1 -- 172.21.15.122:0/360274507 shutdown_connections 2024-09-15T12:40:04.416 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.413+0000 7f92306e7ec0 1 --2- 172.21.15.122:0/360274507 >> v2:172.21.15.122:6803/3904627990 conn(0x15ab300 0x16c7e90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.416 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.413+0000 7f92306e7ec0 1 --2- 172.21.15.122:0/360274507 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f920403d160 0x7f920403f670 unknown :-1 s=CLOSED pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.416 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.413+0000 7f92306e7ec0 1 --2- 172.21.15.122:0/360274507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x15a2fc0 0x16c7950 unknown :-1 s=CLOSED pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.416 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.413+0000 7f92306e7ec0 1 -- 172.21.15.122:0/360274507 >> 172.21.15.122:0/360274507 conn(0x14cf770 msgr2=0x15a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.416 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.413+0000 7f92306e7ec0 1 -- 172.21.15.122:0/360274507 shutdown_connections 2024-09-15T12:40:04.416 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.413+0000 7f92306e7ec0 1 -- 172.21.15.122:0/360274507 wait complete. 2024-09-15T12:40:04.417 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:40:04.417 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p 1c731143-9d61-4faf-9b5c-31d38aecd147 put obj4 /etc/passwd 2024-09-15T12:40:04.454 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.452+0000 7fb0ef8ebec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.459 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.457+0000 7fb0ef8ebec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.459 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.457+0000 7fb0ef8ebec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.459 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.458+0000 7fb0ef8ebec0 1 Processor -- start 2024-09-15T12:40:04.460 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.458+0000 7fb0ef8ebec0 1 -- start start 2024-09-15T12:40:04.462 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.459+0000 7fb0ef8ebec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1b059b0 0x1af0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.462 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.459+0000 7fb0ef8ebec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x19d7520 con 0x1b059b0 2024-09-15T12:40:04.462 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.459+0000 7fb0e2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1b059b0 0x1af0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.462 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.459+0000 7fb0e2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1b059b0 0x1af0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52072/0 (socket says 172.21.15.122:52072) 2024-09-15T12:40:04.462 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.459+0000 7fb0e2ffd640 1 -- 172.21.15.122:0/1031788427 learned_addr learned my addr 172.21.15.122:0/1031788427 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.462 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.459+0000 7fb0e2ffd640 1 -- 172.21.15.122:0/1031788427 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1973e10 con 0x1b059b0 2024-09-15T12:40:04.463 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.459+0000 7fb0e2ffd640 1 --2- 172.21.15.122:0/1031788427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1b059b0 0x1af0850 crc :-1 s=READY pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb6c9d28c1d6c6d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.463 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.459+0000 7fb0e17fa640 1 -- 172.21.15.122:0/1031788427 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb0dc02daf0 con 0x1b059b0 2024-09-15T12:40:04.463 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.459+0000 7fb0e17fa640 1 -- 172.21.15.122:0/1031788427 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb0dc02dc50 con 0x1b059b0 2024-09-15T12:40:04.463 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.459+0000 7fb0e17fa640 1 -- 172.21.15.122:0/1031788427 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb0dc0374a0 con 0x1b059b0 2024-09-15T12:40:04.463 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.460+0000 7fb0ef8ebec0 1 -- 172.21.15.122:0/1031788427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1b059b0 msgr2=0x1af0850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.463 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.460+0000 7fb0ef8ebec0 1 --2- 172.21.15.122:0/1031788427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1b059b0 0x1af0850 crc :-1 s=READY pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.463 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.460+0000 7fb0ef8ebec0 1 -- 172.21.15.122:0/1031788427 shutdown_connections 2024-09-15T12:40:04.463 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.460+0000 7fb0ef8ebec0 1 --2- 172.21.15.122:0/1031788427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1b059b0 0x1af0850 unknown :-1 s=CLOSED pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.463 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.460+0000 7fb0ef8ebec0 1 -- 172.21.15.122:0/1031788427 >> 172.21.15.122:0/1031788427 conn(0x1997770 msgr2=0x1a70230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.463 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.460+0000 7fb0ef8ebec0 1 -- 172.21.15.122:0/1031788427 shutdown_connections 2024-09-15T12:40:04.463 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.460+0000 7fb0ef8ebec0 1 -- 172.21.15.122:0/1031788427 wait complete. 2024-09-15T12:40:04.466 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.461+0000 7fb0ef8ebec0 1 Processor -- start 2024-09-15T12:40:04.466 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.461+0000 7fb0ef8ebec0 1 -- start start 2024-09-15T12:40:04.466 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.462+0000 7fb0ef8ebec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1b059b0 0x1af3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.466 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.462+0000 7fb0ef8ebec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x19d5280 con 0x1b059b0 2024-09-15T12:40:04.466 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.462+0000 7fb0e2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1b059b0 0x1af3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.466 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.462+0000 7fb0e2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1b059b0 0x1af3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52084/0 (socket says 172.21.15.122:52084) 2024-09-15T12:40:04.466 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.462+0000 7fb0e2ffd640 1 -- 172.21.15.122:0/2238568986 learned_addr learned my addr 172.21.15.122:0/2238568986 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.466 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.462+0000 7fb0e2ffd640 1 -- 172.21.15.122:0/2238568986 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1965920 con 0x1b059b0 2024-09-15T12:40:04.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.462+0000 7fb0e2ffd640 1 --2- 172.21.15.122:0/2238568986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1b059b0 0x1af3b50 crc :-1 s=READY pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.462+0000 7fb0dbfff640 1 -- 172.21.15.122:0/2238568986 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb0dc03e040 con 0x1b059b0 2024-09-15T12:40:04.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.462+0000 7fb0dbfff640 1 -- 172.21.15.122:0/2238568986 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb0dc037e10 con 0x1b059b0 2024-09-15T12:40:04.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.462+0000 7fb0ef8ebec0 1 -- 172.21.15.122:0/2238568986 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1965380 con 0x1b059b0 2024-09-15T12:40:04.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.462+0000 7fb0dbfff640 1 -- 172.21.15.122:0/2238568986 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb0dc0374a0 con 0x1b059b0 2024-09-15T12:40:04.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.462+0000 7fb0ef8ebec0 1 -- 172.21.15.122:0/2238568986 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1af6b10 con 0x1b059b0 2024-09-15T12:40:04.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.463+0000 7fb0dbfff640 1 -- 172.21.15.122:0/2238568986 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb0dc041040 con 0x1b059b0 2024-09-15T12:40:04.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.464+0000 7fb0dbfff640 1 --2- 172.21.15.122:0/2238568986 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb0c403d1c0 0x7fb0c403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.464+0000 7fb0dbfff640 1 -- 172.21.15.122:0/2238568986 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(712..712 src has 621..712) ==== 4207+0+0 (crc 0 0 0) 0x7fb0dc032040 con 0x1b059b0 2024-09-15T12:40:04.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.464+0000 7fb0ef8ebec0 1 --2- 172.21.15.122:0/2238568986 >> v2:172.21.15.142:6811/2150609480 conn(0x1b06300 0x1f9ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.464+0000 7fb0ef8ebec0 1 -- 172.21.15.122:0/2238568986 --> v2:172.21.15.142:6811/2150609480 -- osd_op(unknown.0.0:1 200.0 200:0ee9ae15:::obj4:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x1af75c0 con 0x1b06300 2024-09-15T12:40:04.467 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.464+0000 7fb0e27fc640 1 --2- 172.21.15.122:0/2238568986 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb0c403d1c0 0x7fb0c403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.468 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.464+0000 7fb0e27fc640 1 --2- 172.21.15.122:0/2238568986 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb0c403d1c0 0x7fb0c403f6d0 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.468 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.465+0000 7fb0e37fe640 1 --2- 172.21.15.122:0/2238568986 >> v2:172.21.15.142:6811/2150609480 conn(0x1b06300 0x1f9ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:40:04.471 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.469+0000 7fb0e37fe640 1 --2- 172.21.15.122:0/2238568986 >> v2:172.21.15.142:6811/2150609480 conn(0x1b06300 0x1f9ea00 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.487 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.484+0000 7fb0e37fe640 1 -- 172.21.15.122:0/2238568986 <== osd.3 v2:172.21.15.142:6811/2150609480 1 ==== osd_op_reply(1 obj4 [writefull 0~12875] v712'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb0d400a430 con 0x1b06300 2024-09-15T12:40:04.487 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.485+0000 7fb0ef8ebec0 1 -- 172.21.15.122:0/2238568986 >> v2:172.21.15.142:6811/2150609480 conn(0x1b06300 msgr2=0x1f9ea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.487 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.485+0000 7fb0ef8ebec0 1 --2- 172.21.15.122:0/2238568986 >> v2:172.21.15.142:6811/2150609480 conn(0x1b06300 0x1f9ea00 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.487 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.485+0000 7fb0ef8ebec0 1 -- 172.21.15.122:0/2238568986 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb0c403d1c0 msgr2=0x7fb0c403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.487 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.485+0000 7fb0ef8ebec0 1 --2- 172.21.15.122:0/2238568986 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb0c403d1c0 0x7fb0c403f6d0 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.488 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.485+0000 7fb0ef8ebec0 1 -- 172.21.15.122:0/2238568986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1b059b0 msgr2=0x1af3b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.488 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.485+0000 7fb0ef8ebec0 1 --2- 172.21.15.122:0/2238568986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1b059b0 0x1af3b50 crc :-1 s=READY pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.488 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.485+0000 7fb0ef8ebec0 1 -- 172.21.15.122:0/2238568986 shutdown_connections 2024-09-15T12:40:04.488 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.485+0000 7fb0ef8ebec0 1 --2- 172.21.15.122:0/2238568986 >> v2:172.21.15.142:6811/2150609480 conn(0x1b06300 0x1f9ea00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.488 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.485+0000 7fb0ef8ebec0 1 --2- 172.21.15.122:0/2238568986 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb0c403d1c0 0x7fb0c403f6d0 unknown :-1 s=CLOSED pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.488 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.485+0000 7fb0ef8ebec0 1 --2- 172.21.15.122:0/2238568986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1b059b0 0x1af3b50 unknown :-1 s=CLOSED pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.488 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.485+0000 7fb0ef8ebec0 1 -- 172.21.15.122:0/2238568986 >> 172.21.15.122:0/2238568986 conn(0x1997770 msgr2=0x1a70230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.488 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.485+0000 7fb0ef8ebec0 1 -- 172.21.15.122:0/2238568986 shutdown_connections 2024-09-15T12:40:04.488 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.485+0000 7fb0ef8ebec0 1 -- 172.21.15.122:0/2238568986 wait complete. 2024-09-15T12:40:04.489 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:40:04.489 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p 1c731143-9d61-4faf-9b5c-31d38aecd147 put obj5 /etc/passwd 2024-09-15T12:40:04.525 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.523+0000 7f5444974ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.530 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.528+0000 7f5444974ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.530 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.528+0000 7f5444974ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.531 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.529+0000 7f5444974ec0 1 Processor -- start 2024-09-15T12:40:04.531 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.529+0000 7f5444974ec0 1 -- start start 2024-09-15T12:40:04.534 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.530+0000 7f5444974ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1102a60 0x106c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.534 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.530+0000 7f5444974ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0xfd4520 con 0x1102a60 2024-09-15T12:40:04.534 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.530+0000 7f543d39b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1102a60 0x106c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.534 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.530+0000 7f543d39b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1102a60 0x106c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52114/0 (socket says 172.21.15.122:52114) 2024-09-15T12:40:04.534 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.530+0000 7f543d39b640 1 -- 172.21.15.122:0/4186105659 learned_addr learned my addr 172.21.15.122:0/4186105659 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.534 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.530+0000 7f543d39b640 1 -- 172.21.15.122:0/4186105659 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xf70e10 con 0x1102a60 2024-09-15T12:40:04.534 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.531+0000 7f543d39b640 1 --2- 172.21.15.122:0/4186105659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1102a60 0x106c810 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d7217388512ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.534 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.531+0000 7f54377fe640 1 -- 172.21.15.122:0/4186105659 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f542800b580 con 0x1102a60 2024-09-15T12:40:04.534 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.531+0000 7f54377fe640 1 -- 172.21.15.122:0/4186105659 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f542800b6e0 con 0x1102a60 2024-09-15T12:40:04.535 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.531+0000 7f54377fe640 1 -- 172.21.15.122:0/4186105659 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f542800b980 con 0x1102a60 2024-09-15T12:40:04.535 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.531+0000 7f5444974ec0 1 -- 172.21.15.122:0/4186105659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1102a60 msgr2=0x106c810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.535 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.531+0000 7f5444974ec0 1 --2- 172.21.15.122:0/4186105659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1102a60 0x106c810 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.535 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.531+0000 7f5444974ec0 1 -- 172.21.15.122:0/4186105659 shutdown_connections 2024-09-15T12:40:04.535 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.531+0000 7f5444974ec0 1 --2- 172.21.15.122:0/4186105659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1102a60 0x106c810 unknown :-1 s=CLOSED pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.535 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.531+0000 7f5444974ec0 1 -- 172.21.15.122:0/4186105659 >> 172.21.15.122:0/4186105659 conn(0xf94770 msgr2=0x1100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.535 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.531+0000 7f5444974ec0 1 -- 172.21.15.122:0/4186105659 shutdown_connections 2024-09-15T12:40:04.535 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.531+0000 7f5444974ec0 1 -- 172.21.15.122:0/4186105659 wait complete. 2024-09-15T12:40:04.538 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.532+0000 7f5444974ec0 1 Processor -- start 2024-09-15T12:40:04.538 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.532+0000 7f5444974ec0 1 -- start start 2024-09-15T12:40:04.538 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.533+0000 7f5444974ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1102a60 0x10ed440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.538 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.533+0000 7f5444974ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0xfd2280 con 0x1102a60 2024-09-15T12:40:04.538 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.533+0000 7f543d39b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1102a60 0x10ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.538 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.533+0000 7f543d39b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1102a60 0x10ed440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52124/0 (socket says 172.21.15.122:52124) 2024-09-15T12:40:04.538 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.533+0000 7f543d39b640 1 -- 172.21.15.122:0/3155447036 learned_addr learned my addr 172.21.15.122:0/3155447036 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.538 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.534+0000 7f543d39b640 1 -- 172.21.15.122:0/3155447036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xf62920 con 0x1102a60 2024-09-15T12:40:04.538 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.534+0000 7f543d39b640 1 --2- 172.21.15.122:0/3155447036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1102a60 0x10ed440 crc :-1 s=READY pgs=12929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.538 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.534+0000 7f54367fc640 1 -- 172.21.15.122:0/3155447036 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f54280129c0 con 0x1102a60 2024-09-15T12:40:04.538 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.534+0000 7f5444974ec0 1 -- 172.21.15.122:0/3155447036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xf62380 con 0x1102a60 2024-09-15T12:40:04.539 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.534+0000 7f54367fc640 1 -- 172.21.15.122:0/3155447036 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5428005040 con 0x1102a60 2024-09-15T12:40:04.539 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.534+0000 7f54367fc640 1 -- 172.21.15.122:0/3155447036 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5428012c50 con 0x1102a60 2024-09-15T12:40:04.539 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.534+0000 7f5444974ec0 1 -- 172.21.15.122:0/3155447036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x10eed90 con 0x1102a60 2024-09-15T12:40:04.539 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.535+0000 7f54367fc640 1 -- 172.21.15.122:0/3155447036 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f542800d040 con 0x1102a60 2024-09-15T12:40:04.539 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.535+0000 7f54367fc640 1 --2- 172.21.15.122:0/3155447036 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f542403d170 0x7f542403f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.539 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.535+0000 7f54367fc640 1 -- 172.21.15.122:0/3155447036 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(712..712 src has 621..712) ==== 4207+0+0 (crc 0 0 0) 0x7f542800a040 con 0x1102a60 2024-09-15T12:40:04.539 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.535+0000 7f5444974ec0 1 --2- 172.21.15.122:0/3155447036 >> v2:172.21.15.142:6811/2150609480 conn(0x1105890 0x1197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.539 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.535+0000 7f5444974ec0 1 -- 172.21.15.122:0/3155447036 --> v2:172.21.15.142:6811/2150609480 -- osd_op(unknown.0.0:1 200.3 200:c52c9666:::obj5:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x10f0df0 con 0x1105890 2024-09-15T12:40:04.539 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.536+0000 7f543cb9a640 1 --2- 172.21.15.122:0/3155447036 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f542403d170 0x7f542403f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.540 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.536+0000 7f543cb9a640 1 --2- 172.21.15.122:0/3155447036 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f542403d170 0x7f542403f680 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.540 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.536+0000 7f543db9c640 1 --2- 172.21.15.122:0/3155447036 >> v2:172.21.15.142:6811/2150609480 conn(0x1105890 0x1197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:40:04.541 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.539+0000 7f543db9c640 1 --2- 172.21.15.122:0/3155447036 >> v2:172.21.15.142:6811/2150609480 conn(0x1105890 0x1197a80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.556 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.553+0000 7f543db9c640 1 -- 172.21.15.122:0/3155447036 <== osd.3 v2:172.21.15.142:6811/2150609480 1 ==== osd_op_reply(1 obj5 [writefull 0~12875] v712'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f543000a430 con 0x1105890 2024-09-15T12:40:04.556 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.553+0000 7f5444974ec0 1 -- 172.21.15.122:0/3155447036 >> v2:172.21.15.142:6811/2150609480 conn(0x1105890 msgr2=0x1197a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.556 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.553+0000 7f5444974ec0 1 --2- 172.21.15.122:0/3155447036 >> v2:172.21.15.142:6811/2150609480 conn(0x1105890 0x1197a80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.556 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.553+0000 7f5444974ec0 1 -- 172.21.15.122:0/3155447036 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f542403d170 msgr2=0x7f542403f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.556 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.553+0000 7f5444974ec0 1 --2- 172.21.15.122:0/3155447036 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f542403d170 0x7f542403f680 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.556 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.553+0000 7f5444974ec0 1 -- 172.21.15.122:0/3155447036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1102a60 msgr2=0x10ed440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.556 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.553+0000 7f5444974ec0 1 --2- 172.21.15.122:0/3155447036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1102a60 0x10ed440 crc :-1 s=READY pgs=12929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.556 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.553+0000 7f5444974ec0 1 -- 172.21.15.122:0/3155447036 shutdown_connections 2024-09-15T12:40:04.557 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.553+0000 7f5444974ec0 1 --2- 172.21.15.122:0/3155447036 >> v2:172.21.15.142:6811/2150609480 conn(0x1105890 0x1197a80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.557 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.553+0000 7f5444974ec0 1 --2- 172.21.15.122:0/3155447036 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f542403d170 0x7f542403f680 unknown :-1 s=CLOSED pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.557 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.553+0000 7f5444974ec0 1 --2- 172.21.15.122:0/3155447036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x1102a60 0x10ed440 unknown :-1 s=CLOSED pgs=12929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.557 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.553+0000 7f5444974ec0 1 -- 172.21.15.122:0/3155447036 >> 172.21.15.122:0/3155447036 conn(0xf94770 msgr2=0x1100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.557 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.553+0000 7f5444974ec0 1 -- 172.21.15.122:0/3155447036 shutdown_connections 2024-09-15T12:40:04.557 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.553+0000 7f5444974ec0 1 -- 172.21.15.122:0/3155447036 wait complete. 2024-09-15T12:40:04.558 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:40:04.558 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p 1c731143-9d61-4faf-9b5c-31d38aecd147 put obj6 /etc/passwd 2024-09-15T12:40:04.594 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.592+0000 7f604fe6bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.599 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.597+0000 7f604fe6bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.599 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.597+0000 7f604fe6bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.599 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.598+0000 7f604fe6bec0 1 Processor -- start 2024-09-15T12:40:04.600 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.598+0000 7f604fe6bec0 1 -- start start 2024-09-15T12:40:04.601 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.599+0000 7f604fe6bec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xab1a60 0xa1b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.601 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.599+0000 7f604fe6bec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x983520 con 0xab1a60 2024-09-15T12:40:04.601 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.599+0000 7f6042ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xab1a60 0xa1b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.602 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.599+0000 7f6042ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xab1a60 0xa1b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52144/0 (socket says 172.21.15.122:52144) 2024-09-15T12:40:04.602 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.599+0000 7f6042ffd640 1 -- 172.21.15.122:0/2604967382 learned_addr learned my addr 172.21.15.122:0/2604967382 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.602 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.599+0000 7f6042ffd640 1 -- 172.21.15.122:0/2604967382 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x91fe10 con 0xab1a60 2024-09-15T12:40:04.602 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.599+0000 7f6042ffd640 1 --2- 172.21.15.122:0/2604967382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xab1a60 0xa1b810 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4497db0a88fcfd7e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.602 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.599+0000 7f6041ffb640 1 -- 172.21.15.122:0/2604967382 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f603400b500 con 0xab1a60 2024-09-15T12:40:04.602 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.599+0000 7f6041ffb640 1 -- 172.21.15.122:0/2604967382 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f603400b660 con 0xab1a60 2024-09-15T12:40:04.602 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.599+0000 7f6041ffb640 1 -- 172.21.15.122:0/2604967382 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f603400b900 con 0xab1a60 2024-09-15T12:40:04.603 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.600+0000 7f604fe6bec0 1 -- 172.21.15.122:0/2604967382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xab1a60 msgr2=0xa1b810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.603 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.600+0000 7f604fe6bec0 1 --2- 172.21.15.122:0/2604967382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xab1a60 0xa1b810 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.603 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.600+0000 7f604fe6bec0 1 -- 172.21.15.122:0/2604967382 shutdown_connections 2024-09-15T12:40:04.603 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.600+0000 7f604fe6bec0 1 --2- 172.21.15.122:0/2604967382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xab1a60 0xa1b810 unknown :-1 s=CLOSED pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.604 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.600+0000 7f604fe6bec0 1 -- 172.21.15.122:0/2604967382 >> 172.21.15.122:0/2604967382 conn(0x943770 msgr2=0xaaf380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.604 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.600+0000 7f604fe6bec0 1 -- 172.21.15.122:0/2604967382 shutdown_connections 2024-09-15T12:40:04.604 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.600+0000 7f604fe6bec0 1 -- 172.21.15.122:0/2604967382 wait complete. 2024-09-15T12:40:04.604 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.601+0000 7f604fe6bec0 1 Processor -- start 2024-09-15T12:40:04.604 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.601+0000 7f604fe6bec0 1 -- start start 2024-09-15T12:40:04.606 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.602+0000 7f604fe6bec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xab4890 0xa9c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.607 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.602+0000 7f604fe6bec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x981280 con 0xab4890 2024-09-15T12:40:04.607 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.602+0000 7f6042ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xab4890 0xa9c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.607 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.602+0000 7f6042ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xab4890 0xa9c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52146/0 (socket says 172.21.15.122:52146) 2024-09-15T12:40:04.607 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.602+0000 7f6042ffd640 1 -- 172.21.15.122:0/3686899224 learned_addr learned my addr 172.21.15.122:0/3686899224 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.607 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.602+0000 7f6042ffd640 1 -- 172.21.15.122:0/3686899224 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x911920 con 0xab4890 2024-09-15T12:40:04.607 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.602+0000 7f6042ffd640 1 --2- 172.21.15.122:0/3686899224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xab4890 0xa9c580 crc :-1 s=READY pgs=12933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.607 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.602+0000 7f6040ff9640 1 -- 172.21.15.122:0/3686899224 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f60340111e0 con 0xab4890 2024-09-15T12:40:04.607 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.602+0000 7f6040ff9640 1 -- 172.21.15.122:0/3686899224 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6034011700 con 0xab4890 2024-09-15T12:40:04.607 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.602+0000 7f6040ff9640 1 -- 172.21.15.122:0/3686899224 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6034011870 con 0xab4890 2024-09-15T12:40:04.607 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.602+0000 7f604fe6bec0 1 -- 172.21.15.122:0/3686899224 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x911380 con 0xab4890 2024-09-15T12:40:04.607 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.603+0000 7f604fe6bec0 1 -- 172.21.15.122:0/3686899224 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0xa9f3b0 con 0xab4890 2024-09-15T12:40:04.607 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.603+0000 7f6040ff9640 1 -- 172.21.15.122:0/3686899224 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6034011a20 con 0xab4890 2024-09-15T12:40:04.608 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.604+0000 7f6040ff9640 1 --2- 172.21.15.122:0/3686899224 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f602403d1c0 0x7f602403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.608 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.604+0000 7f6040ff9640 1 -- 172.21.15.122:0/3686899224 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(712..712 src has 621..712) ==== 4207+0+0 (crc 0 0 0) 0x7f6034050170 con 0xab4890 2024-09-15T12:40:04.608 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.604+0000 7f604fe6bec0 1 --2- 172.21.15.122:0/3686899224 >> v2:172.21.15.122:6803/3904627990 conn(0xb46a80 0xb46e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.608 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.604+0000 7f604fe6bec0 1 -- 172.21.15.122:0/3686899224 --> v2:172.21.15.122:6803/3904627990 -- osd_op(unknown.0.0:1 200.4 200:233a42c1:::obj6:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0xa9fdb0 con 0xb46a80 2024-09-15T12:40:04.608 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.604+0000 7f603a7fc640 1 --2- 172.21.15.122:0/3686899224 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f602403d1c0 0x7f602403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.608 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.604+0000 7f603a7fc640 1 --2- 172.21.15.122:0/3686899224 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f602403d1c0 0x7f602403f6d0 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.608 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.605+0000 7f60437fe640 1 --2- 172.21.15.122:0/3686899224 >> v2:172.21.15.122:6803/3904627990 conn(0xb46a80 0xb46e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:40:04.609 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.607+0000 7f60437fe640 1 --2- 172.21.15.122:0/3686899224 >> v2:172.21.15.122:6803/3904627990 conn(0xb46a80 0xb46e90 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.623 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.620+0000 7f60437fe640 1 -- 172.21.15.122:0/3686899224 <== osd.1 v2:172.21.15.122:6803/3904627990 1 ==== osd_op_reply(1 obj6 [writefull 0~12875] v712'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f603c00a430 con 0xb46a80 2024-09-15T12:40:04.623 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.621+0000 7f604fe6bec0 1 -- 172.21.15.122:0/3686899224 >> v2:172.21.15.122:6803/3904627990 conn(0xb46a80 msgr2=0xb46e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.623 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.621+0000 7f604fe6bec0 1 --2- 172.21.15.122:0/3686899224 >> v2:172.21.15.122:6803/3904627990 conn(0xb46a80 0xb46e90 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.624 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.621+0000 7f604fe6bec0 1 -- 172.21.15.122:0/3686899224 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f602403d1c0 msgr2=0x7f602403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.624 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.621+0000 7f604fe6bec0 1 --2- 172.21.15.122:0/3686899224 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f602403d1c0 0x7f602403f6d0 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.624 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.621+0000 7f604fe6bec0 1 -- 172.21.15.122:0/3686899224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xab4890 msgr2=0xa9c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.624 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.621+0000 7f604fe6bec0 1 --2- 172.21.15.122:0/3686899224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xab4890 0xa9c580 crc :-1 s=READY pgs=12933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.624 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.621+0000 7f604fe6bec0 1 -- 172.21.15.122:0/3686899224 shutdown_connections 2024-09-15T12:40:04.624 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.621+0000 7f604fe6bec0 1 --2- 172.21.15.122:0/3686899224 >> v2:172.21.15.122:6803/3904627990 conn(0xb46a80 0xb46e90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.624 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.621+0000 7f604fe6bec0 1 --2- 172.21.15.122:0/3686899224 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f602403d1c0 0x7f602403f6d0 unknown :-1 s=CLOSED pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.624 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.621+0000 7f604fe6bec0 1 --2- 172.21.15.122:0/3686899224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xab4890 0xa9c580 unknown :-1 s=CLOSED pgs=12933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.624 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.621+0000 7f604fe6bec0 1 -- 172.21.15.122:0/3686899224 >> 172.21.15.122:0/3686899224 conn(0x943770 msgr2=0xab0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.624 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.621+0000 7f604fe6bec0 1 -- 172.21.15.122:0/3686899224 shutdown_connections 2024-09-15T12:40:04.624 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.621+0000 7f604fe6bec0 1 -- 172.21.15.122:0/3686899224 wait complete. 2024-09-15T12:40:04.625 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:40:04.625 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p 1c731143-9d61-4faf-9b5c-31d38aecd147 put obj7 /etc/passwd 2024-09-15T12:40:04.661 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.659+0000 7f6f8f631ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.666 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.664+0000 7f6f8f631ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.666 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.664+0000 7f6f8f631ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.667 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.665+0000 7f6f8f631ec0 1 Processor -- start 2024-09-15T12:40:04.667 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.665+0000 7f6f8f631ec0 1 -- start start 2024-09-15T12:40:04.670 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.666+0000 7f6f8f631ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x172bfc0 0x17388e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.670 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.666+0000 7f6f8f631ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x1698520 con 0x172bfc0 2024-09-15T12:40:04.670 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.666+0000 7f6f8779b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x172bfc0 0x17388e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.670 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.666+0000 7f6f8779b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x172bfc0 0x17388e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52156/0 (socket says 172.21.15.122:52156) 2024-09-15T12:40:04.670 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.666+0000 7f6f8779b640 1 -- 172.21.15.122:0/1876545061 learned_addr learned my addr 172.21.15.122:0/1876545061 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.670 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.667+0000 7f6f8779b640 1 -- 172.21.15.122:0/1876545061 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1634e10 con 0x172bfc0 2024-09-15T12:40:04.671 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.667+0000 7f6f8779b640 1 --2- 172.21.15.122:0/1876545061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x172bfc0 0x17388e0 crc :-1 s=READY pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a740964265a9858 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.671 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.667+0000 7f6f85f98640 1 -- 172.21.15.122:0/1876545061 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f7002dcc0 con 0x172bfc0 2024-09-15T12:40:04.671 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.667+0000 7f6f85f98640 1 -- 172.21.15.122:0/1876545061 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6f70037370 con 0x172bfc0 2024-09-15T12:40:04.671 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.667+0000 7f6f85f98640 1 -- 172.21.15.122:0/1876545061 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f70037610 con 0x172bfc0 2024-09-15T12:40:04.671 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.667+0000 7f6f8f631ec0 1 -- 172.21.15.122:0/1876545061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x172bfc0 msgr2=0x17388e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.671 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.667+0000 7f6f8f631ec0 1 --2- 172.21.15.122:0/1876545061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x172bfc0 0x17388e0 crc :-1 s=READY pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.671 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.667+0000 7f6f8f631ec0 1 -- 172.21.15.122:0/1876545061 shutdown_connections 2024-09-15T12:40:04.671 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.667+0000 7f6f8f631ec0 1 --2- 172.21.15.122:0/1876545061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x172bfc0 0x17388e0 unknown :-1 s=CLOSED pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.671 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.667+0000 7f6f8f631ec0 1 -- 172.21.15.122:0/1876545061 >> 172.21.15.122:0/1876545061 conn(0x1658770 msgr2=0x172d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.671 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.668+0000 7f6f8f631ec0 1 -- 172.21.15.122:0/1876545061 shutdown_connections 2024-09-15T12:40:04.671 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.668+0000 7f6f8f631ec0 1 -- 172.21.15.122:0/1876545061 wait complete. 2024-09-15T12:40:04.671 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.668+0000 7f6f8f631ec0 1 Processor -- start 2024-09-15T12:40:04.671 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.668+0000 7f6f8f631ec0 1 -- start start 2024-09-15T12:40:04.673 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.669+0000 7f6f8f631ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x172bfc0 0x183ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.673 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.669+0000 7f6f8f631ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x1696280 con 0x172bfc0 2024-09-15T12:40:04.674 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.669+0000 7f6f8779b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x172bfc0 0x183ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.674 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.669+0000 7f6f8779b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x172bfc0 0x183ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52170/0 (socket says 172.21.15.122:52170) 2024-09-15T12:40:04.674 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.669+0000 7f6f8779b640 1 -- 172.21.15.122:0/1973951163 learned_addr learned my addr 172.21.15.122:0/1973951163 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.674 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.670+0000 7f6f8779b640 1 -- 172.21.15.122:0/1973951163 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1626920 con 0x172bfc0 2024-09-15T12:40:04.674 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.670+0000 7f6f8779b640 1 --2- 172.21.15.122:0/1973951163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x172bfc0 0x183ae20 crc :-1 s=READY pgs=12937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.674 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.670+0000 7f6f84f96640 1 -- 172.21.15.122:0/1973951163 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f7002dcc0 con 0x172bfc0 2024-09-15T12:40:04.674 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.670+0000 7f6f84f96640 1 -- 172.21.15.122:0/1973951163 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6f700374e0 con 0x172bfc0 2024-09-15T12:40:04.674 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.670+0000 7f6f84f96640 1 -- 172.21.15.122:0/1973951163 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f70039450 con 0x172bfc0 2024-09-15T12:40:04.674 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.670+0000 7f6f8f631ec0 1 -- 172.21.15.122:0/1973951163 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1626380 con 0x172bfc0 2024-09-15T12:40:04.674 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.670+0000 7f6f8f631ec0 1 -- 172.21.15.122:0/1973951163 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x183c730 con 0x172bfc0 2024-09-15T12:40:04.674 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.671+0000 7f6f84f96640 1 -- 172.21.15.122:0/1973951163 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6f70039600 con 0x172bfc0 2024-09-15T12:40:04.674 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.671+0000 7f6f84f96640 1 --2- 172.21.15.122:0/1973951163 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6f6c03d1c0 0x7f6f6c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.675 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.671+0000 7f6f84f96640 1 -- 172.21.15.122:0/1973951163 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(712..712 src has 621..712) ==== 4207+0+0 (crc 0 0 0) 0x7f6f70032040 con 0x172bfc0 2024-09-15T12:40:04.675 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.671+0000 7f6f8f631ec0 1 --2- 172.21.15.122:0/1973951163 >> v2:172.21.15.122:6800/2464407069 conn(0x1734130 0x183b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.675 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.671+0000 7f6f8f631ec0 1 -- 172.21.15.122:0/1973951163 --> v2:172.21.15.122:6800/2464407069 -- osd_op(unknown.0.0:1 200.9 200:9a09113a:::obj7:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x184e460 con 0x1734130 2024-09-15T12:40:04.675 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.672+0000 7f6f86f9a640 1 --2- 172.21.15.122:0/1973951163 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6f6c03d1c0 0x7f6f6c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.675 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.672+0000 7f6f86f9a640 1 --2- 172.21.15.122:0/1973951163 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6f6c03d1c0 0x7f6f6c03f6d0 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.675 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.672+0000 7f6f87f9c640 1 --2- 172.21.15.122:0/1973951163 >> v2:172.21.15.122:6800/2464407069 conn(0x1734130 0x183b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:40:04.678 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.676+0000 7f6f87f9c640 1 --2- 172.21.15.122:0/1973951163 >> v2:172.21.15.122:6800/2464407069 conn(0x1734130 0x183b870 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.692 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.689+0000 7f6f87f9c640 1 -- 172.21.15.122:0/1973951163 <== osd.0 v2:172.21.15.122:6800/2464407069 1 ==== osd_op_reply(1 obj7 [writefull 0~12875] v712'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6f7800a430 con 0x1734130 2024-09-15T12:40:04.692 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.690+0000 7f6f8f631ec0 1 -- 172.21.15.122:0/1973951163 >> v2:172.21.15.122:6800/2464407069 conn(0x1734130 msgr2=0x183b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.693 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.690+0000 7f6f8f631ec0 1 --2- 172.21.15.122:0/1973951163 >> v2:172.21.15.122:6800/2464407069 conn(0x1734130 0x183b870 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.693 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.690+0000 7f6f8f631ec0 1 -- 172.21.15.122:0/1973951163 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6f6c03d1c0 msgr2=0x7f6f6c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.693 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.690+0000 7f6f8f631ec0 1 --2- 172.21.15.122:0/1973951163 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6f6c03d1c0 0x7f6f6c03f6d0 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.693 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.690+0000 7f6f8f631ec0 1 -- 172.21.15.122:0/1973951163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x172bfc0 msgr2=0x183ae20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.693 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.690+0000 7f6f8f631ec0 1 --2- 172.21.15.122:0/1973951163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x172bfc0 0x183ae20 crc :-1 s=READY pgs=12937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.693 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.690+0000 7f6f8f631ec0 1 -- 172.21.15.122:0/1973951163 shutdown_connections 2024-09-15T12:40:04.693 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.690+0000 7f6f8f631ec0 1 --2- 172.21.15.122:0/1973951163 >> v2:172.21.15.122:6800/2464407069 conn(0x1734130 0x183b870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.693 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.690+0000 7f6f8f631ec0 1 --2- 172.21.15.122:0/1973951163 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f6f6c03d1c0 0x7f6f6c03f6d0 unknown :-1 s=CLOSED pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.693 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.690+0000 7f6f8f631ec0 1 --2- 172.21.15.122:0/1973951163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x172bfc0 0x183ae20 unknown :-1 s=CLOSED pgs=12937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.693 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.690+0000 7f6f8f631ec0 1 -- 172.21.15.122:0/1973951163 >> 172.21.15.122:0/1973951163 conn(0x1658770 msgr2=0x172d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.693 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.690+0000 7f6f8f631ec0 1 -- 172.21.15.122:0/1973951163 shutdown_connections 2024-09-15T12:40:04.694 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.690+0000 7f6f8f631ec0 1 -- 172.21.15.122:0/1973951163 wait complete. 2024-09-15T12:40:04.694 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:40:04.694 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p 1c731143-9d61-4faf-9b5c-31d38aecd147 put obj8 /etc/passwd 2024-09-15T12:40:04.731 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.728+0000 7f55118faec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.735 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.733+0000 7f55118faec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.735 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.733+0000 7f55118faec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.736 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.734+0000 7f55118faec0 1 Processor -- start 2024-09-15T12:40:04.736 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.734+0000 7f55118faec0 1 -- start start 2024-09-15T12:40:04.738 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.735+0000 7f55118faec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x122ffc0 0x121dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.738 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.735+0000 7f55118faec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x119c520 con 0x122ffc0 2024-09-15T12:40:04.738 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.735+0000 7f5509d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x122ffc0 0x121dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.738 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.735+0000 7f5509d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x122ffc0 0x121dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52190/0 (socket says 172.21.15.122:52190) 2024-09-15T12:40:04.738 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.735+0000 7f5509d9b640 1 -- 172.21.15.122:0/572024203 learned_addr learned my addr 172.21.15.122:0/572024203 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.738 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.736+0000 7f5509d9b640 1 -- 172.21.15.122:0/572024203 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1138e10 con 0x122ffc0 2024-09-15T12:40:04.738 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.736+0000 7f5509d9b640 1 --2- 172.21.15.122:0/572024203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x122ffc0 0x121dd80 crc :-1 s=READY pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f3ca06c4ddc765 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.738 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.736+0000 7f55037fe640 1 -- 172.21.15.122:0/572024203 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f54f400c5e0 con 0x122ffc0 2024-09-15T12:40:04.738 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.736+0000 7f55037fe640 1 -- 172.21.15.122:0/572024203 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f54f400c740 con 0x122ffc0 2024-09-15T12:40:04.738 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.736+0000 7f55037fe640 1 -- 172.21.15.122:0/572024203 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f54f400c9e0 con 0x122ffc0 2024-09-15T12:40:04.739 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.736+0000 7f55118faec0 1 -- 172.21.15.122:0/572024203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x122ffc0 msgr2=0x121dd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.740 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.736+0000 7f55118faec0 1 --2- 172.21.15.122:0/572024203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x122ffc0 0x121dd80 crc :-1 s=READY pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.740 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.736+0000 7f55118faec0 1 -- 172.21.15.122:0/572024203 shutdown_connections 2024-09-15T12:40:04.740 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.736+0000 7f55118faec0 1 --2- 172.21.15.122:0/572024203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x122ffc0 0x121dd80 unknown :-1 s=CLOSED pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.740 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.736+0000 7f55118faec0 1 -- 172.21.15.122:0/572024203 >> 172.21.15.122:0/572024203 conn(0x115c770 msgr2=0x1231700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.740 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.737+0000 7f55118faec0 1 -- 172.21.15.122:0/572024203 shutdown_connections 2024-09-15T12:40:04.740 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.737+0000 7f55118faec0 1 -- 172.21.15.122:0/572024203 wait complete. 2024-09-15T12:40:04.740 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.737+0000 7f55118faec0 1 Processor -- start 2024-09-15T12:40:04.740 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.737+0000 7f55118faec0 1 -- start start 2024-09-15T12:40:04.742 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.738+0000 7f55118faec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x122ffc0 0x1342280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.742 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.738+0000 7f55118faec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x119a280 con 0x122ffc0 2024-09-15T12:40:04.742 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.738+0000 7f5509d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x122ffc0 0x1342280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.742 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.738+0000 7f5509d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x122ffc0 0x1342280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52200/0 (socket says 172.21.15.122:52200) 2024-09-15T12:40:04.743 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.738+0000 7f5509d9b640 1 -- 172.21.15.122:0/3554340716 learned_addr learned my addr 172.21.15.122:0/3554340716 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.743 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.739+0000 7f5509d9b640 1 -- 172.21.15.122:0/3554340716 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x112a920 con 0x122ffc0 2024-09-15T12:40:04.743 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.739+0000 7f5509d9b640 1 --2- 172.21.15.122:0/3554340716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x122ffc0 0x1342280 crc :-1 s=READY pgs=12941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.743 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.739+0000 7f55027fc640 1 -- 172.21.15.122:0/3554340716 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f54f40139c0 con 0x122ffc0 2024-09-15T12:40:04.743 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.739+0000 7f55027fc640 1 -- 172.21.15.122:0/3554340716 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f54f4013b20 con 0x122ffc0 2024-09-15T12:40:04.743 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.739+0000 7f55118faec0 1 -- 172.21.15.122:0/3554340716 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x112a380 con 0x122ffc0 2024-09-15T12:40:04.743 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.739+0000 7f55027fc640 1 -- 172.21.15.122:0/3554340716 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f54f4013dc0 con 0x122ffc0 2024-09-15T12:40:04.743 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.739+0000 7f55118faec0 1 -- 172.21.15.122:0/3554340716 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1352920 con 0x122ffc0 2024-09-15T12:40:04.743 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.740+0000 7f55027fc640 1 -- 172.21.15.122:0/3554340716 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f54f4010400 con 0x122ffc0 2024-09-15T12:40:04.743 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.740+0000 7f55027fc640 1 --2- 172.21.15.122:0/3554340716 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f54f003d1c0 0x7f54f003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.743 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.740+0000 7f55027fc640 1 -- 172.21.15.122:0/3554340716 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(712..712 src has 621..712) ==== 4207+0+0 (crc 0 0 0) 0x7f54f4008040 con 0x122ffc0 2024-09-15T12:40:04.743 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.740+0000 7f55118faec0 1 --2- 172.21.15.122:0/3554340716 >> v2:172.21.15.122:6800/2464407069 conn(0x1238300 0x135f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.744 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.740+0000 7f55118faec0 1 -- 172.21.15.122:0/3554340716 --> v2:172.21.15.122:6800/2464407069 -- osd_op(unknown.0.0:1 200.5 200:a557efb1:::obj8:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x135fc40 con 0x1238300 2024-09-15T12:40:04.744 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.741+0000 7f550959a640 1 --2- 172.21.15.122:0/3554340716 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f54f003d1c0 0x7f54f003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.744 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.741+0000 7f550959a640 1 --2- 172.21.15.122:0/3554340716 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f54f003d1c0 0x7f54f003f6d0 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.744 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.741+0000 7f550a59c640 1 --2- 172.21.15.122:0/3554340716 >> v2:172.21.15.122:6800/2464407069 conn(0x1238300 0x135f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:40:04.745 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.743+0000 7f550a59c640 1 --2- 172.21.15.122:0/3554340716 >> v2:172.21.15.122:6800/2464407069 conn(0x1238300 0x135f700 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.760 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.757+0000 7f550a59c640 1 -- 172.21.15.122:0/3554340716 <== osd.0 v2:172.21.15.122:6800/2464407069 1 ==== osd_op_reply(1 obj8 [writefull 0~12875] v712'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54fc00a430 con 0x1238300 2024-09-15T12:40:04.760 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.757+0000 7f55118faec0 1 -- 172.21.15.122:0/3554340716 >> v2:172.21.15.122:6800/2464407069 conn(0x1238300 msgr2=0x135f700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.760 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.757+0000 7f55118faec0 1 --2- 172.21.15.122:0/3554340716 >> v2:172.21.15.122:6800/2464407069 conn(0x1238300 0x135f700 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.760 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.757+0000 7f55118faec0 1 -- 172.21.15.122:0/3554340716 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f54f003d1c0 msgr2=0x7f54f003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.760 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.757+0000 7f55118faec0 1 --2- 172.21.15.122:0/3554340716 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f54f003d1c0 0x7f54f003f6d0 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.760 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.757+0000 7f55118faec0 1 -- 172.21.15.122:0/3554340716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x122ffc0 msgr2=0x1342280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.760 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.757+0000 7f55118faec0 1 --2- 172.21.15.122:0/3554340716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x122ffc0 0x1342280 crc :-1 s=READY pgs=12941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.760 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.757+0000 7f55118faec0 1 -- 172.21.15.122:0/3554340716 shutdown_connections 2024-09-15T12:40:04.760 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.757+0000 7f55118faec0 1 --2- 172.21.15.122:0/3554340716 >> v2:172.21.15.122:6800/2464407069 conn(0x1238300 0x135f700 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.760 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.757+0000 7f55118faec0 1 --2- 172.21.15.122:0/3554340716 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f54f003d1c0 0x7f54f003f6d0 unknown :-1 s=CLOSED pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.761 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.757+0000 7f55118faec0 1 --2- 172.21.15.122:0/3554340716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x122ffc0 0x1342280 unknown :-1 s=CLOSED pgs=12941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.761 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.757+0000 7f55118faec0 1 -- 172.21.15.122:0/3554340716 >> 172.21.15.122:0/3554340716 conn(0x115c770 msgr2=0x123bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.761 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.757+0000 7f55118faec0 1 -- 172.21.15.122:0/3554340716 shutdown_connections 2024-09-15T12:40:04.761 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.757+0000 7f55118faec0 1 -- 172.21.15.122:0/3554340716 wait complete. 2024-09-15T12:40:04.762 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:40:04.762 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p 1c731143-9d61-4faf-9b5c-31d38aecd147 put obj9 /etc/passwd 2024-09-15T12:40:04.798 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.796+0000 7fa57ea2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.803 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.801+0000 7fa57ea2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.803 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.801+0000 7fa57ea2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.804 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.802+0000 7fa57ea2dec0 1 Processor -- start 2024-09-15T12:40:04.804 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.802+0000 7fa57ea2dec0 1 -- start start 2024-09-15T12:40:04.807 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.803+0000 7fa57ea2dec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xeb79b0 0xe289b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.807 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.803+0000 7fa57ea2dec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0xd89520 con 0xeb79b0 2024-09-15T12:40:04.807 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.803+0000 7fa576a3f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xeb79b0 0xe289b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.807 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.803+0000 7fa576a3f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xeb79b0 0xe289b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52222/0 (socket says 172.21.15.122:52222) 2024-09-15T12:40:04.807 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.803+0000 7fa576a3f640 1 -- 172.21.15.122:0/3042761702 learned_addr learned my addr 172.21.15.122:0/3042761702 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.807 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.803+0000 7fa576a3f640 1 -- 172.21.15.122:0/3042761702 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd25e10 con 0xeb79b0 2024-09-15T12:40:04.807 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.804+0000 7fa576a3f640 1 --2- 172.21.15.122:0/3042761702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xeb79b0 0xe289b0 crc :-1 s=READY pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bbccb4980ae730 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.807 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.804+0000 7fa57523c640 1 -- 172.21.15.122:0/3042761702 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa56000b580 con 0xeb79b0 2024-09-15T12:40:04.807 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.804+0000 7fa57523c640 1 -- 172.21.15.122:0/3042761702 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa56000b6e0 con 0xeb79b0 2024-09-15T12:40:04.807 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.804+0000 7fa57523c640 1 -- 172.21.15.122:0/3042761702 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa56000b980 con 0xeb79b0 2024-09-15T12:40:04.807 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.804+0000 7fa57ea2dec0 1 -- 172.21.15.122:0/3042761702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xeb79b0 msgr2=0xe289b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.807 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.804+0000 7fa57ea2dec0 1 --2- 172.21.15.122:0/3042761702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xeb79b0 0xe289b0 crc :-1 s=READY pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.808 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.804+0000 7fa57ea2dec0 1 -- 172.21.15.122:0/3042761702 shutdown_connections 2024-09-15T12:40:04.808 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.804+0000 7fa57ea2dec0 1 --2- 172.21.15.122:0/3042761702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xeb79b0 0xe289b0 unknown :-1 s=CLOSED pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.808 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.804+0000 7fa57ea2dec0 1 -- 172.21.15.122:0/3042761702 >> 172.21.15.122:0/3042761702 conn(0xd49770 msgr2=0xe20e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.808 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.804+0000 7fa57ea2dec0 1 -- 172.21.15.122:0/3042761702 shutdown_connections 2024-09-15T12:40:04.808 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.804+0000 7fa57ea2dec0 1 -- 172.21.15.122:0/3042761702 wait complete. 2024-09-15T12:40:04.809 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.805+0000 7fa57ea2dec0 1 Processor -- start 2024-09-15T12:40:04.810 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.805+0000 7fa57ea2dec0 1 -- start start 2024-09-15T12:40:04.810 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.806+0000 7fa57ea2dec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xeb79b0 0xf4c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.810 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.806+0000 7fa57ea2dec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0xd87280 con 0xeb79b0 2024-09-15T12:40:04.810 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.806+0000 7fa576a3f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xeb79b0 0xf4c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.810 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.806+0000 7fa576a3f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xeb79b0 0xf4c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52228/0 (socket says 172.21.15.122:52228) 2024-09-15T12:40:04.810 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.806+0000 7fa576a3f640 1 -- 172.21.15.122:0/4012224973 learned_addr learned my addr 172.21.15.122:0/4012224973 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.810 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.807+0000 7fa576a3f640 1 -- 172.21.15.122:0/4012224973 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd17920 con 0xeb79b0 2024-09-15T12:40:04.810 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.807+0000 7fa576a3f640 1 --2- 172.21.15.122:0/4012224973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xeb79b0 0xf4c500 crc :-1 s=READY pgs=12945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.810 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.807+0000 7fa56f7fe640 1 -- 172.21.15.122:0/4012224973 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa560012960 con 0xeb79b0 2024-09-15T12:40:04.810 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.807+0000 7fa56f7fe640 1 -- 172.21.15.122:0/4012224973 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa560005040 con 0xeb79b0 2024-09-15T12:40:04.811 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.807+0000 7fa57ea2dec0 1 -- 172.21.15.122:0/4012224973 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xd17380 con 0xeb79b0 2024-09-15T12:40:04.811 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.807+0000 7fa56f7fe640 1 -- 172.21.15.122:0/4012224973 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa560012bf0 con 0xeb79b0 2024-09-15T12:40:04.811 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.807+0000 7fa57ea2dec0 1 -- 172.21.15.122:0/4012224973 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0xea3640 con 0xeb79b0 2024-09-15T12:40:04.812 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.808+0000 7fa56f7fe640 1 -- 172.21.15.122:0/4012224973 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa56000d040 con 0xeb79b0 2024-09-15T12:40:04.812 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.808+0000 7fa56f7fe640 1 --2- 172.21.15.122:0/4012224973 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa55c03d1c0 0x7fa55c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.812 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.808+0000 7fa56f7fe640 1 -- 172.21.15.122:0/4012224973 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(712..712 src has 621..712) ==== 4207+0+0 (crc 0 0 0) 0x7fa56000a040 con 0xeb79b0 2024-09-15T12:40:04.812 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.808+0000 7fa57ea2dec0 1 --2- 172.21.15.122:0/4012224973 >> v2:172.21.15.142:6811/2150609480 conn(0xeb84d0 0xeb6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.812 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.808+0000 7fa57ea2dec0 1 -- 172.21.15.122:0/4012224973 --> v2:172.21.15.142:6811/2150609480 -- osd_op(unknown.0.0:1 200.7 200:fe351e27:::obj9:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0xea6ae0 con 0xeb84d0 2024-09-15T12:40:04.812 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.809+0000 7fa57623e640 1 --2- 172.21.15.122:0/4012224973 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa55c03d1c0 0x7fa55c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.813 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.809+0000 7fa57623e640 1 --2- 172.21.15.122:0/4012224973 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa55c03d1c0 0x7fa55c03f6d0 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.813 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.810+0000 7fa577240640 1 --2- 172.21.15.122:0/4012224973 >> v2:172.21.15.142:6811/2150609480 conn(0xeb84d0 0xeb6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:40:04.816 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.814+0000 7fa577240640 1 --2- 172.21.15.122:0/4012224973 >> v2:172.21.15.142:6811/2150609480 conn(0xeb84d0 0xeb6600 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.833 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.830+0000 7fa577240640 1 -- 172.21.15.122:0/4012224973 <== osd.3 v2:172.21.15.142:6811/2150609480 1 ==== osd_op_reply(1 obj9 [writefull 0~12875] v712'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa56800a430 con 0xeb84d0 2024-09-15T12:40:04.833 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.830+0000 7fa57ea2dec0 1 -- 172.21.15.122:0/4012224973 >> v2:172.21.15.142:6811/2150609480 conn(0xeb84d0 msgr2=0xeb6600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.833 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.830+0000 7fa57ea2dec0 1 --2- 172.21.15.122:0/4012224973 >> v2:172.21.15.142:6811/2150609480 conn(0xeb84d0 0xeb6600 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.833 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.830+0000 7fa57ea2dec0 1 -- 172.21.15.122:0/4012224973 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa55c03d1c0 msgr2=0x7fa55c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.833 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.830+0000 7fa57ea2dec0 1 --2- 172.21.15.122:0/4012224973 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa55c03d1c0 0x7fa55c03f6d0 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.833 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.830+0000 7fa57ea2dec0 1 -- 172.21.15.122:0/4012224973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xeb79b0 msgr2=0xf4c500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.833 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.830+0000 7fa57ea2dec0 1 --2- 172.21.15.122:0/4012224973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xeb79b0 0xf4c500 crc :-1 s=READY pgs=12945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.833 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.830+0000 7fa57ea2dec0 1 -- 172.21.15.122:0/4012224973 shutdown_connections 2024-09-15T12:40:04.833 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.830+0000 7fa57ea2dec0 1 --2- 172.21.15.122:0/4012224973 >> v2:172.21.15.142:6811/2150609480 conn(0xeb84d0 0xeb6600 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.833 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.830+0000 7fa57ea2dec0 1 --2- 172.21.15.122:0/4012224973 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa55c03d1c0 0x7fa55c03f6d0 unknown :-1 s=CLOSED pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.834 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.830+0000 7fa57ea2dec0 1 --2- 172.21.15.122:0/4012224973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xeb79b0 0xf4c500 unknown :-1 s=CLOSED pgs=12945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.834 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.830+0000 7fa57ea2dec0 1 -- 172.21.15.122:0/4012224973 >> 172.21.15.122:0/4012224973 conn(0xd49770 msgr2=0xe20930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.834 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.830+0000 7fa57ea2dec0 1 -- 172.21.15.122:0/4012224973 shutdown_connections 2024-09-15T12:40:04.834 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.830+0000 7fa57ea2dec0 1 -- 172.21.15.122:0/4012224973 wait complete. 2024-09-15T12:40:04.835 INFO:tasks.workunit.client.0.smithi122.stderr:+ for f in `seq 1 10` 2024-09-15T12:40:04.835 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p 1c731143-9d61-4faf-9b5c-31d38aecd147 put obj10 /etc/passwd 2024-09-15T12:40:04.871 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.869+0000 7f9a07039ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.876 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.874+0000 7f9a07039ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.876 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.874+0000 7f9a07039ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:04.877 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.875+0000 7f9a07039ec0 1 Processor -- start 2024-09-15T12:40:04.877 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.875+0000 7f9a07039ec0 1 -- start start 2024-09-15T12:40:04.879 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.876+0000 7f9a07039ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x218bfc0 0x2179d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.879 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.876+0000 7f9a07039ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x20f8520 con 0x218bfc0 2024-09-15T12:40:04.879 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.876+0000 7f99ff03f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x218bfc0 0x2179d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.879 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.876+0000 7f99ff03f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x218bfc0 0x2179d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52250/0 (socket says 172.21.15.122:52250) 2024-09-15T12:40:04.879 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.876+0000 7f99ff03f640 1 -- 172.21.15.122:0/1735687765 learned_addr learned my addr 172.21.15.122:0/1735687765 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.879 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.876+0000 7f99ff03f640 1 -- 172.21.15.122:0/1735687765 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2094e10 con 0x218bfc0 2024-09-15T12:40:04.879 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.876+0000 7f99ff03f640 1 --2- 172.21.15.122:0/1735687765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x218bfc0 0x2179d80 crc :-1 s=READY pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7531f5dc71a291 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.879 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.877+0000 7f99fd83c640 1 -- 172.21.15.122:0/1735687765 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f99e802dc90 con 0x218bfc0 2024-09-15T12:40:04.879 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.877+0000 7f99fd83c640 1 -- 172.21.15.122:0/1735687765 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f99e800a040 con 0x218bfc0 2024-09-15T12:40:04.879 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.877+0000 7f99fd83c640 1 -- 172.21.15.122:0/1735687765 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f99e800a2e0 con 0x218bfc0 2024-09-15T12:40:04.880 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.877+0000 7f9a07039ec0 1 -- 172.21.15.122:0/1735687765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x218bfc0 msgr2=0x2179d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.880 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.877+0000 7f9a07039ec0 1 --2- 172.21.15.122:0/1735687765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x218bfc0 0x2179d80 crc :-1 s=READY pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.880 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.877+0000 7f9a07039ec0 1 -- 172.21.15.122:0/1735687765 shutdown_connections 2024-09-15T12:40:04.881 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.877+0000 7f9a07039ec0 1 --2- 172.21.15.122:0/1735687765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x218bfc0 0x2179d80 unknown :-1 s=CLOSED pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.881 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.877+0000 7f9a07039ec0 1 -- 172.21.15.122:0/1735687765 >> 172.21.15.122:0/1735687765 conn(0x20b8770 msgr2=0x218fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.881 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.877+0000 7f9a07039ec0 1 -- 172.21.15.122:0/1735687765 shutdown_connections 2024-09-15T12:40:04.881 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.877+0000 7f9a07039ec0 1 -- 172.21.15.122:0/1735687765 wait complete. 2024-09-15T12:40:04.881 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.878+0000 7f9a07039ec0 1 Processor -- start 2024-09-15T12:40:04.881 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.878+0000 7f9a07039ec0 1 -- start start 2024-09-15T12:40:04.883 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.879+0000 7f9a07039ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x218bfc0 0x229afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.883 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.879+0000 7f9a07039ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x20f6280 con 0x218bfc0 2024-09-15T12:40:04.883 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.879+0000 7f99ff03f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x218bfc0 0x229afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.883 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.879+0000 7f99ff03f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x218bfc0 0x229afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:52264/0 (socket says 172.21.15.122:52264) 2024-09-15T12:40:04.883 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.879+0000 7f99ff03f640 1 -- 172.21.15.122:0/1365769863 learned_addr learned my addr 172.21.15.122:0/1365769863 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:04.883 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.879+0000 7f99ff03f640 1 -- 172.21.15.122:0/1365769863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2086920 con 0x218bfc0 2024-09-15T12:40:04.883 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.880+0000 7f99ff03f640 1 --2- 172.21.15.122:0/1365769863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x218bfc0 0x229afc0 crc :-1 s=READY pgs=12949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.883 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.880+0000 7f99fc83a640 1 -- 172.21.15.122:0/1365769863 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f99e803e040 con 0x218bfc0 2024-09-15T12:40:04.883 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.880+0000 7f99fc83a640 1 -- 172.21.15.122:0/1365769863 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f99e802db60 con 0x218bfc0 2024-09-15T12:40:04.884 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.880+0000 7f9a07039ec0 1 -- 172.21.15.122:0/1365769863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2086380 con 0x218bfc0 2024-09-15T12:40:04.884 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.880+0000 7f99fc83a640 1 -- 172.21.15.122:0/1365769863 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f99e800a2e0 con 0x218bfc0 2024-09-15T12:40:04.884 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.880+0000 7f9a07039ec0 1 -- 172.21.15.122:0/1365769863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x22ae9d0 con 0x218bfc0 2024-09-15T12:40:04.884 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.881+0000 7f99fc83a640 1 -- 172.21.15.122:0/1365769863 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f99e8009b30 con 0x218bfc0 2024-09-15T12:40:04.884 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.881+0000 7f99fc83a640 1 --2- 172.21.15.122:0/1365769863 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f99e403d1c0 0x7f99e403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.884 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.881+0000 7f99fc83a640 1 -- 172.21.15.122:0/1365769863 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(712..712 src has 621..712) ==== 4207+0+0 (crc 0 0 0) 0x7f99e8032040 con 0x218bfc0 2024-09-15T12:40:04.884 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.881+0000 7f9a07039ec0 1 --2- 172.21.15.122:0/1365769863 >> v2:172.21.15.122:6800/2464407069 conn(0x2194130 0x22ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:04.884 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.881+0000 7f9a07039ec0 1 -- 172.21.15.122:0/1365769863 --> v2:172.21.15.122:6800/2464407069 -- osd_op(unknown.0.0:1 200.b 200:d1337354:::obj10:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x229e7f0 con 0x2194130 2024-09-15T12:40:04.884 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.881+0000 7f99fe83e640 1 --2- 172.21.15.122:0/1365769863 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f99e403d1c0 0x7f99e403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:04.884 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.882+0000 7f99fe83e640 1 --2- 172.21.15.122:0/1365769863 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f99e403d1c0 0x7f99e403f6d0 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.885 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.882+0000 7f99ff840640 1 --2- 172.21.15.122:0/1365769863 >> v2:172.21.15.122:6800/2464407069 conn(0x2194130 0x22ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:40:04.887 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.885+0000 7f99ff840640 1 --2- 172.21.15.122:0/1365769863 >> v2:172.21.15.122:6800/2464407069 conn(0x2194130 0x22ad200 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:04.902 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.899+0000 7f99ff840640 1 -- 172.21.15.122:0/1365769863 <== osd.0 v2:172.21.15.122:6800/2464407069 1 ==== osd_op_reply(1 obj10 [writefull 0~12875] v712'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f99f000a430 con 0x2194130 2024-09-15T12:40:04.902 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.900+0000 7f9a07039ec0 1 -- 172.21.15.122:0/1365769863 >> v2:172.21.15.122:6800/2464407069 conn(0x2194130 msgr2=0x22ad200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.902 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.900+0000 7f9a07039ec0 1 --2- 172.21.15.122:0/1365769863 >> v2:172.21.15.122:6800/2464407069 conn(0x2194130 0x22ad200 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.902 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.900+0000 7f9a07039ec0 1 -- 172.21.15.122:0/1365769863 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f99e403d1c0 msgr2=0x7f99e403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.903 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.900+0000 7f9a07039ec0 1 --2- 172.21.15.122:0/1365769863 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f99e403d1c0 0x7f99e403f6d0 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.903 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.900+0000 7f9a07039ec0 1 -- 172.21.15.122:0/1365769863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x218bfc0 msgr2=0x229afc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:04.903 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.900+0000 7f9a07039ec0 1 --2- 172.21.15.122:0/1365769863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x218bfc0 0x229afc0 crc :-1 s=READY pgs=12949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.903 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.900+0000 7f9a07039ec0 1 -- 172.21.15.122:0/1365769863 shutdown_connections 2024-09-15T12:40:04.903 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.900+0000 7f9a07039ec0 1 --2- 172.21.15.122:0/1365769863 >> v2:172.21.15.122:6800/2464407069 conn(0x2194130 0x22ad200 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.903 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.900+0000 7f9a07039ec0 1 --2- 172.21.15.122:0/1365769863 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f99e403d1c0 0x7f99e403f6d0 unknown :-1 s=CLOSED pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.903 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.900+0000 7f9a07039ec0 1 --2- 172.21.15.122:0/1365769863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x218bfc0 0x229afc0 unknown :-1 s=CLOSED pgs=12949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:04.903 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.900+0000 7f9a07039ec0 1 -- 172.21.15.122:0/1365769863 >> 172.21.15.122:0/1365769863 conn(0x20b8770 msgr2=0x218fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:04.903 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.900+0000 7f9a07039ec0 1 -- 172.21.15.122:0/1365769863 shutdown_connections 2024-09-15T12:40:04.903 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:04.900+0000 7f9a07039ec0 1 -- 172.21.15.122:0/1365769863 wait complete. 2024-09-15T12:40:04.905 INFO:tasks.workunit.client.0.smithi122.stderr:+ sleep 30 2024-09-15T12:40:34.906 INFO:tasks.workunit.client.0.smithi122.stderr:+ rados -p ed9b5ffb-fd10-45e9-a651-fa504ac931a6 put threemore /etc/passwd 2024-09-15T12:40:34.951 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.949+0000 7f4ed0639ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:34.956 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.954+0000 7f4ed0639ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:34.956 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.954+0000 7f4ed0639ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:34.957 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.955+0000 7f4ed0639ec0 1 Processor -- start 2024-09-15T12:40:34.957 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.955+0000 7f4ed0639ec0 1 -- start start 2024-09-15T12:40:34.960 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.956+0000 7f4ed0639ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbfdfc0 0xd22cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:34.960 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.956+0000 7f4ed0639ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0xb6a520 con 0xbfdfc0 2024-09-15T12:40:34.960 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.956+0000 7f4ec37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbfdfc0 0xd22cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:34.960 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.956+0000 7f4ec37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbfdfc0 0xd22cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40270/0 (socket says 172.21.15.122:40270) 2024-09-15T12:40:34.960 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.956+0000 7f4ec37fe640 1 -- 172.21.15.122:0/2436920385 learned_addr learned my addr 172.21.15.122:0/2436920385 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:34.960 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.956+0000 7f4ec37fe640 1 -- 172.21.15.122:0/2436920385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb06e10 con 0xbfdfc0 2024-09-15T12:40:34.960 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.956+0000 7f4ec37fe640 1 --2- 172.21.15.122:0/2436920385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbfdfc0 0xd22cd0 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd07a63c8e4a13b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:34.960 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.957+0000 7f4ec27fc640 1 -- 172.21.15.122:0/2436920385 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4eb400b580 con 0xbfdfc0 2024-09-15T12:40:34.960 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.957+0000 7f4ec27fc640 1 -- 172.21.15.122:0/2436920385 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4eb400b6e0 con 0xbfdfc0 2024-09-15T12:40:34.960 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.957+0000 7f4ec27fc640 1 -- 172.21.15.122:0/2436920385 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4eb400b980 con 0xbfdfc0 2024-09-15T12:40:34.961 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.957+0000 7f4ed0639ec0 1 -- 172.21.15.122:0/2436920385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbfdfc0 msgr2=0xd22cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:34.961 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.957+0000 7f4ed0639ec0 1 --2- 172.21.15.122:0/2436920385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbfdfc0 0xd22cd0 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:34.961 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.957+0000 7f4ed0639ec0 1 -- 172.21.15.122:0/2436920385 shutdown_connections 2024-09-15T12:40:34.961 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.957+0000 7f4ed0639ec0 1 --2- 172.21.15.122:0/2436920385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbfdfc0 0xd22cd0 unknown :-1 s=CLOSED pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:34.961 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.957+0000 7f4ed0639ec0 1 -- 172.21.15.122:0/2436920385 >> 172.21.15.122:0/2436920385 conn(0xb2a770 msgr2=0xc01c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:34.961 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.957+0000 7f4ed0639ec0 1 -- 172.21.15.122:0/2436920385 shutdown_connections 2024-09-15T12:40:34.961 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.957+0000 7f4ed0639ec0 1 -- 172.21.15.122:0/2436920385 wait complete. 2024-09-15T12:40:34.963 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.958+0000 7f4ed0639ec0 1 Processor -- start 2024-09-15T12:40:34.963 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.958+0000 7f4ed0639ec0 1 -- start start 2024-09-15T12:40:34.963 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.959+0000 7f4ed0639ec0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbfdfc0 0xd0ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:34.963 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.959+0000 7f4ed0639ec0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0xb68280 con 0xbfdfc0 2024-09-15T12:40:34.963 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.959+0000 7f4ec37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbfdfc0 0xd0ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:34.963 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.959+0000 7f4ec37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbfdfc0 0xd0ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40272/0 (socket says 172.21.15.122:40272) 2024-09-15T12:40:34.963 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.959+0000 7f4ec37fe640 1 -- 172.21.15.122:0/724753377 learned_addr learned my addr 172.21.15.122:0/724753377 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:34.963 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.960+0000 7f4ec37fe640 1 -- 172.21.15.122:0/724753377 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xaf8920 con 0xbfdfc0 2024-09-15T12:40:34.963 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.960+0000 7f4ec37fe640 1 --2- 172.21.15.122:0/724753377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbfdfc0 0xd0ae40 crc :-1 s=READY pgs=12953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:34.963 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.960+0000 7f4ec17fa640 1 -- 172.21.15.122:0/724753377 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4eb40128e0 con 0xbfdfc0 2024-09-15T12:40:34.963 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.960+0000 7f4ec17fa640 1 -- 172.21.15.122:0/724753377 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4eb4005040 con 0xbfdfc0 2024-09-15T12:40:34.963 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.960+0000 7f4ed0639ec0 1 -- 172.21.15.122:0/724753377 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xaf8380 con 0xbfdfc0 2024-09-15T12:40:34.964 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.960+0000 7f4ec17fa640 1 -- 172.21.15.122:0/724753377 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4eb4012b70 con 0xbfdfc0 2024-09-15T12:40:34.964 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.960+0000 7f4ed0639ec0 1 -- 172.21.15.122:0/724753377 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0xd22820 con 0xbfdfc0 2024-09-15T12:40:34.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.961+0000 7f4ec17fa640 1 -- 172.21.15.122:0/724753377 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4eb400d040 con 0xbfdfc0 2024-09-15T12:40:34.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.961+0000 7f4ec17fa640 1 --2- 172.21.15.122:0/724753377 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4ea403d1c0 0x7f4ea403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:34.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.961+0000 7f4ec17fa640 1 -- 172.21.15.122:0/724753377 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(714..714 src has 621..714) ==== 4207+0+0 (crc 0 0 0) 0x7f4eb400a040 con 0xbfdfc0 2024-09-15T12:40:34.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.962+0000 7f4ec17fa640 1 -- 172.21.15.122:0/724753377 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=715}) -- 0x7f4ea4043bf0 con 0xbfdfc0 2024-09-15T12:40:34.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.962+0000 7f4ed0639ec0 1 --2- 172.21.15.122:0/724753377 >> v2:172.21.15.142:6803/3269009979 conn(0xc06300 0xd2d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:34.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.962+0000 7f4ed0639ec0 1 -- 172.21.15.122:0/724753377 --> v2:172.21.15.142:6803/3269009979 -- osd_op(unknown.0.0:1 199.2 199:47cad802:::threemore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e714) -- 0xd25c40 con 0xc06300 2024-09-15T12:40:34.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.962+0000 7f4ebbfff640 1 --2- 172.21.15.122:0/724753377 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4ea403d1c0 0x7f4ea403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:34.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.962+0000 7f4ebbfff640 1 --2- 172.21.15.122:0/724753377 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4ea403d1c0 0x7f4ea403f6d0 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:34.965 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.963+0000 7f4ec8e40640 1 --2- 172.21.15.122:0/724753377 >> v2:172.21.15.142:6803/3269009979 conn(0xc06300 0xd2d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:40:34.969 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.967+0000 7f4ec8e40640 1 --2- 172.21.15.122:0/724753377 >> v2:172.21.15.142:6803/3269009979 conn(0xc06300 0xd2d780 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:34.987 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.984+0000 7f4ec8e40640 1 -- 172.21.15.122:0/724753377 <== osd.2 v2:172.21.15.142:6803/3269009979 1 ==== osd_op_reply(1 threemore [writefull 0~12875] v714'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f4ebc00a430 con 0xc06300 2024-09-15T12:40:34.987 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.984+0000 7f4ed0639ec0 1 -- 172.21.15.122:0/724753377 >> v2:172.21.15.142:6803/3269009979 conn(0xc06300 msgr2=0xd2d780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:34.987 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.984+0000 7f4ed0639ec0 1 --2- 172.21.15.122:0/724753377 >> v2:172.21.15.142:6803/3269009979 conn(0xc06300 0xd2d780 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:34.987 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.985+0000 7f4ed0639ec0 1 -- 172.21.15.122:0/724753377 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4ea403d1c0 msgr2=0x7f4ea403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:34.987 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.985+0000 7f4ed0639ec0 1 --2- 172.21.15.122:0/724753377 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4ea403d1c0 0x7f4ea403f6d0 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:34.987 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.985+0000 7f4ed0639ec0 1 -- 172.21.15.122:0/724753377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbfdfc0 msgr2=0xd0ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:34.987 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.985+0000 7f4ed0639ec0 1 --2- 172.21.15.122:0/724753377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbfdfc0 0xd0ae40 crc :-1 s=READY pgs=12953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:34.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.985+0000 7f4ed0639ec0 1 -- 172.21.15.122:0/724753377 shutdown_connections 2024-09-15T12:40:34.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.985+0000 7f4ed0639ec0 1 --2- 172.21.15.122:0/724753377 >> v2:172.21.15.142:6803/3269009979 conn(0xc06300 0xd2d780 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:34.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.985+0000 7f4ed0639ec0 1 --2- 172.21.15.122:0/724753377 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4ea403d1c0 0x7f4ea403f6d0 unknown :-1 s=CLOSED pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:34.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.985+0000 7f4ed0639ec0 1 --2- 172.21.15.122:0/724753377 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0xbfdfc0 0xd0ae40 unknown :-1 s=CLOSED pgs=12953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:34.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.985+0000 7f4ed0639ec0 1 -- 172.21.15.122:0/724753377 >> 172.21.15.122:0/724753377 conn(0xb2a770 msgr2=0xbd9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:34.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.985+0000 7f4ed0639ec0 1 -- 172.21.15.122:0/724753377 shutdown_connections 2024-09-15T12:40:34.988 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:34.985+0000 7f4ed0639ec0 1 -- 172.21.15.122:0/724753377 wait complete. 2024-09-15T12:40:34.989 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph osd pool set-quota ed9b5ffb-fd10-45e9-a651-fa504ac931a6 max_bytes 0 2024-09-15T12:40:35.086 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.075+0000 7f8bb84c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:35.087 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.085+0000 7f8bb84c8640 1 Processor -- start 2024-09-15T12:40:35.087 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.085+0000 7f8bb84c8640 1 -- start start 2024-09-15T12:40:35.089 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.086+0000 7f8bb84c8640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8bb006e4c0 0x7f8bb0139540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:35.089 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.086+0000 7f8bb84c8640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb0070460 con 0x7f8bb006d9a0 2024-09-15T12:40:35.089 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.086+0000 7f8bb84c8640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f8bb006f7e0 con 0x7f8bb006e4c0 2024-09-15T12:40:35.089 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.086+0000 7f8bb5a63640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8bb006e4c0 0x7f8bb0139540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:35.089 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.086+0000 7f8bb5a63640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8bb006e4c0 0x7f8bb0139540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40274/0 (socket says 172.21.15.122:40274) 2024-09-15T12:40:35.089 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.086+0000 7f8bb5a63640 1 -- 172.21.15.122:0/1060622972 learned_addr learned my addr 172.21.15.122:0/1060622972 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:35.089 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.086+0000 7f8bb6264640 1 --1- 172.21.15.122:0/1060622972 >> v1:172.21.15.122:6789/0 conn(0x7f8bb006d9a0 0x7f8bb006ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:44780/0 (socket says 172.21.15.122:44780) 2024-09-15T12:40:35.089 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.086+0000 7f8bb5a63640 1 -- 172.21.15.122:0/1060622972 >> v1:172.21.15.122:6789/0 conn(0x7f8bb006d9a0 legacy=0x7f8bb006ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:35.089 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.086+0000 7f8bb5a63640 1 -- 172.21.15.122:0/1060622972 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb006f950 con 0x7f8bb006e4c0 2024-09-15T12:40:35.089 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.087+0000 7f8bb5a63640 1 --2- 172.21.15.122:0/1060622972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bb006e4c0 0x7f8bb0139540 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d1cb4a07ae09b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:35.089 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.087+0000 7f8bb5262640 1 -- 172.21.15.122:0/1060622972 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8bac009e50 con 0x7f8bb006e4c0 2024-09-15T12:40:35.090 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.087+0000 7f8bb5262640 1 -- 172.21.15.122:0/1060622972 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8bac00e230 con 0x7f8bb006e4c0 2024-09-15T12:40:35.090 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.087+0000 7f8bb5262640 1 -- 172.21.15.122:0/1060622972 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8bac00e4d0 con 0x7f8bb006e4c0 2024-09-15T12:40:35.090 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.087+0000 7f8bb84c8640 1 -- 172.21.15.122:0/1060622972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bb006e4c0 msgr2=0x7f8bb0139540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:35.090 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.087+0000 7f8bb84c8640 1 --2- 172.21.15.122:0/1060622972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bb006e4c0 0x7f8bb0139540 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:35.091 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.087+0000 7f8bb84c8640 1 -- 172.21.15.122:0/1060622972 shutdown_connections 2024-09-15T12:40:35.091 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.087+0000 7f8bb84c8640 1 --2- 172.21.15.122:0/1060622972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bb006e4c0 0x7f8bb0139540 unknown :-1 s=CLOSED pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:35.091 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.088+0000 7f8bb84c8640 1 -- 172.21.15.122:0/1060622972 >> 172.21.15.122:0/1060622972 conn(0x7f8bb00a30a0 msgr2=0x7f8bb00a34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:35.091 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.088+0000 7f8bb84c8640 1 -- 172.21.15.122:0/1060622972 shutdown_connections 2024-09-15T12:40:35.091 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.088+0000 7f8bb84c8640 1 -- 172.21.15.122:0/1060622972 wait complete. 2024-09-15T12:40:35.091 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.088+0000 7f8bb84c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:35.091 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.089+0000 7f8bb84c8640 1 Processor -- start 2024-09-15T12:40:35.091 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.089+0000 7f8bb84c8640 1 -- start start 2024-09-15T12:40:35.093 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.090+0000 7f8bb84c8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bb006d9a0 0x7f8bb012f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:35.093 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.090+0000 7f8bb84c8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb0130a30 con 0x7f8bb006d9a0 2024-09-15T12:40:35.093 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.090+0000 7f8bb6264640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bb006d9a0 0x7f8bb012f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:35.093 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.090+0000 7f8bb6264640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bb006d9a0 0x7f8bb012f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40280/0 (socket says 172.21.15.122:40280) 2024-09-15T12:40:35.093 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.090+0000 7f8bb6264640 1 -- 172.21.15.122:0/469649826 learned_addr learned my addr 172.21.15.122:0/469649826 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:35.093 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.090+0000 7f8bb6264640 1 -- 172.21.15.122:0/469649826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb0131630 con 0x7f8bb006d9a0 2024-09-15T12:40:35.093 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.091+0000 7f8bb6264640 1 --2- 172.21.15.122:0/469649826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bb006d9a0 0x7f8bb012f0d0 crc :-1 s=READY pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:35.093 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.091+0000 7f8ba6ffd640 1 -- 172.21.15.122:0/469649826 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ba00059a0 con 0x7f8bb006d9a0 2024-09-15T12:40:35.093 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.091+0000 7f8ba6ffd640 1 -- 172.21.15.122:0/469649826 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8ba0005b00 con 0x7f8bb006d9a0 2024-09-15T12:40:35.093 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.091+0000 7f8bb84c8640 1 -- 172.21.15.122:0/469649826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb0133240 con 0x7f8bb006d9a0 2024-09-15T12:40:35.094 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.091+0000 7f8ba6ffd640 1 -- 172.21.15.122:0/469649826 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ba0005da0 con 0x7f8bb006d9a0 2024-09-15T12:40:35.094 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.091+0000 7f8bb84c8640 1 -- 172.21.15.122:0/469649826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb01327e0 con 0x7f8bb006d9a0 2024-09-15T12:40:35.094 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.092+0000 7f8bb84c8640 1 -- 172.21.15.122:0/469649826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb0132d00 con 0x7f8bb006d9a0 2024-09-15T12:40:35.095 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.092+0000 7f8ba6ffd640 1 -- 172.21.15.122:0/469649826 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8ba00070b0 con 0x7f8bb006d9a0 2024-09-15T12:40:35.095 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.092+0000 7f8ba6ffd640 1 --2- 172.21.15.122:0/469649826 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8b9403e8e0 0x7f8b94040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:35.095 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.092+0000 7f8ba6ffd640 1 -- 172.21.15.122:0/469649826 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(714..714 src has 621..714) ==== 4207+0+0 (crc 0 0 0) 0x7f8ba004fca0 con 0x7f8bb006d9a0 2024-09-15T12:40:35.095 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.092+0000 7f8ba6ffd640 1 -- 172.21.15.122:0/469649826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=715}) -- 0x7f8b94045370 con 0x7f8bb006d9a0 2024-09-15T12:40:35.095 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.093+0000 7f8bb5a63640 1 --2- 172.21.15.122:0/469649826 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8b9403e8e0 0x7f8b94040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:35.095 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.093+0000 7f8bb5a63640 1 --2- 172.21.15.122:0/469649826 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8b9403e8e0 0x7f8b94040df0 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:35.099 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.097+0000 7f8ba6ffd640 1 -- 172.21.15.122:0/469649826 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f8ba000f230 con 0x7f8bb006d9a0 2024-09-15T12:40:35.288 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:35.286+0000 7f8bb84c8640 1 -- 172.21.15.122:0/469649826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_bytes", "val": "0"} v 0) -- 0x7f8bb0077c10 con 0x7f8bb006d9a0 2024-09-15T12:40:36.153 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:36.151+0000 7f8ba6ffd640 1 -- 172.21.15.122:0/469649826 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 v715) ==== 217+0+0 (crc 0 0 0) 0x7f8ba000d660 con 0x7f8bb006d9a0 2024-09-15T12:40:36.155 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:36.153+0000 7f8ba6ffd640 1 -- 172.21.15.122:0/469649826 <== mon.0 v2:172.21.15.122:3300/0 8 ==== osd_map(715..715 src has 621..715) ==== 628+0+0 (crc 0 0 0) 0x7f8ba000da00 con 0x7f8bb006d9a0 2024-09-15T12:40:36.155 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:36.153+0000 7f8ba6ffd640 1 -- 172.21.15.122:0/469649826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=716}) -- 0x7f8b940460f0 con 0x7f8bb006d9a0 2024-09-15T12:40:36.277 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:36.275+0000 7f8bb84c8640 1 -- 172.21.15.122:0/469649826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_bytes", "val": "0"} v 0) -- 0x7f8bb006ddb0 con 0x7f8bb006d9a0 2024-09-15T12:40:37.169 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.166+0000 7f8ba6ffd640 1 -- 172.21.15.122:0/469649826 <== mon.0 v2:172.21.15.122:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 v716) ==== 217+0+0 (crc 0 0 0) 0x7f8ba000d840 con 0x7f8bb006d9a0 2024-09-15T12:40:37.169 INFO:tasks.workunit.client.0.smithi122.stderr:set-quota max_bytes = 0 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 2024-09-15T12:40:37.171 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.169+0000 7f8ba6ffd640 1 -- 172.21.15.122:0/469649826 <== mon.0 v2:172.21.15.122:3300/0 10 ==== osd_map(716..716 src has 621..716) ==== 628+0+0 (crc 0 0 0) 0x7f8ba0021d70 con 0x7f8bb006d9a0 2024-09-15T12:40:37.171 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.169+0000 7f8ba6ffd640 1 -- 172.21.15.122:0/469649826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=717}) -- 0x7f8b940463d0 con 0x7f8bb006d9a0 2024-09-15T12:40:37.172 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.170+0000 7f8bb84c8640 1 -- 172.21.15.122:0/469649826 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8b9403e8e0 msgr2=0x7f8b94040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:37.172 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.170+0000 7f8bb84c8640 1 --2- 172.21.15.122:0/469649826 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8b9403e8e0 0x7f8b94040df0 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:37.172 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.170+0000 7f8bb84c8640 1 -- 172.21.15.122:0/469649826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bb006d9a0 msgr2=0x7f8bb012f0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:37.172 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.170+0000 7f8bb84c8640 1 --2- 172.21.15.122:0/469649826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bb006d9a0 0x7f8bb012f0d0 crc :-1 s=READY pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:37.172 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.170+0000 7f8bb84c8640 1 -- 172.21.15.122:0/469649826 shutdown_connections 2024-09-15T12:40:37.172 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.170+0000 7f8bb84c8640 1 --2- 172.21.15.122:0/469649826 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8b9403e8e0 0x7f8b94040df0 unknown :-1 s=CLOSED pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:37.173 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.170+0000 7f8bb84c8640 1 --2- 172.21.15.122:0/469649826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bb006d9a0 0x7f8bb012f0d0 unknown :-1 s=CLOSED pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:37.173 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.170+0000 7f8bb84c8640 1 -- 172.21.15.122:0/469649826 >> 172.21.15.122:0/469649826 conn(0x7f8bb00a30a0 msgr2=0x7f8bb00724c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:37.173 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.170+0000 7f8bb84c8640 1 -- 172.21.15.122:0/469649826 shutdown_connections 2024-09-15T12:40:37.173 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.170+0000 7f8bb84c8640 1 -- 172.21.15.122:0/469649826 wait complete. 2024-09-15T12:40:37.188 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph osd pool set-quota ed9b5ffb-fd10-45e9-a651-fa504ac931a6 max_objects 0 2024-09-15T12:40:37.294 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.284+0000 7fdf50711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:37.295 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.293+0000 7fdf50711640 1 Processor -- start 2024-09-15T12:40:37.295 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.293+0000 7fdf50711640 1 -- start start 2024-09-15T12:40:37.298 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.294+0000 7fdf50711640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdf481335d0 0x7fdf48137e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:37.298 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.294+0000 7fdf50711640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf48132ae0 con 0x7fdf4809ec10 2024-09-15T12:40:37.299 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.294+0000 7fdf50711640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fdf481339e0 con 0x7fdf481335d0 2024-09-15T12:40:37.299 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.295+0000 7fdf4dcac640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdf481335d0 0x7fdf48137e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:37.299 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.295+0000 7fdf4dcac640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdf481335d0 0x7fdf48137e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40294/0 (socket says 172.21.15.122:40294) 2024-09-15T12:40:37.299 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.295+0000 7fdf4e4ad640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fdf4809ec10 0x7fdf48132ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:44796/0 (socket says 172.21.15.122:44796) 2024-09-15T12:40:37.299 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.295+0000 7fdf4dcac640 1 -- 172.21.15.122:0/3225534496 learned_addr learned my addr 172.21.15.122:0/3225534496 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:37.299 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.295+0000 7fdf4dcac640 1 -- 172.21.15.122:0/3225534496 >> v1:172.21.15.122:6789/0 conn(0x7fdf4809ec10 legacy=0x7fdf48132ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:37.299 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.295+0000 7fdf4dcac640 1 -- 172.21.15.122:0/3225534496 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4806fe70 con 0x7fdf481335d0 2024-09-15T12:40:37.299 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.295+0000 7fdf4dcac640 1 --2- 172.21.15.122:0/3225534496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf481335d0 0x7fdf48137e00 crc :-1 s=READY pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23ca4b58dd340fb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:37.299 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.295+0000 7fdf4d4ab640 1 -- 172.21.15.122:0/3225534496 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdf38009e50 con 0x7fdf481335d0 2024-09-15T12:40:37.299 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.295+0000 7fdf4d4ab640 1 -- 172.21.15.122:0/3225534496 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdf3800e230 con 0x7fdf481335d0 2024-09-15T12:40:37.299 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.295+0000 7fdf4d4ab640 1 -- 172.21.15.122:0/3225534496 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdf3800e4d0 con 0x7fdf481335d0 2024-09-15T12:40:37.299 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.296+0000 7fdf50711640 1 -- 172.21.15.122:0/3225534496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf481335d0 msgr2=0x7fdf48137e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:37.300 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.296+0000 7fdf50711640 1 --2- 172.21.15.122:0/3225534496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf481335d0 0x7fdf48137e00 crc :-1 s=READY pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:37.300 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.296+0000 7fdf50711640 1 -- 172.21.15.122:0/3225534496 shutdown_connections 2024-09-15T12:40:37.300 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.296+0000 7fdf50711640 1 --2- 172.21.15.122:0/3225534496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf481335d0 0x7fdf48137e00 unknown :-1 s=CLOSED pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:37.300 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.296+0000 7fdf50711640 1 -- 172.21.15.122:0/3225534496 >> 172.21.15.122:0/3225534496 conn(0x7fdf4809d9e0 msgr2=0x7fdf4809ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:37.300 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.296+0000 7fdf50711640 1 -- 172.21.15.122:0/3225534496 shutdown_connections 2024-09-15T12:40:37.300 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.296+0000 7fdf50711640 1 -- 172.21.15.122:0/3225534496 wait complete. 2024-09-15T12:40:37.300 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.296+0000 7fdf50711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:40:37.302 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.298+0000 7fdf50711640 1 Processor -- start 2024-09-15T12:40:37.302 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.298+0000 7fdf50711640 1 -- start start 2024-09-15T12:40:37.302 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.299+0000 7fdf50711640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf4809ec10 0x7fdf4811b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:37.302 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.299+0000 7fdf50711640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdf480a4710 con 0x7fdf4809ec10 2024-09-15T12:40:37.302 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.299+0000 7fdf4e4ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf4809ec10 0x7fdf4811b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:37.302 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.299+0000 7fdf4e4ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf4809ec10 0x7fdf4811b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:40298/0 (socket says 172.21.15.122:40298) 2024-09-15T12:40:37.302 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.299+0000 7fdf4e4ad640 1 -- 172.21.15.122:0/1031875866 learned_addr learned my addr 172.21.15.122:0/1031875866 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:40:37.302 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.299+0000 7fdf4e4ad640 1 -- 172.21.15.122:0/1031875866 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4811c7b0 con 0x7fdf4809ec10 2024-09-15T12:40:37.303 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.299+0000 7fdf4e4ad640 1 --2- 172.21.15.122:0/1031875866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf4809ec10 0x7fdf4811b0b0 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:37.303 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.299+0000 7fdf3effd640 1 -- 172.21.15.122:0/1031875866 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdf44005bb0 con 0x7fdf4809ec10 2024-09-15T12:40:37.303 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.299+0000 7fdf3effd640 1 -- 172.21.15.122:0/1031875866 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdf44005d10 con 0x7fdf4809ec10 2024-09-15T12:40:37.303 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.299+0000 7fdf50711640 1 -- 172.21.15.122:0/1031875866 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4811eca0 con 0x7fdf4809ec10 2024-09-15T12:40:37.303 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.299+0000 7fdf3effd640 1 -- 172.21.15.122:0/1031875866 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdf440070b0 con 0x7fdf4809ec10 2024-09-15T12:40:37.303 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.299+0000 7fdf50711640 1 -- 172.21.15.122:0/1031875866 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf4811d020 con 0x7fdf4809ec10 2024-09-15T12:40:37.304 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.300+0000 7fdf50711640 1 -- 172.21.15.122:0/1031875866 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf48070a20 con 0x7fdf4809ec10 2024-09-15T12:40:37.304 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.301+0000 7fdf3effd640 1 -- 172.21.15.122:0/1031875866 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fdf44007260 con 0x7fdf4809ec10 2024-09-15T12:40:37.304 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.301+0000 7fdf3effd640 1 --2- 172.21.15.122:0/1031875866 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fdf2c03e8e0 0x7fdf2c040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:40:37.305 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.301+0000 7fdf3effd640 1 -- 172.21.15.122:0/1031875866 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(716..716 src has 621..716) ==== 4207+0+0 (crc 0 0 0) 0x7fdf44052890 con 0x7fdf4809ec10 2024-09-15T12:40:37.305 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.301+0000 7fdf3effd640 1 -- 172.21.15.122:0/1031875866 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=717}) -- 0x7fdf2c045310 con 0x7fdf4809ec10 2024-09-15T12:40:37.305 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.301+0000 7fdf4dcac640 1 --2- 172.21.15.122:0/1031875866 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fdf2c03e8e0 0x7fdf2c040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:40:37.305 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.302+0000 7fdf4dcac640 1 --2- 172.21.15.122:0/1031875866 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fdf2c03e8e0 0x7fdf2c040df0 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:40:37.308 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.306+0000 7fdf3effd640 1 -- 172.21.15.122:0/1031875866 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fdf440016e0 con 0x7fdf4809ec10 2024-09-15T12:40:37.484 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:37.482+0000 7fdf50711640 1 -- 172.21.15.122:0/1031875866 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_objects", "val": "0"} v 0) -- 0x7fdf48132ec0 con 0x7fdf4809ec10 2024-09-15T12:40:38.170 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:38.167+0000 7fdf3effd640 1 -- 172.21.15.122:0/1031875866 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 v717) ==== 221+0+0 (crc 0 0 0) 0x7fdf440010e0 con 0x7fdf4809ec10 2024-09-15T12:40:38.170 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:38.168+0000 7fdf3effd640 1 -- 172.21.15.122:0/1031875866 <== mon.0 v2:172.21.15.122:3300/0 8 ==== osd_map(717..717 src has 621..717) ==== 628+0+0 (crc 0 0 0) 0x7fdf44001480 con 0x7fdf4809ec10 2024-09-15T12:40:38.171 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:38.168+0000 7fdf3effd640 1 -- 172.21.15.122:0/1031875866 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=718}) -- 0x7fdf2c046050 con 0x7fdf4809ec10 2024-09-15T12:40:38.288 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:38.286+0000 7fdf50711640 1 -- 172.21.15.122:0/1031875866 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_objects", "val": "0"} v 0) -- 0x7fdf480008d0 con 0x7fdf4809ec10 2024-09-15T12:40:39.182 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:39.179+0000 7fdf3effd640 1 -- 172.21.15.122:0/1031875866 <== mon.0 v2:172.21.15.122:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 v718) ==== 221+0+0 (crc 0 0 0) 0x7fdf440012c0 con 0x7fdf4809ec10 2024-09-15T12:40:39.182 INFO:tasks.workunit.client.0.smithi122.stderr:set-quota max_objects = 0 for pool ed9b5ffb-fd10-45e9-a651-fa504ac931a6 2024-09-15T12:40:39.184 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:39.182+0000 7fdf50711640 1 -- 172.21.15.122:0/1031875866 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fdf2c03e8e0 msgr2=0x7fdf2c040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:39.184 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:39.182+0000 7fdf50711640 1 --2- 172.21.15.122:0/1031875866 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fdf2c03e8e0 0x7fdf2c040df0 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:39.185 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:39.182+0000 7fdf50711640 1 -- 172.21.15.122:0/1031875866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf4809ec10 msgr2=0x7fdf4811b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:40:39.185 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:39.182+0000 7fdf3effd640 1 -- 172.21.15.122:0/1031875866 <== mon.0 v2:172.21.15.122:3300/0 10 ==== osd_map(718..718 src has 621..718) ==== 628+0+0 (crc 0 0 0) 0x7fdf44012000 con 0x7fdf4809ec10 2024-09-15T12:40:39.185 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:39.182+0000 7fdf50711640 1 --2- 172.21.15.122:0/1031875866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf4809ec10 0x7fdf4811b0b0 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:39.185 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:39.182+0000 7fdf50711640 1 -- 172.21.15.122:0/1031875866 shutdown_connections 2024-09-15T12:40:39.185 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:39.182+0000 7fdf50711640 1 --2- 172.21.15.122:0/1031875866 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fdf2c03e8e0 0x7fdf2c040df0 unknown :-1 s=CLOSED pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:39.185 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:39.182+0000 7fdf50711640 1 --2- 172.21.15.122:0/1031875866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdf4809ec10 0x7fdf4811b0b0 unknown :-1 s=CLOSED pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:40:39.185 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:39.182+0000 7fdf50711640 1 -- 172.21.15.122:0/1031875866 >> 172.21.15.122:0/1031875866 conn(0x7fdf4809d9e0 msgr2=0x7fdf480a0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:40:39.185 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:39.182+0000 7fdf50711640 1 -- 172.21.15.122:0/1031875866 shutdown_connections 2024-09-15T12:40:39.185 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:40:39.182+0000 7fdf50711640 1 -- 172.21.15.122:0/1031875866 wait complete. 2024-09-15T12:40:39.200 INFO:tasks.workunit.client.0.smithi122.stderr:+ sleep 30 2024-09-15T12:41:09.202 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph osd pool delete ed9b5ffb-fd10-45e9-a651-fa504ac931a6 ed9b5ffb-fd10-45e9-a651-fa504ac931a6 --yes-i-really-really-mean-it 2024-09-15T12:41:09.307 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.296+0000 7efc11351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:09.308 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.305+0000 7efc11351640 1 Processor -- start 2024-09-15T12:41:09.308 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.305+0000 7efc11351640 1 -- start start 2024-09-15T12:41:09.311 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.306+0000 7efc11351640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efc0c1369d0 0x7efc0c13b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:09.312 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.306+0000 7efc11351640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc0c09fd50 con 0x7efc0c09ed30 2024-09-15T12:41:09.312 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.306+0000 7efc11351640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7efc0c09fa40 con 0x7efc0c1369d0 2024-09-15T12:41:09.312 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.306+0000 7efc0affd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7efc0c09ed30 0x7efc0c1362c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:46800/0 (socket says 172.21.15.122:46800) 2024-09-15T12:41:09.312 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.306+0000 7efc0affd640 1 -- 172.21.15.122:0/869959717 learned_addr learned my addr 172.21.15.122:0/869959717 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:41:09.312 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.306+0000 7efc0a7fc640 1 --2- 172.21.15.122:0/869959717 >> v2:172.21.15.122:3300/0 conn(0x7efc0c1369d0 0x7efc0c13b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:09.312 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.306+0000 7efc0a7fc640 1 -- 172.21.15.122:0/869959717 >> v1:172.21.15.122:6789/0 conn(0x7efc0c09ed30 legacy=0x7efc0c1362c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:09.312 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.306+0000 7efc09ffb640 1 -- 172.21.15.122:0/869959717 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553510325 0 0) 0x7efc0c09fd50 con 0x7efc0c09ed30 2024-09-15T12:41:09.312 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.306+0000 7efc0a7fc640 1 -- 172.21.15.122:0/869959717 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c09ffe0 con 0x7efc0c1369d0 2024-09-15T12:41:09.312 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.307+0000 7efc0a7fc640 1 --2- 172.21.15.122:0/869959717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc0c1369d0 0x7efc0c13b0b0 crc :-1 s=READY pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9700bac9060047a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:09.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.307+0000 7efc09ffb640 1 -- 172.21.15.122:0/869959717 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efbf4009d90 con 0x7efc0c1369d0 2024-09-15T12:41:09.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.307+0000 7efc09ffb640 1 -- 172.21.15.122:0/869959717 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efbf400e230 con 0x7efc0c1369d0 2024-09-15T12:41:09.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.307+0000 7efc09ffb640 1 -- 172.21.15.122:0/869959717 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efbf400e4d0 con 0x7efc0c1369d0 2024-09-15T12:41:09.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.308+0000 7efc11351640 1 -- 172.21.15.122:0/869959717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc0c1369d0 msgr2=0x7efc0c13b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:09.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.308+0000 7efc11351640 1 --2- 172.21.15.122:0/869959717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc0c1369d0 0x7efc0c13b0b0 crc :-1 s=READY pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:09.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.308+0000 7efc11351640 1 -- 172.21.15.122:0/869959717 shutdown_connections 2024-09-15T12:41:09.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.308+0000 7efc11351640 1 --2- 172.21.15.122:0/869959717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc0c1369d0 0x7efc0c13b0b0 unknown :-1 s=CLOSED pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:09.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.308+0000 7efc11351640 1 -- 172.21.15.122:0/869959717 >> 172.21.15.122:0/869959717 conn(0x7efc0c0a5350 msgr2=0x7efc0c0a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:09.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.308+0000 7efc11351640 1 -- 172.21.15.122:0/869959717 shutdown_connections 2024-09-15T12:41:09.314 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.308+0000 7efc11351640 1 -- 172.21.15.122:0/869959717 wait complete. 2024-09-15T12:41:09.314 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.308+0000 7efc11351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:09.317 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.309+0000 7efc11351640 1 Processor -- start 2024-09-15T12:41:09.317 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.309+0000 7efc11351640 1 -- start start 2024-09-15T12:41:09.317 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.310+0000 7efc11351640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc0c09ed30 0x7efc0c124110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:09.317 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.310+0000 7efc11351640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c120b60 con 0x7efc0c09ed30 2024-09-15T12:41:09.317 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.310+0000 7efc0affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc0c09ed30 0x7efc0c124110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:09.317 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.311+0000 7efc0affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc0c09ed30 0x7efc0c124110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:34802/0 (socket says 172.21.15.122:34802) 2024-09-15T12:41:09.317 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.311+0000 7efc0affd640 1 -- 172.21.15.122:0/4281371493 learned_addr learned my addr 172.21.15.122:0/4281371493 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:09.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.311+0000 7efc0affd640 1 -- 172.21.15.122:0/4281371493 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c1222d0 con 0x7efc0c09ed30 2024-09-15T12:41:09.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.311+0000 7efc0affd640 1 --2- 172.21.15.122:0/4281371493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc0c09ed30 0x7efc0c124110 crc :-1 s=READY pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:09.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.311+0000 7efc037fe640 1 -- 172.21.15.122:0/4281371493 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efbfc004bc0 con 0x7efc0c09ed30 2024-09-15T12:41:09.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.311+0000 7efc037fe640 1 -- 172.21.15.122:0/4281371493 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efbfc004d20 con 0x7efc0c09ed30 2024-09-15T12:41:09.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.311+0000 7efc11351640 1 -- 172.21.15.122:0/4281371493 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0c120850 con 0x7efc0c09ed30 2024-09-15T12:41:09.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.311+0000 7efc037fe640 1 -- 172.21.15.122:0/4281371493 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efbfc007120 con 0x7efc0c09ed30 2024-09-15T12:41:09.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.311+0000 7efc11351640 1 -- 172.21.15.122:0/4281371493 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc0c123130 con 0x7efc0c09ed30 2024-09-15T12:41:09.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.312+0000 7efc11351640 1 -- 172.21.15.122:0/4281371493 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc0c1362c0 con 0x7efc0c09ed30 2024-09-15T12:41:09.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.312+0000 7efc037fe640 1 -- 172.21.15.122:0/4281371493 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7efbfc007320 con 0x7efc0c09ed30 2024-09-15T12:41:09.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.312+0000 7efc037fe640 1 --2- 172.21.15.122:0/4281371493 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efbec03e910 0x7efbec040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:09.318 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.313+0000 7efc037fe640 1 -- 172.21.15.122:0/4281371493 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(718..718 src has 621..718) ==== 4207+0+0 (crc 0 0 0) 0x7efbfc050640 con 0x7efc0c09ed30 2024-09-15T12:41:09.319 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.313+0000 7efc037fe640 1 -- 172.21.15.122:0/4281371493 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=719}) -- 0x7efbec0453a0 con 0x7efc0c09ed30 2024-09-15T12:41:09.319 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.313+0000 7efc0a7fc640 1 --2- 172.21.15.122:0/4281371493 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efbec03e910 0x7efbec040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:09.319 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.313+0000 7efc0a7fc640 1 --2- 172.21.15.122:0/4281371493 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efbec03e910 0x7efbec040e20 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:09.321 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.318+0000 7efc037fe640 1 -- 172.21.15.122:0/4281371493 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7efbfc00fae0 con 0x7efc0c09ed30 2024-09-15T12:41:09.496 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:09.494+0000 7efc11351640 1 -- 172.21.15.122:0/4281371493 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "pool2": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "yes_i_really_really_mean_it": true} v 0) -- 0x7efc0c076080 con 0x7efc0c09ed30 2024-09-15T12:41:10.165 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.163+0000 7efc037fe640 1 -- 172.21.15.122:0/4281371493 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "pool2": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "yes_i_really_really_mean_it": true}]=0 pool 'ed9b5ffb-fd10-45e9-a651-fa504ac931a6' removed v719) ==== 248+0+0 (crc 0 0 0) 0x7efbfc0060b0 con 0x7efc0c09ed30 2024-09-15T12:41:10.167 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.165+0000 7efc037fe640 1 -- 172.21.15.122:0/4281371493 <== mon.0 v2:172.21.15.122:3300/0 8 ==== osd_map(719..719 src has 621..719) ==== 296+0+0 (crc 0 0 0) 0x7efbfc006450 con 0x7efc0c09ed30 2024-09-15T12:41:10.167 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.165+0000 7efc037fe640 1 -- 172.21.15.122:0/4281371493 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=720}) -- 0x7efbec045d20 con 0x7efc0c09ed30 2024-09-15T12:41:10.308 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.306+0000 7efc11351640 1 -- 172.21.15.122:0/4281371493 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "pool2": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "yes_i_really_really_mean_it": true} v 0) -- 0x7efc0c1369a0 con 0x7efc0c09ed30 2024-09-15T12:41:10.308 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.306+0000 7efc037fe640 1 -- 172.21.15.122:0/4281371493 <== mon.0 v2:172.21.15.122:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "pool2": "ed9b5ffb-fd10-45e9-a651-fa504ac931a6", "yes_i_really_really_mean_it": true}]=0 pool 'ed9b5ffb-fd10-45e9-a651-fa504ac931a6' does not exist v719) ==== 255+0+0 (crc 0 0 0) 0x7efbfc006290 con 0x7efc0c09ed30 2024-09-15T12:41:10.310 INFO:tasks.workunit.client.0.smithi122.stderr:pool 'ed9b5ffb-fd10-45e9-a651-fa504ac931a6' does not exist 2024-09-15T12:41:10.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.310+0000 7efc11351640 1 -- 172.21.15.122:0/4281371493 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efbec03e910 msgr2=0x7efbec040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:10.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.310+0000 7efc11351640 1 --2- 172.21.15.122:0/4281371493 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efbec03e910 0x7efbec040e20 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:10.313 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.310+0000 7efc11351640 1 -- 172.21.15.122:0/4281371493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc0c09ed30 msgr2=0x7efc0c124110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:10.314 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.310+0000 7efc11351640 1 --2- 172.21.15.122:0/4281371493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc0c09ed30 0x7efc0c124110 crc :-1 s=READY pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:10.314 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.311+0000 7efc11351640 1 -- 172.21.15.122:0/4281371493 shutdown_connections 2024-09-15T12:41:10.314 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.311+0000 7efc11351640 1 --2- 172.21.15.122:0/4281371493 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efbec03e910 0x7efbec040e20 unknown :-1 s=CLOSED pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:10.314 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.311+0000 7efc11351640 1 --2- 172.21.15.122:0/4281371493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc0c09ed30 0x7efc0c124110 unknown :-1 s=CLOSED pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:10.314 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.311+0000 7efc11351640 1 -- 172.21.15.122:0/4281371493 >> 172.21.15.122:0/4281371493 conn(0x7efc0c0a5350 msgr2=0x7efc0c0a3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:10.314 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.311+0000 7efc11351640 1 -- 172.21.15.122:0/4281371493 shutdown_connections 2024-09-15T12:41:10.314 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.311+0000 7efc11351640 1 -- 172.21.15.122:0/4281371493 wait complete. 2024-09-15T12:41:10.324 INFO:tasks.workunit.client.0.smithi122.stderr:+ ceph osd pool delete 1c731143-9d61-4faf-9b5c-31d38aecd147 1c731143-9d61-4faf-9b5c-31d38aecd147 --yes-i-really-really-mean-it 2024-09-15T12:41:10.416 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.406+0000 7f8df3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:10.417 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.415+0000 7f8df3591640 1 Processor -- start 2024-09-15T12:41:10.417 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.415+0000 7f8df3591640 1 -- start start 2024-09-15T12:41:10.421 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.416+0000 7f8df3591640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8dec09cfa0 0x7f8dec09d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:10.422 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.416+0000 7f8df3591640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dec06e470 con 0x7f8dec09d8f0 2024-09-15T12:41:10.422 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.416+0000 7f8df3591640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f8dec06e7c0 con 0x7f8dec09cfa0 2024-09-15T12:41:10.422 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.416+0000 7f8df132d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8dec09cfa0 0x7f8dec09d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:10.422 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.416+0000 7f8df0b2c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f8dec09d8f0 0x7f8dec137280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:46806/0 (socket says 172.21.15.122:46806) 2024-09-15T12:41:10.422 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.416+0000 7f8df0b2c640 1 -- 172.21.15.122:0/1037776515 learned_addr learned my addr 172.21.15.122:0/1037776515 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:41:10.422 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.417+0000 7f8df132d640 1 -- 172.21.15.122:0/1037776515 >> v1:172.21.15.122:6789/0 conn(0x7f8dec09d8f0 legacy=0x7f8dec137280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:10.422 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.417+0000 7f8de3fff640 1 -- 172.21.15.122:0/1037776515 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2845575767 0 0) 0x7f8dec06e470 con 0x7f8dec09d8f0 2024-09-15T12:41:10.423 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.417+0000 7f8df132d640 1 -- 172.21.15.122:0/1037776515 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dec075320 con 0x7f8dec09cfa0 2024-09-15T12:41:10.423 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.417+0000 7f8df132d640 1 --2- 172.21.15.122:0/1037776515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dec09cfa0 0x7f8dec09d3b0 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256fb6a07cbf9598 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:10.423 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.417+0000 7f8de3fff640 1 -- 172.21.15.122:0/1037776515 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8de8009d90 con 0x7f8dec09cfa0 2024-09-15T12:41:10.423 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.417+0000 7f8de3fff640 1 -- 172.21.15.122:0/1037776515 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8de800e230 con 0x7f8dec09cfa0 2024-09-15T12:41:10.423 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.417+0000 7f8de3fff640 1 -- 172.21.15.122:0/1037776515 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8de800e4d0 con 0x7f8dec09cfa0 2024-09-15T12:41:10.423 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.418+0000 7f8df3591640 1 -- 172.21.15.122:0/1037776515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dec09cfa0 msgr2=0x7f8dec09d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:10.424 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.418+0000 7f8df3591640 1 --2- 172.21.15.122:0/1037776515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dec09cfa0 0x7f8dec09d3b0 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:10.424 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.418+0000 7f8df3591640 1 -- 172.21.15.122:0/1037776515 shutdown_connections 2024-09-15T12:41:10.424 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.418+0000 7f8df3591640 1 --2- 172.21.15.122:0/1037776515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dec09cfa0 0x7f8dec09d3b0 unknown :-1 s=CLOSED pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:10.424 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.418+0000 7f8df3591640 1 -- 172.21.15.122:0/1037776515 >> 172.21.15.122:0/1037776515 conn(0x7f8dec0a2000 msgr2=0x7f8dec0a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:10.424 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.418+0000 7f8df3591640 1 -- 172.21.15.122:0/1037776515 shutdown_connections 2024-09-15T12:41:10.424 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.418+0000 7f8df3591640 1 -- 172.21.15.122:0/1037776515 wait complete. 2024-09-15T12:41:10.425 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.418+0000 7f8df3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:10.425 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.419+0000 7f8df3591640 1 Processor -- start 2024-09-15T12:41:10.425 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.419+0000 7f8df3591640 1 -- start start 2024-09-15T12:41:10.428 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.420+0000 7f8df3591640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dec09cfa0 0x7f8dec096eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:10.428 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.421+0000 7f8df3591640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec0978e0 con 0x7f8dec09cfa0 2024-09-15T12:41:10.428 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.421+0000 7f8df132d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dec09cfa0 0x7f8dec096eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:10.428 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.421+0000 7f8df132d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dec09cfa0 0x7f8dec096eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:34830/0 (socket says 172.21.15.122:34830) 2024-09-15T12:41:10.429 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.421+0000 7f8df132d640 1 -- 172.21.15.122:0/3637357291 learned_addr learned my addr 172.21.15.122:0/3637357291 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:10.429 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.421+0000 7f8df132d640 1 -- 172.21.15.122:0/3637357291 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dec095800 con 0x7f8dec09cfa0 2024-09-15T12:41:10.429 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.421+0000 7f8df132d640 1 --2- 172.21.15.122:0/3637357291 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dec09cfa0 0x7f8dec096eb0 crc :-1 s=READY pgs=12965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:10.429 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.421+0000 7f8de1ffb640 1 -- 172.21.15.122:0/3637357291 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8de8014620 con 0x7f8dec09cfa0 2024-09-15T12:41:10.429 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.421+0000 7f8de1ffb640 1 -- 172.21.15.122:0/3637357291 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8de8014780 con 0x7f8dec09cfa0 2024-09-15T12:41:10.429 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.421+0000 7f8de1ffb640 1 -- 172.21.15.122:0/3637357291 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8de8014a20 con 0x7f8dec09cfa0 2024-09-15T12:41:10.429 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.421+0000 7f8df3591640 1 -- 172.21.15.122:0/3637357291 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dec0a0010 con 0x7f8dec09cfa0 2024-09-15T12:41:10.429 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.421+0000 7f8df3591640 1 -- 172.21.15.122:0/3637357291 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dec096590 con 0x7f8dec09cfa0 2024-09-15T12:41:10.429 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.422+0000 7f8de1ffb640 1 -- 172.21.15.122:0/3637357291 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8de8014b80 con 0x7f8dec09cfa0 2024-09-15T12:41:10.430 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.422+0000 7f8df3591640 1 -- 172.21.15.122:0/3637357291 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dec096070 con 0x7f8dec09cfa0 2024-09-15T12:41:10.430 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.423+0000 7f8de1ffb640 1 --2- 172.21.15.122:0/3637357291 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8dd003e930 0x7f8dd0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:10.430 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.423+0000 7f8de1ffb640 1 -- 172.21.15.122:0/3637357291 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(719..719 src has 621..719) ==== 3819+0+0 (crc 0 0 0) 0x7f8de8019040 con 0x7f8dec09cfa0 2024-09-15T12:41:10.430 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.423+0000 7f8de1ffb640 1 -- 172.21.15.122:0/3637357291 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=720}) -- 0x7f8dd0044c20 con 0x7f8dec09cfa0 2024-09-15T12:41:10.430 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.423+0000 7f8df0b2c640 1 --2- 172.21.15.122:0/3637357291 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8dd003e930 0x7f8dd0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:10.430 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.423+0000 7f8df0b2c640 1 --2- 172.21.15.122:0/3637357291 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8dd003e930 0x7f8dd0040e40 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:10.431 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.428+0000 7f8de1ffb640 1 -- 172.21.15.122:0/3637357291 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f8de8011570 con 0x7f8dec09cfa0 2024-09-15T12:41:10.606 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:10.604+0000 7f8df3591640 1 -- 172.21.15.122:0/3637357291 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "1c731143-9d61-4faf-9b5c-31d38aecd147", "pool2": "1c731143-9d61-4faf-9b5c-31d38aecd147", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8dec074f90 con 0x7f8dec09cfa0 2024-09-15T12:41:11.181 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:11.179+0000 7f8de1ffb640 1 -- 172.21.15.122:0/3637357291 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "1c731143-9d61-4faf-9b5c-31d38aecd147", "pool2": "1c731143-9d61-4faf-9b5c-31d38aecd147", "yes_i_really_really_mean_it": true}]=0 pool '1c731143-9d61-4faf-9b5c-31d38aecd147' removed v720) ==== 248+0+0 (crc 0 0 0) 0x7f8de8008f20 con 0x7f8dec09cfa0 2024-09-15T12:41:11.183 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:11.181+0000 7f8de1ffb640 1 -- 172.21.15.122:0/3637357291 <== mon.0 v2:172.21.15.122:3300/0 8 ==== osd_map(720..720 src has 621..720) ==== 296+0+0 (crc 0 0 0) 0x7f8de8018710 con 0x7f8dec09cfa0 2024-09-15T12:41:11.183 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:11.181+0000 7f8de1ffb640 1 -- 172.21.15.122:0/3637357291 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=721}) -- 0x7f8dd00458c0 con 0x7f8dec09cfa0 2024-09-15T12:41:11.321 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:11.319+0000 7f8df3591640 1 -- 172.21.15.122:0/3637357291 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "1c731143-9d61-4faf-9b5c-31d38aecd147", "pool2": "1c731143-9d61-4faf-9b5c-31d38aecd147", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8dec0008d0 con 0x7f8dec09cfa0 2024-09-15T12:41:11.321 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:11.319+0000 7f8de1ffb640 1 -- 172.21.15.122:0/3637357291 <== mon.0 v2:172.21.15.122:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "1c731143-9d61-4faf-9b5c-31d38aecd147", "pool2": "1c731143-9d61-4faf-9b5c-31d38aecd147", "yes_i_really_really_mean_it": true}]=0 pool '1c731143-9d61-4faf-9b5c-31d38aecd147' does not exist v720) ==== 255+0+0 (crc 0 0 0) 0x7f8de8018190 con 0x7f8dec09cfa0 2024-09-15T12:41:11.321 INFO:tasks.workunit.client.0.smithi122.stderr:pool '1c731143-9d61-4faf-9b5c-31d38aecd147' does not exist 2024-09-15T12:41:11.324 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:11.321+0000 7f8df3591640 1 -- 172.21.15.122:0/3637357291 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8dd003e930 msgr2=0x7f8dd0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:11.324 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:11.321+0000 7f8df3591640 1 --2- 172.21.15.122:0/3637357291 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8dd003e930 0x7f8dd0040e40 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:11.324 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:11.322+0000 7f8df3591640 1 -- 172.21.15.122:0/3637357291 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dec09cfa0 msgr2=0x7f8dec096eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:11.324 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:11.322+0000 7f8df3591640 1 --2- 172.21.15.122:0/3637357291 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dec09cfa0 0x7f8dec096eb0 crc :-1 s=READY pgs=12965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:11.324 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:11.322+0000 7f8df3591640 1 -- 172.21.15.122:0/3637357291 shutdown_connections 2024-09-15T12:41:11.324 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:11.322+0000 7f8df3591640 1 --2- 172.21.15.122:0/3637357291 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f8dd003e930 0x7f8dd0040e40 unknown :-1 s=CLOSED pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:11.325 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:11.322+0000 7f8df3591640 1 --2- 172.21.15.122:0/3637357291 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dec09cfa0 0x7f8dec096eb0 unknown :-1 s=CLOSED pgs=12965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:11.325 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:11.322+0000 7f8df3591640 1 -- 172.21.15.122:0/3637357291 >> 172.21.15.122:0/3637357291 conn(0x7f8dec0a2000 msgr2=0x7f8dec071c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:11.325 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:11.322+0000 7f8df3591640 1 -- 172.21.15.122:0/3637357291 shutdown_connections 2024-09-15T12:41:11.325 INFO:tasks.workunit.client.0.smithi122.stderr:2024-09-15T12:41:11.322+0000 7f8df3591640 1 -- 172.21.15.122:0/3637357291 wait complete. 2024-09-15T12:41:11.335 INFO:tasks.workunit.client.0.smithi122.stdout:OK 2024-09-15T12:41:11.335 INFO:tasks.workunit.client.0.smithi122.stderr:+ echo OK 2024-09-15T12:41:11.336 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-15T12:41:11.336 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-15T12:41:11.401 INFO:tasks.workunit:Stopping ['rados/test.sh --crimson', 'rados/test_pool_quota.sh'] on client.0... 2024-09-15T12:41:11.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-15T12:41:11.719 DEBUG:teuthology.parallel:result is None 2024-09-15T12:41:11.720 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T12:41:11.744 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T12:41:11.745 DEBUG:teuthology.orchestra.run.smithi122:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-15T12:41:11.804 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T12:41:11.805 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-15T12:41:11.814 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T12:41:11.814 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:41:11.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.947+0000 7f4a81311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:11.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.952+0000 7f4a81311640 1 Processor -- start 2024-09-15T12:41:11.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.952+0000 7f4a81311640 1 -- start start 2024-09-15T12:41:11.955 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.953+0000 7f4a81311640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4a7c09ca50 0x7f4a7c09ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:11.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.953+0000 7f4a81311640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a7c0a0060 con 0x7f4a7c09d3a0 2024-09-15T12:41:11.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.953+0000 7f4a81311640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f4a7c09fd30 con 0x7f4a7c09ca50 2024-09-15T12:41:11.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.953+0000 7f4a7affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4a7c09ca50 0x7f4a7c09ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:11.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.953+0000 7f4a7a7fc640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f4a7c09d3a0 0x7f4a7c135ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:46822/0 (socket says 172.21.15.122:46822) 2024-09-15T12:41:11.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.953+0000 7f4a7a7fc640 1 -- 172.21.15.122:0/3980420726 learned_addr learned my addr 172.21.15.122:0/3980420726 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:41:11.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.953+0000 7f4a7affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4a7c09ca50 0x7f4a7c09ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:34832/0 (socket says 172.21.15.122:34832) 2024-09-15T12:41:11.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.953+0000 7f4a7affd640 1 -- 172.21.15.122:0/3980420726 >> v1:172.21.15.122:6789/0 conn(0x7f4a7c09d3a0 legacy=0x7f4a7c135ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:11.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.953+0000 7f4a7affd640 1 -- 172.21.15.122:0/3980420726 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c09e3c0 con 0x7f4a7c09ca50 2024-09-15T12:41:11.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.953+0000 7f4a7affd640 1 --2- 172.21.15.122:0/3980420726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a7c09ca50 0x7f4a7c09ce60 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4dff45422df23 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:11.956 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.953+0000 7f4a79ffb640 1 -- 172.21.15.122:0/3980420726 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4a6c009d80 con 0x7f4a7c09ca50 2024-09-15T12:41:11.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.953+0000 7f4a79ffb640 1 -- 172.21.15.122:0/3980420726 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4a6c00e230 con 0x7f4a7c09ca50 2024-09-15T12:41:11.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.953+0000 7f4a79ffb640 1 -- 172.21.15.122:0/3980420726 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4a6c00e4d0 con 0x7f4a7c09ca50 2024-09-15T12:41:11.957 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.954+0000 7f4a81311640 1 -- 172.21.15.122:0/3980420726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a7c09ca50 msgr2=0x7f4a7c09ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:11.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.954+0000 7f4a81311640 1 --2- 172.21.15.122:0/3980420726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a7c09ca50 0x7f4a7c09ce60 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:11.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.954+0000 7f4a81311640 1 -- 172.21.15.122:0/3980420726 shutdown_connections 2024-09-15T12:41:11.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.954+0000 7f4a81311640 1 --2- 172.21.15.122:0/3980420726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a7c09ca50 0x7f4a7c09ce60 unknown :-1 s=CLOSED pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:11.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.954+0000 7f4a81311640 1 -- 172.21.15.122:0/3980420726 >> 172.21.15.122:0/3980420726 conn(0x7f4a7c0a5230 msgr2=0x7f4a7c0a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:11.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.954+0000 7f4a81311640 1 -- 172.21.15.122:0/3980420726 shutdown_connections 2024-09-15T12:41:11.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.954+0000 7f4a81311640 1 -- 172.21.15.122:0/3980420726 wait complete. 2024-09-15T12:41:11.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.955+0000 7f4a81311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:11.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.956+0000 7f4a81311640 1 Processor -- start 2024-09-15T12:41:11.958 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.956+0000 7f4a81311640 1 -- start start 2024-09-15T12:41:11.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.957+0000 7f4a81311640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a7c09ca50 0x7f4a7c122d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:11.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.957+0000 7f4a81311640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c136da0 con 0x7f4a7c09ca50 2024-09-15T12:41:11.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.957+0000 7f4a7affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a7c09ca50 0x7f4a7c122d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:11.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.957+0000 7f4a7affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a7c09ca50 0x7f4a7c122d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:34834/0 (socket says 172.21.15.122:34834) 2024-09-15T12:41:11.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.957+0000 7f4a7affd640 1 -- 172.21.15.122:0/1952847459 learned_addr learned my addr 172.21.15.122:0/1952847459 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:11.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.957+0000 7f4a7affd640 1 -- 172.21.15.122:0/1952847459 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c126cf0 con 0x7f4a7c09ca50 2024-09-15T12:41:11.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.958+0000 7f4a7affd640 1 --2- 172.21.15.122:0/1952847459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a7c09ca50 0x7f4a7c122d10 crc :-1 s=READY pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:11.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.958+0000 7f4a637fe640 1 -- 172.21.15.122:0/1952847459 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4a6c014540 con 0x7f4a7c09ca50 2024-09-15T12:41:11.960 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.958+0000 7f4a637fe640 1 -- 172.21.15.122:0/1952847459 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4a6c0146a0 con 0x7f4a7c09ca50 2024-09-15T12:41:11.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.958+0000 7f4a81311640 1 -- 172.21.15.122:0/1952847459 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7c136a70 con 0x7f4a7c09ca50 2024-09-15T12:41:11.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.958+0000 7f4a637fe640 1 -- 172.21.15.122:0/1952847459 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4a6c014940 con 0x7f4a7c09ca50 2024-09-15T12:41:11.961 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.958+0000 7f4a81311640 1 -- 172.21.15.122:0/1952847459 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a7c0a3830 con 0x7f4a7c09ca50 2024-09-15T12:41:11.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.959+0000 7f4a637fe640 1 -- 172.21.15.122:0/1952847459 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4a6c014d00 con 0x7f4a7c09ca50 2024-09-15T12:41:11.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.959+0000 7f4a81311640 1 -- 172.21.15.122:0/1952847459 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a7c124fc0 con 0x7f4a7c09ca50 2024-09-15T12:41:11.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.959+0000 7f4a637fe640 1 --2- 172.21.15.122:0/1952847459 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4a6803e930 0x7f4a68040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:11.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.959+0000 7f4a637fe640 1 -- 172.21.15.122:0/1952847459 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(720..720 src has 621..720) ==== 3431+0+0 (crc 0 0 0) 0x7f4a6c019040 con 0x7f4a7c09ca50 2024-09-15T12:41:11.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.959+0000 7f4a7a7fc640 1 --2- 172.21.15.122:0/1952847459 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4a6803e930 0x7f4a68040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:11.962 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.960+0000 7f4a7a7fc640 1 --2- 172.21.15.122:0/1952847459 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4a6803e930 0x7f4a68040e40 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:11.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:11.964+0000 7f4a637fe640 1 -- 172.21.15.122:0/1952847459 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f4a6c012390 con 0x7f4a7c09ca50 2024-09-15T12:41:12.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.134+0000 7f4a81311640 1 -- 172.21.15.122:0/1952847459 --> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a7c0a1fc0 con 0x7f4a6803e930 2024-09-15T12:41:12.139 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.137+0000 7f4a637fe640 1 -- 172.21.15.122:0/1952847459 <== mgr.4100 v2:172.21.15.142:6800/73136857 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109234 (crc 0 0 0) 0x7f4a7c0a1fc0 con 0x7f4a6803e930 2024-09-15T12:41:12.140 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:41:12.140 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-15T12:41:12.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.139+0000 7f4a81311640 1 -- 172.21.15.122:0/1952847459 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4a6803e930 msgr2=0x7f4a68040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:12.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.139+0000 7f4a81311640 1 --2- 172.21.15.122:0/1952847459 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4a6803e930 0x7f4a68040e40 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.139+0000 7f4a81311640 1 -- 172.21.15.122:0/1952847459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a7c09ca50 msgr2=0x7f4a7c122d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:12.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.139+0000 7f4a81311640 1 --2- 172.21.15.122:0/1952847459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a7c09ca50 0x7f4a7c122d10 crc :-1 s=READY pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.139+0000 7f4a81311640 1 -- 172.21.15.122:0/1952847459 shutdown_connections 2024-09-15T12:41:12.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.139+0000 7f4a81311640 1 --2- 172.21.15.122:0/1952847459 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f4a6803e930 0x7f4a68040e40 unknown :-1 s=CLOSED pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.142 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.139+0000 7f4a81311640 1 --2- 172.21.15.122:0/1952847459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a7c09ca50 0x7f4a7c122d10 unknown :-1 s=CLOSED pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.139+0000 7f4a81311640 1 -- 172.21.15.122:0/1952847459 >> 172.21.15.122:0/1952847459 conn(0x7f4a7c0a5230 msgr2=0x7f4a7c0a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:12.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.139+0000 7f4a81311640 1 -- 172.21.15.122:0/1952847459 shutdown_connections 2024-09-15T12:41:12.143 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.139+0000 7f4a81311640 1 -- 172.21.15.122:0/1952847459 wait complete. 2024-09-15T12:41:12.152 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":1280,"stamp":"2024-09-15T12:41:11.182920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":256096,"kb_used_data":7200,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377231264,"statfs":{"total":386547056640,"available":386284814336,"internally_reserved":0,"allocated":7372800,"data_stored":3755246,"data_compressed":354488,"data_compressed_allocated":491520,"data_compressed_original":1761280,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.533556"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.211693+0000","last_change":"2024-09-15T12:27:21.178610+0000","last_active":"2024-09-15T12:40:39.211693+0000","last_peered":"2024-09-15T12:40:39.211693+0000","last_clean":"2024-09-15T12:40:39.211693+0000","last_became_active":"2024-09-15T12:27:21.162458+0000","last_became_peered":"2024-09-15T12:27:21.162458+0000","last_unstale":"2024-09-15T12:40:39.211693+0000","last_undegraded":"2024-09-15T12:40:39.211693+0000","last_fullsized":"2024-09-15T12:40:39.211693+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.217323+0000","last_change":"2024-09-15T12:27:21.213920+0000","last_active":"2024-09-15T12:40:39.217323+0000","last_peered":"2024-09-15T12:40:39.217323+0000","last_clean":"2024-09-15T12:40:39.217323+0000","last_became_active":"2024-09-15T12:27:21.204453+0000","last_became_peered":"2024-09-15T12:27:21.204453+0000","last_unstale":"2024-09-15T12:40:39.217323+0000","last_undegraded":"2024-09-15T12:40:39.217323+0000","last_fullsized":"2024-09-15T12:40:39.217323+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.206716+0000","last_change":"2024-09-15T12:27:21.164996+0000","last_active":"2024-09-15T12:40:39.206716+0000","last_peered":"2024-09-15T12:40:39.206716+0000","last_clean":"2024-09-15T12:40:39.206716+0000","last_became_active":"2024-09-15T12:27:21.155594+0000","last_became_peered":"2024-09-15T12:27:21.155594+0000","last_unstale":"2024-09-15T12:40:39.206716+0000","last_undegraded":"2024-09-15T12:40:39.206716+0000","last_fullsized":"2024-09-15T12:40:39.206716+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.203751+0000","last_change":"2024-09-15T12:27:21.174176+0000","last_active":"2024-09-15T12:40:39.203751+0000","last_peered":"2024-09-15T12:40:39.203751+0000","last_clean":"2024-09-15T12:40:39.203751+0000","last_became_active":"2024-09-15T12:27:21.154114+0000","last_became_peered":"2024-09-15T12:27:21.154114+0000","last_unstale":"2024-09-15T12:40:39.203751+0000","last_undegraded":"2024-09-15T12:40:39.203751+0000","last_fullsized":"2024-09-15T12:40:39.203751+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214753+0000","last_change":"2024-09-15T12:27:21.214859+0000","last_active":"2024-09-15T12:40:39.214753+0000","last_peered":"2024-09-15T12:40:39.214753+0000","last_clean":"2024-09-15T12:40:39.214753+0000","last_became_active":"2024-09-15T12:27:21.208784+0000","last_became_peered":"2024-09-15T12:27:21.208784+0000","last_unstale":"2024-09-15T12:40:39.214753+0000","last_undegraded":"2024-09-15T12:40:39.214753+0000","last_fullsized":"2024-09-15T12:40:39.214753+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.198145+0000","last_change":"2024-09-15T12:27:21.229007+0000","last_active":"2024-09-15T12:40:39.198145+0000","last_peered":"2024-09-15T12:40:39.198145+0000","last_clean":"2024-09-15T12:40:39.198145+0000","last_became_active":"2024-09-15T12:27:21.199501+0000","last_became_peered":"2024-09-15T12:27:21.199501+0000","last_unstale":"2024-09-15T12:40:39.198145+0000","last_undegraded":"2024-09-15T12:40:39.198145+0000","last_fullsized":"2024-09-15T12:40:39.198145+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.208598+0000","last_change":"2024-09-15T12:27:21.226985+0000","last_active":"2024-09-15T12:40:39.208598+0000","last_peered":"2024-09-15T12:40:39.208598+0000","last_clean":"2024-09-15T12:40:39.208598+0000","last_became_active":"2024-09-15T12:27:21.213341+0000","last_became_peered":"2024-09-15T12:27:21.213341+0000","last_unstale":"2024-09-15T12:40:39.208598+0000","last_undegraded":"2024-09-15T12:40:39.208598+0000","last_fullsized":"2024-09-15T12:40:39.208598+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.201604+0000","last_change":"2024-09-15T12:27:21.331475+0000","last_active":"2024-09-15T12:40:39.201604+0000","last_peered":"2024-09-15T12:40:39.201604+0000","last_clean":"2024-09-15T12:40:39.201604+0000","last_became_active":"2024-09-15T12:27:21.314250+0000","last_became_peered":"2024-09-15T12:27:21.314250+0000","last_unstale":"2024-09-15T12:40:39.201604+0000","last_undegraded":"2024-09-15T12:40:39.201604+0000","last_fullsized":"2024-09-15T12:40:39.201604+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.212098+0000","last_change":"2024-09-15T12:27:21.223149+0000","last_active":"2024-09-15T12:40:39.212098+0000","last_peered":"2024-09-15T12:40:39.212098+0000","last_clean":"2024-09-15T12:40:39.212098+0000","last_became_active":"2024-09-15T12:27:21.210467+0000","last_became_peered":"2024-09-15T12:27:21.210467+0000","last_unstale":"2024-09-15T12:40:39.212098+0000","last_undegraded":"2024-09-15T12:40:39.212098+0000","last_fullsized":"2024-09-15T12:40:39.212098+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.204307+0000","last_change":"2024-09-15T12:27:21.198137+0000","last_active":"2024-09-15T12:40:39.204307+0000","last_peered":"2024-09-15T12:40:39.204307+0000","last_clean":"2024-09-15T12:40:39.204307+0000","last_became_active":"2024-09-15T12:27:21.183618+0000","last_became_peered":"2024-09-15T12:27:21.183618+0000","last_unstale":"2024-09-15T12:40:39.204307+0000","last_undegraded":"2024-09-15T12:40:39.204307+0000","last_fullsized":"2024-09-15T12:40:39.204307+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214783+0000","last_change":"2024-09-15T12:27:21.257627+0000","last_active":"2024-09-15T12:40:39.214783+0000","last_peered":"2024-09-15T12:40:39.214783+0000","last_clean":"2024-09-15T12:40:39.214783+0000","last_became_active":"2024-09-15T12:27:21.249285+0000","last_became_peered":"2024-09-15T12:27:21.249285+0000","last_unstale":"2024-09-15T12:40:39.214783+0000","last_undegraded":"2024-09-15T12:40:39.214783+0000","last_fullsized":"2024-09-15T12:40:39.214783+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.213446+0000","last_change":"2024-09-15T12:27:21.283400+0000","last_active":"2024-09-15T12:40:39.213446+0000","last_peered":"2024-09-15T12:40:39.213446+0000","last_clean":"2024-09-15T12:40:39.213446+0000","last_became_active":"2024-09-15T12:27:21.269838+0000","last_became_peered":"2024-09-15T12:27:21.269838+0000","last_unstale":"2024-09-15T12:40:39.213446+0000","last_undegraded":"2024-09-15T12:40:39.213446+0000","last_fullsized":"2024-09-15T12:40:39.213446+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.205889+0000","last_change":"2024-09-15T12:27:21.191351+0000","last_active":"2024-09-15T12:40:39.205889+0000","last_peered":"2024-09-15T12:40:39.205889+0000","last_clean":"2024-09-15T12:40:39.205889+0000","last_became_active":"2024-09-15T12:27:21.178077+0000","last_became_peered":"2024-09-15T12:27:21.178077+0000","last_unstale":"2024-09-15T12:40:39.205889+0000","last_undegraded":"2024-09-15T12:40:39.205889+0000","last_fullsized":"2024-09-15T12:40:39.205889+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.202404+0000","last_change":"2024-09-15T12:27:21.222442+0000","last_active":"2024-09-15T12:40:39.202404+0000","last_peered":"2024-09-15T12:40:39.202404+0000","last_clean":"2024-09-15T12:40:39.202404+0000","last_became_active":"2024-09-15T12:27:21.210134+0000","last_became_peered":"2024-09-15T12:27:21.210134+0000","last_unstale":"2024-09-15T12:40:39.202404+0000","last_undegraded":"2024-09-15T12:40:39.202404+0000","last_fullsized":"2024-09-15T12:40:39.202404+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.199541+0000","last_change":"2024-09-15T12:27:21.224669+0000","last_active":"2024-09-15T12:40:39.199541+0000","last_peered":"2024-09-15T12:40:39.199541+0000","last_clean":"2024-09-15T12:40:39.199541+0000","last_became_active":"2024-09-15T12:27:21.206575+0000","last_became_peered":"2024-09-15T12:27:21.206575+0000","last_unstale":"2024-09-15T12:40:39.199541+0000","last_undegraded":"2024-09-15T12:40:39.199541+0000","last_fullsized":"2024-09-15T12:40:39.199541+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.202979+0000","last_change":"2024-09-15T12:27:21.310077+0000","last_active":"2024-09-15T12:40:39.202979+0000","last_peered":"2024-09-15T12:40:39.202979+0000","last_clean":"2024-09-15T12:40:39.202979+0000","last_became_active":"2024-09-15T12:27:21.301356+0000","last_became_peered":"2024-09-15T12:27:21.301356+0000","last_unstale":"2024-09-15T12:40:39.202979+0000","last_undegraded":"2024-09-15T12:40:39.202979+0000","last_fullsized":"2024-09-15T12:40:39.202979+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214906+0000","last_change":"2024-09-15T12:27:21.274087+0000","last_active":"2024-09-15T12:40:39.214906+0000","last_peered":"2024-09-15T12:40:39.214906+0000","last_clean":"2024-09-15T12:40:39.214906+0000","last_became_active":"2024-09-15T12:27:21.265145+0000","last_became_peered":"2024-09-15T12:27:21.265145+0000","last_unstale":"2024-09-15T12:40:39.214906+0000","last_undegraded":"2024-09-15T12:40:39.214906+0000","last_fullsized":"2024-09-15T12:40:39.214906+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.208851+0000","last_change":"2024-09-15T12:27:21.215295+0000","last_active":"2024-09-15T12:40:39.208851+0000","last_peered":"2024-09-15T12:40:39.208851+0000","last_clean":"2024-09-15T12:40:39.208851+0000","last_became_active":"2024-09-15T12:27:21.195582+0000","last_became_peered":"2024-09-15T12:27:21.195582+0000","last_unstale":"2024-09-15T12:40:39.208851+0000","last_undegraded":"2024-09-15T12:40:39.208851+0000","last_fullsized":"2024-09-15T12:40:39.208851+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.211268+0000","last_change":"2024-09-15T12:27:21.185970+0000","last_active":"2024-09-15T12:40:39.211268+0000","last_peered":"2024-09-15T12:40:39.211268+0000","last_clean":"2024-09-15T12:40:39.211268+0000","last_became_active":"2024-09-15T12:27:21.174023+0000","last_became_peered":"2024-09-15T12:27:21.174023+0000","last_unstale":"2024-09-15T12:40:39.211268+0000","last_undegraded":"2024-09-15T12:40:39.211268+0000","last_fullsized":"2024-09-15T12:40:39.211268+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214589+0000","last_change":"2024-09-15T12:27:21.280402+0000","last_active":"2024-09-15T12:40:39.214589+0000","last_peered":"2024-09-15T12:40:39.214589+0000","last_clean":"2024-09-15T12:40:39.214589+0000","last_became_active":"2024-09-15T12:27:21.265986+0000","last_became_peered":"2024-09-15T12:27:21.265986+0000","last_unstale":"2024-09-15T12:40:39.214589+0000","last_undegraded":"2024-09-15T12:40:39.214589+0000","last_fullsized":"2024-09-15T12:40:39.214589+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.210040+0000","last_change":"2024-09-15T12:27:21.288326+0000","last_active":"2024-09-15T12:40:39.210040+0000","last_peered":"2024-09-15T12:40:39.210040+0000","last_clean":"2024-09-15T12:40:39.210040+0000","last_became_active":"2024-09-15T12:27:21.272862+0000","last_became_peered":"2024-09-15T12:27:21.272862+0000","last_unstale":"2024-09-15T12:40:39.210040+0000","last_undegraded":"2024-09-15T12:40:39.210040+0000","last_fullsized":"2024-09-15T12:40:39.210040+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.203022+0000","last_change":"2024-09-15T12:27:21.186855+0000","last_active":"2024-09-15T12:40:39.203022+0000","last_peered":"2024-09-15T12:40:39.203022+0000","last_clean":"2024-09-15T12:40:39.203022+0000","last_became_active":"2024-09-15T12:27:21.173254+0000","last_became_peered":"2024-09-15T12:27:21.173254+0000","last_unstale":"2024-09-15T12:40:39.203022+0000","last_undegraded":"2024-09-15T12:40:39.203022+0000","last_fullsized":"2024-09-15T12:40:39.203022+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.202973+0000","last_change":"2024-09-15T12:27:21.209103+0000","last_active":"2024-09-15T12:40:39.202973+0000","last_peered":"2024-09-15T12:40:39.202973+0000","last_clean":"2024-09-15T12:40:39.202973+0000","last_became_active":"2024-09-15T12:27:21.202878+0000","last_became_peered":"2024-09-15T12:27:21.202878+0000","last_unstale":"2024-09-15T12:40:39.202973+0000","last_undegraded":"2024-09-15T12:40:39.202973+0000","last_fullsized":"2024-09-15T12:40:39.202973+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.210377+0000","last_change":"2024-09-15T12:27:21.280809+0000","last_active":"2024-09-15T12:40:39.210377+0000","last_peered":"2024-09-15T12:40:39.210377+0000","last_clean":"2024-09-15T12:40:39.210377+0000","last_became_active":"2024-09-15T12:27:21.274273+0000","last_became_peered":"2024-09-15T12:27:21.274273+0000","last_unstale":"2024-09-15T12:40:39.210377+0000","last_undegraded":"2024-09-15T12:40:39.210377+0000","last_fullsized":"2024-09-15T12:40:39.210377+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.211113+0000","last_change":"2024-09-15T12:27:21.242910+0000","last_active":"2024-09-15T12:40:39.211113+0000","last_peered":"2024-09-15T12:40:39.211113+0000","last_clean":"2024-09-15T12:40:39.211113+0000","last_became_active":"2024-09-15T12:27:21.236120+0000","last_became_peered":"2024-09-15T12:27:21.236120+0000","last_unstale":"2024-09-15T12:40:39.211113+0000","last_undegraded":"2024-09-15T12:40:39.211113+0000","last_fullsized":"2024-09-15T12:40:39.211113+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.206000+0000","last_change":"2024-09-15T12:27:21.254314+0000","last_active":"2024-09-15T12:40:39.206000+0000","last_peered":"2024-09-15T12:40:39.206000+0000","last_clean":"2024-09-15T12:40:39.206000+0000","last_became_active":"2024-09-15T12:27:21.241138+0000","last_became_peered":"2024-09-15T12:27:21.241138+0000","last_unstale":"2024-09-15T12:40:39.206000+0000","last_undegraded":"2024-09-15T12:40:39.206000+0000","last_fullsized":"2024-09-15T12:40:39.206000+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214779+0000","last_change":"2024-09-15T12:27:21.251401+0000","last_active":"2024-09-15T12:40:39.214779+0000","last_peered":"2024-09-15T12:40:39.214779+0000","last_clean":"2024-09-15T12:40:39.214779+0000","last_became_active":"2024-09-15T12:27:21.243633+0000","last_became_peered":"2024-09-15T12:27:21.243633+0000","last_unstale":"2024-09-15T12:40:39.214779+0000","last_undegraded":"2024-09-15T12:40:39.214779+0000","last_fullsized":"2024-09-15T12:40:39.214779+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.203793+0000","last_change":"2024-09-15T12:27:21.342117+0000","last_active":"2024-09-15T12:40:39.203793+0000","last_peered":"2024-09-15T12:40:39.203793+0000","last_clean":"2024-09-15T12:40:39.203793+0000","last_became_active":"2024-09-15T12:27:21.335250+0000","last_became_peered":"2024-09-15T12:27:21.335250+0000","last_unstale":"2024-09-15T12:40:39.203793+0000","last_undegraded":"2024-09-15T12:40:39.203793+0000","last_fullsized":"2024-09-15T12:40:39.203793+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.208478+0000","last_change":"2024-09-15T12:27:21.318846+0000","last_active":"2024-09-15T12:40:39.208478+0000","last_peered":"2024-09-15T12:40:39.208478+0000","last_clean":"2024-09-15T12:40:39.208478+0000","last_became_active":"2024-09-15T12:27:21.306255+0000","last_became_peered":"2024-09-15T12:27:21.306255+0000","last_unstale":"2024-09-15T12:40:39.208478+0000","last_undegraded":"2024-09-15T12:40:39.208478+0000","last_fullsized":"2024-09-15T12:40:39.208478+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.200872+0000","last_change":"2024-09-15T12:27:21.254965+0000","last_active":"2024-09-15T12:40:39.200872+0000","last_peered":"2024-09-15T12:40:39.200872+0000","last_clean":"2024-09-15T12:40:39.200872+0000","last_became_active":"2024-09-15T12:27:21.232463+0000","last_became_peered":"2024-09-15T12:27:21.232463+0000","last_unstale":"2024-09-15T12:40:39.200872+0000","last_undegraded":"2024-09-15T12:40:39.200872+0000","last_fullsized":"2024-09-15T12:40:39.200872+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1464,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.212111+0000","last_change":"2024-09-15T12:27:21.188176+0000","last_active":"2024-09-15T12:40:39.212111+0000","last_peered":"2024-09-15T12:40:39.212111+0000","last_clean":"2024-09-15T12:40:39.212111+0000","last_became_active":"2024-09-15T12:27:21.171794+0000","last_became_peered":"2024-09-15T12:27:21.171794+0000","last_unstale":"2024-09-15T12:40:39.212111+0000","last_undegraded":"2024-09-15T12:40:39.212111+0000","last_fullsized":"2024-09-15T12:40:39.212111+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.209817+0000","last_change":"2024-09-15T12:27:21.182150+0000","last_active":"2024-09-15T12:40:39.209817+0000","last_peered":"2024-09-15T12:40:39.209817+0000","last_clean":"2024-09-15T12:40:39.209817+0000","last_became_active":"2024-09-15T12:27:21.169417+0000","last_became_peered":"2024-09-15T12:27:21.169417+0000","last_unstale":"2024-09-15T12:40:39.209817+0000","last_undegraded":"2024-09-15T12:40:39.209817+0000","last_fullsized":"2024-09-15T12:40:39.209817+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.201780+0000","last_change":"2024-09-15T12:22:21.439357+0000","last_active":"2024-09-15T12:40:39.201780+0000","last_peered":"2024-09-15T12:40:39.201780+0000","last_clean":"2024-09-15T12:40:39.201780+0000","last_became_active":"2024-09-15T12:22:19.461505+0000","last_became_peered":"2024-09-15T12:22:19.461505+0000","last_unstale":"2024-09-15T12:40:39.201780+0000","last_undegraded":"2024-09-15T12:40:39.201780+0000","last_fullsized":"2024-09-15T12:40:39.201780+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.203188+0000","last_change":"2024-09-15T12:22:21.437833+0000","last_active":"2024-09-15T12:40:39.203188+0000","last_peered":"2024-09-15T12:40:39.203188+0000","last_clean":"2024-09-15T12:40:39.203188+0000","last_became_active":"2024-09-15T12:22:19.483223+0000","last_became_peered":"2024-09-15T12:22:19.483223+0000","last_unstale":"2024-09-15T12:40:39.203188+0000","last_undegraded":"2024-09-15T12:40:39.203188+0000","last_fullsized":"2024-09-15T12:40:39.203188+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.216732+0000","last_change":"2024-09-15T12:22:21.438624+0000","last_active":"2024-09-15T12:40:39.216732+0000","last_peered":"2024-09-15T12:40:39.216732+0000","last_clean":"2024-09-15T12:40:39.216732+0000","last_became_active":"2024-09-15T12:22:19.461144+0000","last_became_peered":"2024-09-15T12:22:19.461144+0000","last_unstale":"2024-09-15T12:40:39.216732+0000","last_undegraded":"2024-09-15T12:40:39.216732+0000","last_fullsized":"2024-09-15T12:40:39.216732+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.198958+0000","last_change":"2024-09-15T12:22:21.436163+0000","last_active":"2024-09-15T12:40:39.198958+0000","last_peered":"2024-09-15T12:40:39.198958+0000","last_clean":"2024-09-15T12:40:39.198958+0000","last_became_active":"2024-09-15T12:22:19.461497+0000","last_became_peered":"2024-09-15T12:22:19.461497+0000","last_unstale":"2024-09-15T12:40:39.198958+0000","last_undegraded":"2024-09-15T12:40:39.198958+0000","last_fullsized":"2024-09-15T12:40:39.198958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2126,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.208144+0000","last_change":"2024-09-15T12:22:21.438691+0000","last_active":"2024-09-15T12:40:39.208144+0000","last_peered":"2024-09-15T12:40:39.208144+0000","last_clean":"2024-09-15T12:40:39.208144+0000","last_became_active":"2024-09-15T12:22:19.461584+0000","last_became_peered":"2024-09-15T12:22:19.461584+0000","last_unstale":"2024-09-15T12:40:39.208144+0000","last_undegraded":"2024-09-15T12:40:39.208144+0000","last_fullsized":"2024-09-15T12:40:39.208144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.204082+0000","last_change":"2024-09-15T12:22:21.438817+0000","last_active":"2024-09-15T12:40:39.204082+0000","last_peered":"2024-09-15T12:40:39.204082+0000","last_clean":"2024-09-15T12:40:39.204082+0000","last_became_active":"2024-09-15T12:22:19.466495+0000","last_became_peered":"2024-09-15T12:22:19.466495+0000","last_unstale":"2024-09-15T12:40:39.204082+0000","last_undegraded":"2024-09-15T12:40:39.204082+0000","last_fullsized":"2024-09-15T12:40:39.204082+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.207286+0000","last_change":"2024-09-15T12:22:21.438734+0000","last_active":"2024-09-15T12:40:39.207286+0000","last_peered":"2024-09-15T12:40:39.207286+0000","last_clean":"2024-09-15T12:40:39.207286+0000","last_became_active":"2024-09-15T12:22:19.475039+0000","last_became_peered":"2024-09-15T12:22:19.475039+0000","last_unstale":"2024-09-15T12:40:39.207286+0000","last_undegraded":"2024-09-15T12:40:39.207286+0000","last_fullsized":"2024-09-15T12:40:39.207286+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2125,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.210638+0000","last_change":"2024-09-15T12:22:21.441279+0000","last_active":"2024-09-15T12:40:39.210638+0000","last_peered":"2024-09-15T12:40:39.210638+0000","last_clean":"2024-09-15T12:40:39.210638+0000","last_became_active":"2024-09-15T12:22:19.485089+0000","last_became_peered":"2024-09-15T12:22:19.485089+0000","last_unstale":"2024-09-15T12:40:39.210638+0000","last_undegraded":"2024-09-15T12:40:39.210638+0000","last_fullsized":"2024-09-15T12:40:39.210638+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2193,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.200139+0000","last_change":"2024-09-15T12:22:18.465473+0000","last_active":"2024-09-15T12:40:39.200139+0000","last_peered":"2024-09-15T12:40:39.200139+0000","last_clean":"2024-09-15T12:40:39.200139+0000","last_became_active":"2024-09-15T12:22:18.457094+0000","last_became_peered":"2024-09-15T12:22:18.457094+0000","last_unstale":"2024-09-15T12:40:39.200139+0000","last_undegraded":"2024-09-15T12:40:39.200139+0000","last_fullsized":"2024-09-15T12:40:39.200139+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:17.395744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:17.395744+0000","last_clean_scrub_stamp":"2024-09-15T12:22:17.395744+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949674069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63352,"kb_used_data":1832,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94308488,"statfs":{"total":96636764160,"available":96571891712,"internally_reserved":0,"allocated":1875968,"data_stored":1240421,"data_compressed":106588,"data_compressed_allocated":147456,"data_compressed_original":733184,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59128,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94312712,"statfs":{"total":96636764160,"available":96576217088,"internally_reserved":0,"allocated":1810432,"data_stored":637202,"data_compressed":70656,"data_compressed_allocated":98304,"data_compressed_original":147456,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64680,"kb_used_data":1752,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94307160,"statfs":{"total":96636764160,"available":96570531840,"internally_reserved":0,"allocated":1794048,"data_stored":624308,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706772,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68936,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302904,"statfs":{"total":96636764160,"available":96566173696,"internally_reserved":0,"allocated":1892352,"data_stored":1253315,"data_compressed":112476,"data_compressed_allocated":155648,"data_compressed_original":745472,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:41:12.154 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:41:12.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.256+0000 7faaf6f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:12.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.262+0000 7faaf6f51640 1 Processor -- start 2024-09-15T12:41:12.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.262+0000 7faaf6f51640 1 -- start start 2024-09-15T12:41:12.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.263+0000 7faaf6f51640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7faaf00a0590 0x7faaf013b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:12.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.263+0000 7faaf6f51640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaf006f3a0 con 0x7faaf009fa70 2024-09-15T12:41:12.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.263+0000 7faaf6f51640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7faaf0074c20 con 0x7faaf00a0590 2024-09-15T12:41:12.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.264+0000 7faaf4ced640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7faaf009fa70 0x7faaf009fe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:46830/0 (socket says 172.21.15.122:46830) 2024-09-15T12:41:12.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.264+0000 7faaf4ced640 1 -- 172.21.15.122:0/4023105384 learned_addr learned my addr 172.21.15.122:0/4023105384 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:41:12.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.264+0000 7faae7fff640 1 --2- 172.21.15.122:0/4023105384 >> v2:172.21.15.122:3300/0 conn(0x7faaf00a0590 0x7faaf013b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:12.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.264+0000 7faae7fff640 1 -- 172.21.15.122:0/4023105384 >> v1:172.21.15.122:6789/0 conn(0x7faaf009fa70 legacy=0x7faaf009fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:12.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.264+0000 7faae7fff640 1 -- 172.21.15.122:0/4023105384 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf006f5d0 con 0x7faaf00a0590 2024-09-15T12:41:12.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.264+0000 7faae7fff640 1 --2- 172.21.15.122:0/4023105384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faaf00a0590 0x7faaf013b210 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c395be3229b6fdf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:12.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.264+0000 7faae77fe640 1 -- 172.21.15.122:0/4023105384 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faae0009d80 con 0x7faaf00a0590 2024-09-15T12:41:12.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.264+0000 7faae77fe640 1 -- 172.21.15.122:0/4023105384 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7faae000e230 con 0x7faaf00a0590 2024-09-15T12:41:12.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.264+0000 7faae77fe640 1 -- 172.21.15.122:0/4023105384 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faae000e4d0 con 0x7faaf00a0590 2024-09-15T12:41:12.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.265+0000 7faaf6f51640 1 -- 172.21.15.122:0/4023105384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faaf00a0590 msgr2=0x7faaf013b210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:12.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.265+0000 7faaf6f51640 1 --2- 172.21.15.122:0/4023105384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faaf00a0590 0x7faaf013b210 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.265+0000 7faaf6f51640 1 -- 172.21.15.122:0/4023105384 shutdown_connections 2024-09-15T12:41:12.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.265+0000 7faaf6f51640 1 --2- 172.21.15.122:0/4023105384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faaf00a0590 0x7faaf013b210 unknown :-1 s=CLOSED pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.265+0000 7faaf6f51640 1 -- 172.21.15.122:0/4023105384 >> 172.21.15.122:0/4023105384 conn(0x7faaf00a33b0 msgr2=0x7faaf00a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:12.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.265+0000 7faaf6f51640 1 -- 172.21.15.122:0/4023105384 shutdown_connections 2024-09-15T12:41:12.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.265+0000 7faaf6f51640 1 -- 172.21.15.122:0/4023105384 wait complete. 2024-09-15T12:41:12.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.265+0000 7faaf6f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:12.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.266+0000 7faaf6f51640 1 Processor -- start 2024-09-15T12:41:12.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.267+0000 7faaf6f51640 1 -- start start 2024-09-15T12:41:12.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.268+0000 7faaf6f51640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faaf009fa70 0x7faaf01ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:12.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.268+0000 7faaf6f51640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faaf0124990 con 0x7faaf009fa70 2024-09-15T12:41:12.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.268+0000 7faaf4ced640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faaf009fa70 0x7faaf01ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:12.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.268+0000 7faaf4ced640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faaf009fa70 0x7faaf01ca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:34860/0 (socket says 172.21.15.122:34860) 2024-09-15T12:41:12.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.268+0000 7faaf4ced640 1 -- 172.21.15.122:0/1219369235 learned_addr learned my addr 172.21.15.122:0/1219369235 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:12.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.268+0000 7faaf4ced640 1 -- 172.21.15.122:0/1219369235 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf0120d70 con 0x7faaf009fa70 2024-09-15T12:41:12.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.268+0000 7faaf4ced640 1 --2- 172.21.15.122:0/1219369235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faaf009fa70 0x7faaf01ca860 crc :-1 s=READY pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:12.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.268+0000 7faae57fa640 1 -- 172.21.15.122:0/1219369235 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faaec005a60 con 0x7faaf009fa70 2024-09-15T12:41:12.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.268+0000 7faae57fa640 1 -- 172.21.15.122:0/1219369235 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7faaec005bc0 con 0x7faaf009fa70 2024-09-15T12:41:12.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.268+0000 7faaf6f51640 1 -- 172.21.15.122:0/1219369235 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf0122410 con 0x7faaf009fa70 2024-09-15T12:41:12.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.268+0000 7faae57fa640 1 -- 172.21.15.122:0/1219369235 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faaec005e60 con 0x7faaf009fa70 2024-09-15T12:41:12.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.268+0000 7faaf6f51640 1 -- 172.21.15.122:0/1219369235 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf0120a60 con 0x7faaf009fa70 2024-09-15T12:41:12.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.269+0000 7faaf6f51640 1 -- 172.21.15.122:0/1219369235 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf009fe80 con 0x7faaf009fa70 2024-09-15T12:41:12.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.269+0000 7faae57fa640 1 -- 172.21.15.122:0/1219369235 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7faaec0070b0 con 0x7faaf009fa70 2024-09-15T12:41:12.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.270+0000 7faae57fa640 1 --2- 172.21.15.122:0/1219369235 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7faadc03e930 0x7faadc040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:12.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.270+0000 7faae57fa640 1 -- 172.21.15.122:0/1219369235 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(720..720 src has 621..720) ==== 3431+0+0 (crc 0 0 0) 0x7faaec04f890 con 0x7faaf009fa70 2024-09-15T12:41:12.272 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.270+0000 7faae7fff640 1 --2- 172.21.15.122:0/1219369235 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7faadc03e930 0x7faadc040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:12.273 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.271+0000 7faae7fff640 1 --2- 172.21.15.122:0/1219369235 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7faadc03e930 0x7faadc040e40 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:12.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.275+0000 7faae57fa640 1 -- 172.21.15.122:0/1219369235 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7faaec00dc10 con 0x7faaf009fa70 2024-09-15T12:41:12.450 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.448+0000 7faaf6f51640 1 -- 172.21.15.122:0/1219369235 --> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faaf00a4130 con 0x7faadc03e930 2024-09-15T12:41:12.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.450+0000 7faae57fa640 1 -- 172.21.15.122:0/1219369235 <== mgr.4100 v2:172.21.15.142:6800/73136857 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109234 (crc 0 0 0) 0x7faae0009da0 con 0x7faadc03e930 2024-09-15T12:41:12.454 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:41:12.454 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-15T12:41:12.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.453+0000 7faaf6f51640 1 -- 172.21.15.122:0/1219369235 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7faadc03e930 msgr2=0x7faadc040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:12.455 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.453+0000 7faaf6f51640 1 --2- 172.21.15.122:0/1219369235 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7faadc03e930 0x7faadc040e40 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.453+0000 7faaf6f51640 1 -- 172.21.15.122:0/1219369235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faaf009fa70 msgr2=0x7faaf01ca860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:12.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.453+0000 7faaf6f51640 1 --2- 172.21.15.122:0/1219369235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faaf009fa70 0x7faaf01ca860 crc :-1 s=READY pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.453+0000 7faaf6f51640 1 -- 172.21.15.122:0/1219369235 shutdown_connections 2024-09-15T12:41:12.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.453+0000 7faaf6f51640 1 --2- 172.21.15.122:0/1219369235 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7faadc03e930 0x7faadc040e40 unknown :-1 s=CLOSED pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.453+0000 7faaf6f51640 1 --2- 172.21.15.122:0/1219369235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faaf009fa70 0x7faaf01ca860 unknown :-1 s=CLOSED pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.453+0000 7faaf6f51640 1 -- 172.21.15.122:0/1219369235 >> 172.21.15.122:0/1219369235 conn(0x7faaf00a33b0 msgr2=0x7faaf009e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:12.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.453+0000 7faaf6f51640 1 -- 172.21.15.122:0/1219369235 shutdown_connections 2024-09-15T12:41:12.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.453+0000 7faaf6f51640 1 -- 172.21.15.122:0/1219369235 wait complete. 2024-09-15T12:41:12.466 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":1280,"stamp":"2024-09-15T12:41:11.182920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":256096,"kb_used_data":7200,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377231264,"statfs":{"total":386547056640,"available":386284814336,"internally_reserved":0,"allocated":7372800,"data_stored":3755246,"data_compressed":354488,"data_compressed_allocated":491520,"data_compressed_original":1761280,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.533556"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.211693+0000","last_change":"2024-09-15T12:27:21.178610+0000","last_active":"2024-09-15T12:40:39.211693+0000","last_peered":"2024-09-15T12:40:39.211693+0000","last_clean":"2024-09-15T12:40:39.211693+0000","last_became_active":"2024-09-15T12:27:21.162458+0000","last_became_peered":"2024-09-15T12:27:21.162458+0000","last_unstale":"2024-09-15T12:40:39.211693+0000","last_undegraded":"2024-09-15T12:40:39.211693+0000","last_fullsized":"2024-09-15T12:40:39.211693+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.217323+0000","last_change":"2024-09-15T12:27:21.213920+0000","last_active":"2024-09-15T12:40:39.217323+0000","last_peered":"2024-09-15T12:40:39.217323+0000","last_clean":"2024-09-15T12:40:39.217323+0000","last_became_active":"2024-09-15T12:27:21.204453+0000","last_became_peered":"2024-09-15T12:27:21.204453+0000","last_unstale":"2024-09-15T12:40:39.217323+0000","last_undegraded":"2024-09-15T12:40:39.217323+0000","last_fullsized":"2024-09-15T12:40:39.217323+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.206716+0000","last_change":"2024-09-15T12:27:21.164996+0000","last_active":"2024-09-15T12:40:39.206716+0000","last_peered":"2024-09-15T12:40:39.206716+0000","last_clean":"2024-09-15T12:40:39.206716+0000","last_became_active":"2024-09-15T12:27:21.155594+0000","last_became_peered":"2024-09-15T12:27:21.155594+0000","last_unstale":"2024-09-15T12:40:39.206716+0000","last_undegraded":"2024-09-15T12:40:39.206716+0000","last_fullsized":"2024-09-15T12:40:39.206716+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.203751+0000","last_change":"2024-09-15T12:27:21.174176+0000","last_active":"2024-09-15T12:40:39.203751+0000","last_peered":"2024-09-15T12:40:39.203751+0000","last_clean":"2024-09-15T12:40:39.203751+0000","last_became_active":"2024-09-15T12:27:21.154114+0000","last_became_peered":"2024-09-15T12:27:21.154114+0000","last_unstale":"2024-09-15T12:40:39.203751+0000","last_undegraded":"2024-09-15T12:40:39.203751+0000","last_fullsized":"2024-09-15T12:40:39.203751+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214753+0000","last_change":"2024-09-15T12:27:21.214859+0000","last_active":"2024-09-15T12:40:39.214753+0000","last_peered":"2024-09-15T12:40:39.214753+0000","last_clean":"2024-09-15T12:40:39.214753+0000","last_became_active":"2024-09-15T12:27:21.208784+0000","last_became_peered":"2024-09-15T12:27:21.208784+0000","last_unstale":"2024-09-15T12:40:39.214753+0000","last_undegraded":"2024-09-15T12:40:39.214753+0000","last_fullsized":"2024-09-15T12:40:39.214753+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.198145+0000","last_change":"2024-09-15T12:27:21.229007+0000","last_active":"2024-09-15T12:40:39.198145+0000","last_peered":"2024-09-15T12:40:39.198145+0000","last_clean":"2024-09-15T12:40:39.198145+0000","last_became_active":"2024-09-15T12:27:21.199501+0000","last_became_peered":"2024-09-15T12:27:21.199501+0000","last_unstale":"2024-09-15T12:40:39.198145+0000","last_undegraded":"2024-09-15T12:40:39.198145+0000","last_fullsized":"2024-09-15T12:40:39.198145+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.208598+0000","last_change":"2024-09-15T12:27:21.226985+0000","last_active":"2024-09-15T12:40:39.208598+0000","last_peered":"2024-09-15T12:40:39.208598+0000","last_clean":"2024-09-15T12:40:39.208598+0000","last_became_active":"2024-09-15T12:27:21.213341+0000","last_became_peered":"2024-09-15T12:27:21.213341+0000","last_unstale":"2024-09-15T12:40:39.208598+0000","last_undegraded":"2024-09-15T12:40:39.208598+0000","last_fullsized":"2024-09-15T12:40:39.208598+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.201604+0000","last_change":"2024-09-15T12:27:21.331475+0000","last_active":"2024-09-15T12:40:39.201604+0000","last_peered":"2024-09-15T12:40:39.201604+0000","last_clean":"2024-09-15T12:40:39.201604+0000","last_became_active":"2024-09-15T12:27:21.314250+0000","last_became_peered":"2024-09-15T12:27:21.314250+0000","last_unstale":"2024-09-15T12:40:39.201604+0000","last_undegraded":"2024-09-15T12:40:39.201604+0000","last_fullsized":"2024-09-15T12:40:39.201604+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.212098+0000","last_change":"2024-09-15T12:27:21.223149+0000","last_active":"2024-09-15T12:40:39.212098+0000","last_peered":"2024-09-15T12:40:39.212098+0000","last_clean":"2024-09-15T12:40:39.212098+0000","last_became_active":"2024-09-15T12:27:21.210467+0000","last_became_peered":"2024-09-15T12:27:21.210467+0000","last_unstale":"2024-09-15T12:40:39.212098+0000","last_undegraded":"2024-09-15T12:40:39.212098+0000","last_fullsized":"2024-09-15T12:40:39.212098+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.204307+0000","last_change":"2024-09-15T12:27:21.198137+0000","last_active":"2024-09-15T12:40:39.204307+0000","last_peered":"2024-09-15T12:40:39.204307+0000","last_clean":"2024-09-15T12:40:39.204307+0000","last_became_active":"2024-09-15T12:27:21.183618+0000","last_became_peered":"2024-09-15T12:27:21.183618+0000","last_unstale":"2024-09-15T12:40:39.204307+0000","last_undegraded":"2024-09-15T12:40:39.204307+0000","last_fullsized":"2024-09-15T12:40:39.204307+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214783+0000","last_change":"2024-09-15T12:27:21.257627+0000","last_active":"2024-09-15T12:40:39.214783+0000","last_peered":"2024-09-15T12:40:39.214783+0000","last_clean":"2024-09-15T12:40:39.214783+0000","last_became_active":"2024-09-15T12:27:21.249285+0000","last_became_peered":"2024-09-15T12:27:21.249285+0000","last_unstale":"2024-09-15T12:40:39.214783+0000","last_undegraded":"2024-09-15T12:40:39.214783+0000","last_fullsized":"2024-09-15T12:40:39.214783+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.213446+0000","last_change":"2024-09-15T12:27:21.283400+0000","last_active":"2024-09-15T12:40:39.213446+0000","last_peered":"2024-09-15T12:40:39.213446+0000","last_clean":"2024-09-15T12:40:39.213446+0000","last_became_active":"2024-09-15T12:27:21.269838+0000","last_became_peered":"2024-09-15T12:27:21.269838+0000","last_unstale":"2024-09-15T12:40:39.213446+0000","last_undegraded":"2024-09-15T12:40:39.213446+0000","last_fullsized":"2024-09-15T12:40:39.213446+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.205889+0000","last_change":"2024-09-15T12:27:21.191351+0000","last_active":"2024-09-15T12:40:39.205889+0000","last_peered":"2024-09-15T12:40:39.205889+0000","last_clean":"2024-09-15T12:40:39.205889+0000","last_became_active":"2024-09-15T12:27:21.178077+0000","last_became_peered":"2024-09-15T12:27:21.178077+0000","last_unstale":"2024-09-15T12:40:39.205889+0000","last_undegraded":"2024-09-15T12:40:39.205889+0000","last_fullsized":"2024-09-15T12:40:39.205889+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.202404+0000","last_change":"2024-09-15T12:27:21.222442+0000","last_active":"2024-09-15T12:40:39.202404+0000","last_peered":"2024-09-15T12:40:39.202404+0000","last_clean":"2024-09-15T12:40:39.202404+0000","last_became_active":"2024-09-15T12:27:21.210134+0000","last_became_peered":"2024-09-15T12:27:21.210134+0000","last_unstale":"2024-09-15T12:40:39.202404+0000","last_undegraded":"2024-09-15T12:40:39.202404+0000","last_fullsized":"2024-09-15T12:40:39.202404+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.199541+0000","last_change":"2024-09-15T12:27:21.224669+0000","last_active":"2024-09-15T12:40:39.199541+0000","last_peered":"2024-09-15T12:40:39.199541+0000","last_clean":"2024-09-15T12:40:39.199541+0000","last_became_active":"2024-09-15T12:27:21.206575+0000","last_became_peered":"2024-09-15T12:27:21.206575+0000","last_unstale":"2024-09-15T12:40:39.199541+0000","last_undegraded":"2024-09-15T12:40:39.199541+0000","last_fullsized":"2024-09-15T12:40:39.199541+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.202979+0000","last_change":"2024-09-15T12:27:21.310077+0000","last_active":"2024-09-15T12:40:39.202979+0000","last_peered":"2024-09-15T12:40:39.202979+0000","last_clean":"2024-09-15T12:40:39.202979+0000","last_became_active":"2024-09-15T12:27:21.301356+0000","last_became_peered":"2024-09-15T12:27:21.301356+0000","last_unstale":"2024-09-15T12:40:39.202979+0000","last_undegraded":"2024-09-15T12:40:39.202979+0000","last_fullsized":"2024-09-15T12:40:39.202979+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214906+0000","last_change":"2024-09-15T12:27:21.274087+0000","last_active":"2024-09-15T12:40:39.214906+0000","last_peered":"2024-09-15T12:40:39.214906+0000","last_clean":"2024-09-15T12:40:39.214906+0000","last_became_active":"2024-09-15T12:27:21.265145+0000","last_became_peered":"2024-09-15T12:27:21.265145+0000","last_unstale":"2024-09-15T12:40:39.214906+0000","last_undegraded":"2024-09-15T12:40:39.214906+0000","last_fullsized":"2024-09-15T12:40:39.214906+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.208851+0000","last_change":"2024-09-15T12:27:21.215295+0000","last_active":"2024-09-15T12:40:39.208851+0000","last_peered":"2024-09-15T12:40:39.208851+0000","last_clean":"2024-09-15T12:40:39.208851+0000","last_became_active":"2024-09-15T12:27:21.195582+0000","last_became_peered":"2024-09-15T12:27:21.195582+0000","last_unstale":"2024-09-15T12:40:39.208851+0000","last_undegraded":"2024-09-15T12:40:39.208851+0000","last_fullsized":"2024-09-15T12:40:39.208851+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.211268+0000","last_change":"2024-09-15T12:27:21.185970+0000","last_active":"2024-09-15T12:40:39.211268+0000","last_peered":"2024-09-15T12:40:39.211268+0000","last_clean":"2024-09-15T12:40:39.211268+0000","last_became_active":"2024-09-15T12:27:21.174023+0000","last_became_peered":"2024-09-15T12:27:21.174023+0000","last_unstale":"2024-09-15T12:40:39.211268+0000","last_undegraded":"2024-09-15T12:40:39.211268+0000","last_fullsized":"2024-09-15T12:40:39.211268+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214589+0000","last_change":"2024-09-15T12:27:21.280402+0000","last_active":"2024-09-15T12:40:39.214589+0000","last_peered":"2024-09-15T12:40:39.214589+0000","last_clean":"2024-09-15T12:40:39.214589+0000","last_became_active":"2024-09-15T12:27:21.265986+0000","last_became_peered":"2024-09-15T12:27:21.265986+0000","last_unstale":"2024-09-15T12:40:39.214589+0000","last_undegraded":"2024-09-15T12:40:39.214589+0000","last_fullsized":"2024-09-15T12:40:39.214589+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.210040+0000","last_change":"2024-09-15T12:27:21.288326+0000","last_active":"2024-09-15T12:40:39.210040+0000","last_peered":"2024-09-15T12:40:39.210040+0000","last_clean":"2024-09-15T12:40:39.210040+0000","last_became_active":"2024-09-15T12:27:21.272862+0000","last_became_peered":"2024-09-15T12:27:21.272862+0000","last_unstale":"2024-09-15T12:40:39.210040+0000","last_undegraded":"2024-09-15T12:40:39.210040+0000","last_fullsized":"2024-09-15T12:40:39.210040+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.203022+0000","last_change":"2024-09-15T12:27:21.186855+0000","last_active":"2024-09-15T12:40:39.203022+0000","last_peered":"2024-09-15T12:40:39.203022+0000","last_clean":"2024-09-15T12:40:39.203022+0000","last_became_active":"2024-09-15T12:27:21.173254+0000","last_became_peered":"2024-09-15T12:27:21.173254+0000","last_unstale":"2024-09-15T12:40:39.203022+0000","last_undegraded":"2024-09-15T12:40:39.203022+0000","last_fullsized":"2024-09-15T12:40:39.203022+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.202973+0000","last_change":"2024-09-15T12:27:21.209103+0000","last_active":"2024-09-15T12:40:39.202973+0000","last_peered":"2024-09-15T12:40:39.202973+0000","last_clean":"2024-09-15T12:40:39.202973+0000","last_became_active":"2024-09-15T12:27:21.202878+0000","last_became_peered":"2024-09-15T12:27:21.202878+0000","last_unstale":"2024-09-15T12:40:39.202973+0000","last_undegraded":"2024-09-15T12:40:39.202973+0000","last_fullsized":"2024-09-15T12:40:39.202973+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.210377+0000","last_change":"2024-09-15T12:27:21.280809+0000","last_active":"2024-09-15T12:40:39.210377+0000","last_peered":"2024-09-15T12:40:39.210377+0000","last_clean":"2024-09-15T12:40:39.210377+0000","last_became_active":"2024-09-15T12:27:21.274273+0000","last_became_peered":"2024-09-15T12:27:21.274273+0000","last_unstale":"2024-09-15T12:40:39.210377+0000","last_undegraded":"2024-09-15T12:40:39.210377+0000","last_fullsized":"2024-09-15T12:40:39.210377+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.211113+0000","last_change":"2024-09-15T12:27:21.242910+0000","last_active":"2024-09-15T12:40:39.211113+0000","last_peered":"2024-09-15T12:40:39.211113+0000","last_clean":"2024-09-15T12:40:39.211113+0000","last_became_active":"2024-09-15T12:27:21.236120+0000","last_became_peered":"2024-09-15T12:27:21.236120+0000","last_unstale":"2024-09-15T12:40:39.211113+0000","last_undegraded":"2024-09-15T12:40:39.211113+0000","last_fullsized":"2024-09-15T12:40:39.211113+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.206000+0000","last_change":"2024-09-15T12:27:21.254314+0000","last_active":"2024-09-15T12:40:39.206000+0000","last_peered":"2024-09-15T12:40:39.206000+0000","last_clean":"2024-09-15T12:40:39.206000+0000","last_became_active":"2024-09-15T12:27:21.241138+0000","last_became_peered":"2024-09-15T12:27:21.241138+0000","last_unstale":"2024-09-15T12:40:39.206000+0000","last_undegraded":"2024-09-15T12:40:39.206000+0000","last_fullsized":"2024-09-15T12:40:39.206000+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214779+0000","last_change":"2024-09-15T12:27:21.251401+0000","last_active":"2024-09-15T12:40:39.214779+0000","last_peered":"2024-09-15T12:40:39.214779+0000","last_clean":"2024-09-15T12:40:39.214779+0000","last_became_active":"2024-09-15T12:27:21.243633+0000","last_became_peered":"2024-09-15T12:27:21.243633+0000","last_unstale":"2024-09-15T12:40:39.214779+0000","last_undegraded":"2024-09-15T12:40:39.214779+0000","last_fullsized":"2024-09-15T12:40:39.214779+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.203793+0000","last_change":"2024-09-15T12:27:21.342117+0000","last_active":"2024-09-15T12:40:39.203793+0000","last_peered":"2024-09-15T12:40:39.203793+0000","last_clean":"2024-09-15T12:40:39.203793+0000","last_became_active":"2024-09-15T12:27:21.335250+0000","last_became_peered":"2024-09-15T12:27:21.335250+0000","last_unstale":"2024-09-15T12:40:39.203793+0000","last_undegraded":"2024-09-15T12:40:39.203793+0000","last_fullsized":"2024-09-15T12:40:39.203793+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.208478+0000","last_change":"2024-09-15T12:27:21.318846+0000","last_active":"2024-09-15T12:40:39.208478+0000","last_peered":"2024-09-15T12:40:39.208478+0000","last_clean":"2024-09-15T12:40:39.208478+0000","last_became_active":"2024-09-15T12:27:21.306255+0000","last_became_peered":"2024-09-15T12:27:21.306255+0000","last_unstale":"2024-09-15T12:40:39.208478+0000","last_undegraded":"2024-09-15T12:40:39.208478+0000","last_fullsized":"2024-09-15T12:40:39.208478+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.200872+0000","last_change":"2024-09-15T12:27:21.254965+0000","last_active":"2024-09-15T12:40:39.200872+0000","last_peered":"2024-09-15T12:40:39.200872+0000","last_clean":"2024-09-15T12:40:39.200872+0000","last_became_active":"2024-09-15T12:27:21.232463+0000","last_became_peered":"2024-09-15T12:27:21.232463+0000","last_unstale":"2024-09-15T12:40:39.200872+0000","last_undegraded":"2024-09-15T12:40:39.200872+0000","last_fullsized":"2024-09-15T12:40:39.200872+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1464,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.212111+0000","last_change":"2024-09-15T12:27:21.188176+0000","last_active":"2024-09-15T12:40:39.212111+0000","last_peered":"2024-09-15T12:40:39.212111+0000","last_clean":"2024-09-15T12:40:39.212111+0000","last_became_active":"2024-09-15T12:27:21.171794+0000","last_became_peered":"2024-09-15T12:27:21.171794+0000","last_unstale":"2024-09-15T12:40:39.212111+0000","last_undegraded":"2024-09-15T12:40:39.212111+0000","last_fullsized":"2024-09-15T12:40:39.212111+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.209817+0000","last_change":"2024-09-15T12:27:21.182150+0000","last_active":"2024-09-15T12:40:39.209817+0000","last_peered":"2024-09-15T12:40:39.209817+0000","last_clean":"2024-09-15T12:40:39.209817+0000","last_became_active":"2024-09-15T12:27:21.169417+0000","last_became_peered":"2024-09-15T12:27:21.169417+0000","last_unstale":"2024-09-15T12:40:39.209817+0000","last_undegraded":"2024-09-15T12:40:39.209817+0000","last_fullsized":"2024-09-15T12:40:39.209817+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.201780+0000","last_change":"2024-09-15T12:22:21.439357+0000","last_active":"2024-09-15T12:40:39.201780+0000","last_peered":"2024-09-15T12:40:39.201780+0000","last_clean":"2024-09-15T12:40:39.201780+0000","last_became_active":"2024-09-15T12:22:19.461505+0000","last_became_peered":"2024-09-15T12:22:19.461505+0000","last_unstale":"2024-09-15T12:40:39.201780+0000","last_undegraded":"2024-09-15T12:40:39.201780+0000","last_fullsized":"2024-09-15T12:40:39.201780+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.203188+0000","last_change":"2024-09-15T12:22:21.437833+0000","last_active":"2024-09-15T12:40:39.203188+0000","last_peered":"2024-09-15T12:40:39.203188+0000","last_clean":"2024-09-15T12:40:39.203188+0000","last_became_active":"2024-09-15T12:22:19.483223+0000","last_became_peered":"2024-09-15T12:22:19.483223+0000","last_unstale":"2024-09-15T12:40:39.203188+0000","last_undegraded":"2024-09-15T12:40:39.203188+0000","last_fullsized":"2024-09-15T12:40:39.203188+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.216732+0000","last_change":"2024-09-15T12:22:21.438624+0000","last_active":"2024-09-15T12:40:39.216732+0000","last_peered":"2024-09-15T12:40:39.216732+0000","last_clean":"2024-09-15T12:40:39.216732+0000","last_became_active":"2024-09-15T12:22:19.461144+0000","last_became_peered":"2024-09-15T12:22:19.461144+0000","last_unstale":"2024-09-15T12:40:39.216732+0000","last_undegraded":"2024-09-15T12:40:39.216732+0000","last_fullsized":"2024-09-15T12:40:39.216732+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.198958+0000","last_change":"2024-09-15T12:22:21.436163+0000","last_active":"2024-09-15T12:40:39.198958+0000","last_peered":"2024-09-15T12:40:39.198958+0000","last_clean":"2024-09-15T12:40:39.198958+0000","last_became_active":"2024-09-15T12:22:19.461497+0000","last_became_peered":"2024-09-15T12:22:19.461497+0000","last_unstale":"2024-09-15T12:40:39.198958+0000","last_undegraded":"2024-09-15T12:40:39.198958+0000","last_fullsized":"2024-09-15T12:40:39.198958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2126,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.208144+0000","last_change":"2024-09-15T12:22:21.438691+0000","last_active":"2024-09-15T12:40:39.208144+0000","last_peered":"2024-09-15T12:40:39.208144+0000","last_clean":"2024-09-15T12:40:39.208144+0000","last_became_active":"2024-09-15T12:22:19.461584+0000","last_became_peered":"2024-09-15T12:22:19.461584+0000","last_unstale":"2024-09-15T12:40:39.208144+0000","last_undegraded":"2024-09-15T12:40:39.208144+0000","last_fullsized":"2024-09-15T12:40:39.208144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.204082+0000","last_change":"2024-09-15T12:22:21.438817+0000","last_active":"2024-09-15T12:40:39.204082+0000","last_peered":"2024-09-15T12:40:39.204082+0000","last_clean":"2024-09-15T12:40:39.204082+0000","last_became_active":"2024-09-15T12:22:19.466495+0000","last_became_peered":"2024-09-15T12:22:19.466495+0000","last_unstale":"2024-09-15T12:40:39.204082+0000","last_undegraded":"2024-09-15T12:40:39.204082+0000","last_fullsized":"2024-09-15T12:40:39.204082+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.207286+0000","last_change":"2024-09-15T12:22:21.438734+0000","last_active":"2024-09-15T12:40:39.207286+0000","last_peered":"2024-09-15T12:40:39.207286+0000","last_clean":"2024-09-15T12:40:39.207286+0000","last_became_active":"2024-09-15T12:22:19.475039+0000","last_became_peered":"2024-09-15T12:22:19.475039+0000","last_unstale":"2024-09-15T12:40:39.207286+0000","last_undegraded":"2024-09-15T12:40:39.207286+0000","last_fullsized":"2024-09-15T12:40:39.207286+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2125,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.210638+0000","last_change":"2024-09-15T12:22:21.441279+0000","last_active":"2024-09-15T12:40:39.210638+0000","last_peered":"2024-09-15T12:40:39.210638+0000","last_clean":"2024-09-15T12:40:39.210638+0000","last_became_active":"2024-09-15T12:22:19.485089+0000","last_became_peered":"2024-09-15T12:22:19.485089+0000","last_unstale":"2024-09-15T12:40:39.210638+0000","last_undegraded":"2024-09-15T12:40:39.210638+0000","last_fullsized":"2024-09-15T12:40:39.210638+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2193,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.200139+0000","last_change":"2024-09-15T12:22:18.465473+0000","last_active":"2024-09-15T12:40:39.200139+0000","last_peered":"2024-09-15T12:40:39.200139+0000","last_clean":"2024-09-15T12:40:39.200139+0000","last_became_active":"2024-09-15T12:22:18.457094+0000","last_became_peered":"2024-09-15T12:22:18.457094+0000","last_unstale":"2024-09-15T12:40:39.200139+0000","last_undegraded":"2024-09-15T12:40:39.200139+0000","last_fullsized":"2024-09-15T12:40:39.200139+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:17.395744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:17.395744+0000","last_clean_scrub_stamp":"2024-09-15T12:22:17.395744+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949674069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63352,"kb_used_data":1832,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94308488,"statfs":{"total":96636764160,"available":96571891712,"internally_reserved":0,"allocated":1875968,"data_stored":1240421,"data_compressed":106588,"data_compressed_allocated":147456,"data_compressed_original":733184,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59128,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94312712,"statfs":{"total":96636764160,"available":96576217088,"internally_reserved":0,"allocated":1810432,"data_stored":637202,"data_compressed":70656,"data_compressed_allocated":98304,"data_compressed_original":147456,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64680,"kb_used_data":1752,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94307160,"statfs":{"total":96636764160,"available":96570531840,"internally_reserved":0,"allocated":1794048,"data_stored":624308,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706772,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68936,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302904,"statfs":{"total":96636764160,"available":96566173696,"internally_reserved":0,"allocated":1892352,"data_stored":1253315,"data_compressed":112476,"data_compressed_allocated":155648,"data_compressed_original":745472,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:41:12.468 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T12:41:12.468 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:41:12.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.573+0000 7f5b81591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:12.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.579+0000 7f5b81591640 1 Processor -- start 2024-09-15T12:41:12.581 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.579+0000 7f5b81591640 1 -- start start 2024-09-15T12:41:12.582 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.580+0000 7f5b81591640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5b7c09ca50 0x7f5b7c09ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:12.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.580+0000 7f5b81591640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b7c0a0060 con 0x7f5b7c09d3a0 2024-09-15T12:41:12.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.580+0000 7f5b81591640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f5b7c09fd30 con 0x7f5b7c09ca50 2024-09-15T12:41:12.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.580+0000 7f5b7affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5b7c09ca50 0x7f5b7c09ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:12.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.580+0000 7f5b727fc640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f5b7c09d3a0 0x7f5b7c135ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56582/0 (socket says 172.21.15.122:56582) 2024-09-15T12:41:12.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.580+0000 7f5b727fc640 1 -- 172.21.15.122:0/149142608 learned_addr learned my addr 172.21.15.122:0/149142608 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:41:12.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.580+0000 7f5b7affd640 1 -- 172.21.15.122:0/149142608 >> v1:172.21.15.122:6789/0 conn(0x7f5b7c09d3a0 legacy=0x7f5b7c135ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:12.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.580+0000 7f5b7affd640 1 -- 172.21.15.122:0/149142608 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7c09e3c0 con 0x7f5b7c09ca50 2024-09-15T12:41:12.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.580+0000 7f5b7affd640 1 --2- 172.21.15.122:0/149142608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b7c09ca50 0x7f5b7c09ce60 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86df3ba9b8115162 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:12.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.581+0000 7f5b7a7fc640 1 -- 172.21.15.122:0/149142608 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5b6c009d80 con 0x7f5b7c09ca50 2024-09-15T12:41:12.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.581+0000 7f5b7a7fc640 1 -- 172.21.15.122:0/149142608 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5b6c00e230 con 0x7f5b7c09ca50 2024-09-15T12:41:12.583 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.581+0000 7f5b7a7fc640 1 -- 172.21.15.122:0/149142608 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5b6c00e4d0 con 0x7f5b7c09ca50 2024-09-15T12:41:12.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.581+0000 7f5b81591640 1 -- 172.21.15.122:0/149142608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b7c09ca50 msgr2=0x7f5b7c09ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:12.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.581+0000 7f5b81591640 1 --2- 172.21.15.122:0/149142608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b7c09ca50 0x7f5b7c09ce60 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.581+0000 7f5b81591640 1 -- 172.21.15.122:0/149142608 shutdown_connections 2024-09-15T12:41:12.584 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.581+0000 7f5b81591640 1 --2- 172.21.15.122:0/149142608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b7c09ca50 0x7f5b7c09ce60 unknown :-1 s=CLOSED pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.581+0000 7f5b81591640 1 -- 172.21.15.122:0/149142608 >> 172.21.15.122:0/149142608 conn(0x7f5b7c0a5230 msgr2=0x7f5b7c0a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:12.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.581+0000 7f5b81591640 1 -- 172.21.15.122:0/149142608 shutdown_connections 2024-09-15T12:41:12.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.581+0000 7f5b81591640 1 -- 172.21.15.122:0/149142608 wait complete. 2024-09-15T12:41:12.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.582+0000 7f5b81591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:12.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.583+0000 7f5b81591640 1 Processor -- start 2024-09-15T12:41:12.585 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.583+0000 7f5b81591640 1 -- start start 2024-09-15T12:41:12.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.584+0000 7f5b81591640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b7c09ca50 0x7f5b7c122d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:12.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.584+0000 7f5b81591640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c136da0 con 0x7f5b7c09ca50 2024-09-15T12:41:12.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.584+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b7c09ca50 0x7f5b7c122d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:12.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.584+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b7c09ca50 0x7f5b7c122d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43444/0 (socket says 172.21.15.122:43444) 2024-09-15T12:41:12.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.584+0000 7f5b7affd640 1 -- 172.21.15.122:0/1846056178 learned_addr learned my addr 172.21.15.122:0/1846056178 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:12.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.585+0000 7f5b7affd640 1 -- 172.21.15.122:0/1846056178 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7c126cf0 con 0x7f5b7c09ca50 2024-09-15T12:41:12.587 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.585+0000 7f5b7affd640 1 --2- 172.21.15.122:0/1846056178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b7c09ca50 0x7f5b7c122d10 crc :-1 s=READY pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:12.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.585+0000 7f5b73fff640 1 -- 172.21.15.122:0/1846056178 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5b6c014540 con 0x7f5b7c09ca50 2024-09-15T12:41:12.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.585+0000 7f5b73fff640 1 -- 172.21.15.122:0/1846056178 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5b6c0146a0 con 0x7f5b7c09ca50 2024-09-15T12:41:12.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.585+0000 7f5b81591640 1 -- 172.21.15.122:0/1846056178 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b7c136a70 con 0x7f5b7c09ca50 2024-09-15T12:41:12.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.585+0000 7f5b73fff640 1 -- 172.21.15.122:0/1846056178 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5b6c014940 con 0x7f5b7c09ca50 2024-09-15T12:41:12.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.585+0000 7f5b81591640 1 -- 172.21.15.122:0/1846056178 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b7c0a3830 con 0x7f5b7c09ca50 2024-09-15T12:41:12.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.586+0000 7f5b73fff640 1 -- 172.21.15.122:0/1846056178 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f5b6c014d00 con 0x7f5b7c09ca50 2024-09-15T12:41:12.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.586+0000 7f5b73fff640 1 --2- 172.21.15.122:0/1846056178 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f5b5c03e930 0x7f5b5c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:12.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.586+0000 7f5b73fff640 1 -- 172.21.15.122:0/1846056178 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(720..720 src has 621..720) ==== 3431+0+0 (crc 0 0 0) 0x7f5b6c019040 con 0x7f5b7c09ca50 2024-09-15T12:41:12.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.586+0000 7f5b81591640 1 -- 172.21.15.122:0/1846056178 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b7c124fc0 con 0x7f5b7c09ca50 2024-09-15T12:41:12.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.586+0000 7f5b727fc640 1 --2- 172.21.15.122:0/1846056178 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f5b5c03e930 0x7f5b5c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:12.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.587+0000 7f5b727fc640 1 --2- 172.21.15.122:0/1846056178 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f5b5c03e930 0x7f5b5c040e40 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:12.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.591+0000 7f5b73fff640 1 -- 172.21.15.122:0/1846056178 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f5b6c012580 con 0x7f5b7c09ca50 2024-09-15T12:41:12.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.764+0000 7f5b81591640 1 -- 172.21.15.122:0/1846056178 --> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5b7c0a1fc0 con 0x7f5b5c03e930 2024-09-15T12:41:12.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.766+0000 7f5b73fff640 1 -- 172.21.15.122:0/1846056178 <== mgr.4100 v2:172.21.15.142:6800/73136857 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109234 (crc 0 0 0) 0x7f5b7c0a1fc0 con 0x7f5b5c03e930 2024-09-15T12:41:12.770 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:41:12.770 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-15T12:41:12.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.769+0000 7f5b81591640 1 -- 172.21.15.122:0/1846056178 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f5b5c03e930 msgr2=0x7f5b5c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:12.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.769+0000 7f5b81591640 1 --2- 172.21.15.122:0/1846056178 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f5b5c03e930 0x7f5b5c040e40 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.769+0000 7f5b81591640 1 -- 172.21.15.122:0/1846056178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b7c09ca50 msgr2=0x7f5b7c122d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:12.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.769+0000 7f5b81591640 1 --2- 172.21.15.122:0/1846056178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b7c09ca50 0x7f5b7c122d10 crc :-1 s=READY pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.769+0000 7f5b81591640 1 -- 172.21.15.122:0/1846056178 shutdown_connections 2024-09-15T12:41:12.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.769+0000 7f5b81591640 1 --2- 172.21.15.122:0/1846056178 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f5b5c03e930 0x7f5b5c040e40 unknown :-1 s=CLOSED pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.772 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.769+0000 7f5b81591640 1 --2- 172.21.15.122:0/1846056178 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b7c09ca50 0x7f5b7c122d10 unknown :-1 s=CLOSED pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.769+0000 7f5b81591640 1 -- 172.21.15.122:0/1846056178 >> 172.21.15.122:0/1846056178 conn(0x7f5b7c0a5230 msgr2=0x7f5b7c0a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:12.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.769+0000 7f5b81591640 1 -- 172.21.15.122:0/1846056178 shutdown_connections 2024-09-15T12:41:12.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.769+0000 7f5b81591640 1 -- 172.21.15.122:0/1846056178 wait complete. 2024-09-15T12:41:12.782 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":1281,"stamp":"2024-09-15T12:41:12.652238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":256096,"kb_used_data":7200,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377231264,"statfs":{"total":386547056640,"available":386284814336,"internally_reserved":0,"allocated":7372800,"data_stored":3755246,"data_compressed":354488,"data_compressed_allocated":491520,"data_compressed_original":1761280,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002185"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.211693+0000","last_change":"2024-09-15T12:27:21.178610+0000","last_active":"2024-09-15T12:40:39.211693+0000","last_peered":"2024-09-15T12:40:39.211693+0000","last_clean":"2024-09-15T12:40:39.211693+0000","last_became_active":"2024-09-15T12:27:21.162458+0000","last_became_peered":"2024-09-15T12:27:21.162458+0000","last_unstale":"2024-09-15T12:40:39.211693+0000","last_undegraded":"2024-09-15T12:40:39.211693+0000","last_fullsized":"2024-09-15T12:40:39.211693+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.217323+0000","last_change":"2024-09-15T12:27:21.213920+0000","last_active":"2024-09-15T12:40:39.217323+0000","last_peered":"2024-09-15T12:40:39.217323+0000","last_clean":"2024-09-15T12:40:39.217323+0000","last_became_active":"2024-09-15T12:27:21.204453+0000","last_became_peered":"2024-09-15T12:27:21.204453+0000","last_unstale":"2024-09-15T12:40:39.217323+0000","last_undegraded":"2024-09-15T12:40:39.217323+0000","last_fullsized":"2024-09-15T12:40:39.217323+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.206716+0000","last_change":"2024-09-15T12:27:21.164996+0000","last_active":"2024-09-15T12:40:39.206716+0000","last_peered":"2024-09-15T12:40:39.206716+0000","last_clean":"2024-09-15T12:40:39.206716+0000","last_became_active":"2024-09-15T12:27:21.155594+0000","last_became_peered":"2024-09-15T12:27:21.155594+0000","last_unstale":"2024-09-15T12:40:39.206716+0000","last_undegraded":"2024-09-15T12:40:39.206716+0000","last_fullsized":"2024-09-15T12:40:39.206716+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.203751+0000","last_change":"2024-09-15T12:27:21.174176+0000","last_active":"2024-09-15T12:40:39.203751+0000","last_peered":"2024-09-15T12:40:39.203751+0000","last_clean":"2024-09-15T12:40:39.203751+0000","last_became_active":"2024-09-15T12:27:21.154114+0000","last_became_peered":"2024-09-15T12:27:21.154114+0000","last_unstale":"2024-09-15T12:40:39.203751+0000","last_undegraded":"2024-09-15T12:40:39.203751+0000","last_fullsized":"2024-09-15T12:40:39.203751+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214753+0000","last_change":"2024-09-15T12:27:21.214859+0000","last_active":"2024-09-15T12:40:39.214753+0000","last_peered":"2024-09-15T12:40:39.214753+0000","last_clean":"2024-09-15T12:40:39.214753+0000","last_became_active":"2024-09-15T12:27:21.208784+0000","last_became_peered":"2024-09-15T12:27:21.208784+0000","last_unstale":"2024-09-15T12:40:39.214753+0000","last_undegraded":"2024-09-15T12:40:39.214753+0000","last_fullsized":"2024-09-15T12:40:39.214753+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.198145+0000","last_change":"2024-09-15T12:27:21.229007+0000","last_active":"2024-09-15T12:40:39.198145+0000","last_peered":"2024-09-15T12:40:39.198145+0000","last_clean":"2024-09-15T12:40:39.198145+0000","last_became_active":"2024-09-15T12:27:21.199501+0000","last_became_peered":"2024-09-15T12:27:21.199501+0000","last_unstale":"2024-09-15T12:40:39.198145+0000","last_undegraded":"2024-09-15T12:40:39.198145+0000","last_fullsized":"2024-09-15T12:40:39.198145+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.208598+0000","last_change":"2024-09-15T12:27:21.226985+0000","last_active":"2024-09-15T12:40:39.208598+0000","last_peered":"2024-09-15T12:40:39.208598+0000","last_clean":"2024-09-15T12:40:39.208598+0000","last_became_active":"2024-09-15T12:27:21.213341+0000","last_became_peered":"2024-09-15T12:27:21.213341+0000","last_unstale":"2024-09-15T12:40:39.208598+0000","last_undegraded":"2024-09-15T12:40:39.208598+0000","last_fullsized":"2024-09-15T12:40:39.208598+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.201604+0000","last_change":"2024-09-15T12:27:21.331475+0000","last_active":"2024-09-15T12:40:39.201604+0000","last_peered":"2024-09-15T12:40:39.201604+0000","last_clean":"2024-09-15T12:40:39.201604+0000","last_became_active":"2024-09-15T12:27:21.314250+0000","last_became_peered":"2024-09-15T12:27:21.314250+0000","last_unstale":"2024-09-15T12:40:39.201604+0000","last_undegraded":"2024-09-15T12:40:39.201604+0000","last_fullsized":"2024-09-15T12:40:39.201604+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.212098+0000","last_change":"2024-09-15T12:27:21.223149+0000","last_active":"2024-09-15T12:40:39.212098+0000","last_peered":"2024-09-15T12:40:39.212098+0000","last_clean":"2024-09-15T12:40:39.212098+0000","last_became_active":"2024-09-15T12:27:21.210467+0000","last_became_peered":"2024-09-15T12:27:21.210467+0000","last_unstale":"2024-09-15T12:40:39.212098+0000","last_undegraded":"2024-09-15T12:40:39.212098+0000","last_fullsized":"2024-09-15T12:40:39.212098+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.204307+0000","last_change":"2024-09-15T12:27:21.198137+0000","last_active":"2024-09-15T12:40:39.204307+0000","last_peered":"2024-09-15T12:40:39.204307+0000","last_clean":"2024-09-15T12:40:39.204307+0000","last_became_active":"2024-09-15T12:27:21.183618+0000","last_became_peered":"2024-09-15T12:27:21.183618+0000","last_unstale":"2024-09-15T12:40:39.204307+0000","last_undegraded":"2024-09-15T12:40:39.204307+0000","last_fullsized":"2024-09-15T12:40:39.204307+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214783+0000","last_change":"2024-09-15T12:27:21.257627+0000","last_active":"2024-09-15T12:40:39.214783+0000","last_peered":"2024-09-15T12:40:39.214783+0000","last_clean":"2024-09-15T12:40:39.214783+0000","last_became_active":"2024-09-15T12:27:21.249285+0000","last_became_peered":"2024-09-15T12:27:21.249285+0000","last_unstale":"2024-09-15T12:40:39.214783+0000","last_undegraded":"2024-09-15T12:40:39.214783+0000","last_fullsized":"2024-09-15T12:40:39.214783+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.213446+0000","last_change":"2024-09-15T12:27:21.283400+0000","last_active":"2024-09-15T12:40:39.213446+0000","last_peered":"2024-09-15T12:40:39.213446+0000","last_clean":"2024-09-15T12:40:39.213446+0000","last_became_active":"2024-09-15T12:27:21.269838+0000","last_became_peered":"2024-09-15T12:27:21.269838+0000","last_unstale":"2024-09-15T12:40:39.213446+0000","last_undegraded":"2024-09-15T12:40:39.213446+0000","last_fullsized":"2024-09-15T12:40:39.213446+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.205889+0000","last_change":"2024-09-15T12:27:21.191351+0000","last_active":"2024-09-15T12:40:39.205889+0000","last_peered":"2024-09-15T12:40:39.205889+0000","last_clean":"2024-09-15T12:40:39.205889+0000","last_became_active":"2024-09-15T12:27:21.178077+0000","last_became_peered":"2024-09-15T12:27:21.178077+0000","last_unstale":"2024-09-15T12:40:39.205889+0000","last_undegraded":"2024-09-15T12:40:39.205889+0000","last_fullsized":"2024-09-15T12:40:39.205889+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.202404+0000","last_change":"2024-09-15T12:27:21.222442+0000","last_active":"2024-09-15T12:40:39.202404+0000","last_peered":"2024-09-15T12:40:39.202404+0000","last_clean":"2024-09-15T12:40:39.202404+0000","last_became_active":"2024-09-15T12:27:21.210134+0000","last_became_peered":"2024-09-15T12:27:21.210134+0000","last_unstale":"2024-09-15T12:40:39.202404+0000","last_undegraded":"2024-09-15T12:40:39.202404+0000","last_fullsized":"2024-09-15T12:40:39.202404+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.199541+0000","last_change":"2024-09-15T12:27:21.224669+0000","last_active":"2024-09-15T12:40:39.199541+0000","last_peered":"2024-09-15T12:40:39.199541+0000","last_clean":"2024-09-15T12:40:39.199541+0000","last_became_active":"2024-09-15T12:27:21.206575+0000","last_became_peered":"2024-09-15T12:27:21.206575+0000","last_unstale":"2024-09-15T12:40:39.199541+0000","last_undegraded":"2024-09-15T12:40:39.199541+0000","last_fullsized":"2024-09-15T12:40:39.199541+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.202979+0000","last_change":"2024-09-15T12:27:21.310077+0000","last_active":"2024-09-15T12:40:39.202979+0000","last_peered":"2024-09-15T12:40:39.202979+0000","last_clean":"2024-09-15T12:40:39.202979+0000","last_became_active":"2024-09-15T12:27:21.301356+0000","last_became_peered":"2024-09-15T12:27:21.301356+0000","last_unstale":"2024-09-15T12:40:39.202979+0000","last_undegraded":"2024-09-15T12:40:39.202979+0000","last_fullsized":"2024-09-15T12:40:39.202979+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214906+0000","last_change":"2024-09-15T12:27:21.274087+0000","last_active":"2024-09-15T12:40:39.214906+0000","last_peered":"2024-09-15T12:40:39.214906+0000","last_clean":"2024-09-15T12:40:39.214906+0000","last_became_active":"2024-09-15T12:27:21.265145+0000","last_became_peered":"2024-09-15T12:27:21.265145+0000","last_unstale":"2024-09-15T12:40:39.214906+0000","last_undegraded":"2024-09-15T12:40:39.214906+0000","last_fullsized":"2024-09-15T12:40:39.214906+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.208851+0000","last_change":"2024-09-15T12:27:21.215295+0000","last_active":"2024-09-15T12:40:39.208851+0000","last_peered":"2024-09-15T12:40:39.208851+0000","last_clean":"2024-09-15T12:40:39.208851+0000","last_became_active":"2024-09-15T12:27:21.195582+0000","last_became_peered":"2024-09-15T12:27:21.195582+0000","last_unstale":"2024-09-15T12:40:39.208851+0000","last_undegraded":"2024-09-15T12:40:39.208851+0000","last_fullsized":"2024-09-15T12:40:39.208851+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.211268+0000","last_change":"2024-09-15T12:27:21.185970+0000","last_active":"2024-09-15T12:40:39.211268+0000","last_peered":"2024-09-15T12:40:39.211268+0000","last_clean":"2024-09-15T12:40:39.211268+0000","last_became_active":"2024-09-15T12:27:21.174023+0000","last_became_peered":"2024-09-15T12:27:21.174023+0000","last_unstale":"2024-09-15T12:40:39.211268+0000","last_undegraded":"2024-09-15T12:40:39.211268+0000","last_fullsized":"2024-09-15T12:40:39.211268+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214589+0000","last_change":"2024-09-15T12:27:21.280402+0000","last_active":"2024-09-15T12:40:39.214589+0000","last_peered":"2024-09-15T12:40:39.214589+0000","last_clean":"2024-09-15T12:40:39.214589+0000","last_became_active":"2024-09-15T12:27:21.265986+0000","last_became_peered":"2024-09-15T12:27:21.265986+0000","last_unstale":"2024-09-15T12:40:39.214589+0000","last_undegraded":"2024-09-15T12:40:39.214589+0000","last_fullsized":"2024-09-15T12:40:39.214589+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.210040+0000","last_change":"2024-09-15T12:27:21.288326+0000","last_active":"2024-09-15T12:40:39.210040+0000","last_peered":"2024-09-15T12:40:39.210040+0000","last_clean":"2024-09-15T12:40:39.210040+0000","last_became_active":"2024-09-15T12:27:21.272862+0000","last_became_peered":"2024-09-15T12:27:21.272862+0000","last_unstale":"2024-09-15T12:40:39.210040+0000","last_undegraded":"2024-09-15T12:40:39.210040+0000","last_fullsized":"2024-09-15T12:40:39.210040+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.203022+0000","last_change":"2024-09-15T12:27:21.186855+0000","last_active":"2024-09-15T12:40:39.203022+0000","last_peered":"2024-09-15T12:40:39.203022+0000","last_clean":"2024-09-15T12:40:39.203022+0000","last_became_active":"2024-09-15T12:27:21.173254+0000","last_became_peered":"2024-09-15T12:27:21.173254+0000","last_unstale":"2024-09-15T12:40:39.203022+0000","last_undegraded":"2024-09-15T12:40:39.203022+0000","last_fullsized":"2024-09-15T12:40:39.203022+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.202973+0000","last_change":"2024-09-15T12:27:21.209103+0000","last_active":"2024-09-15T12:40:39.202973+0000","last_peered":"2024-09-15T12:40:39.202973+0000","last_clean":"2024-09-15T12:40:39.202973+0000","last_became_active":"2024-09-15T12:27:21.202878+0000","last_became_peered":"2024-09-15T12:27:21.202878+0000","last_unstale":"2024-09-15T12:40:39.202973+0000","last_undegraded":"2024-09-15T12:40:39.202973+0000","last_fullsized":"2024-09-15T12:40:39.202973+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.210377+0000","last_change":"2024-09-15T12:27:21.280809+0000","last_active":"2024-09-15T12:40:39.210377+0000","last_peered":"2024-09-15T12:40:39.210377+0000","last_clean":"2024-09-15T12:40:39.210377+0000","last_became_active":"2024-09-15T12:27:21.274273+0000","last_became_peered":"2024-09-15T12:27:21.274273+0000","last_unstale":"2024-09-15T12:40:39.210377+0000","last_undegraded":"2024-09-15T12:40:39.210377+0000","last_fullsized":"2024-09-15T12:40:39.210377+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.211113+0000","last_change":"2024-09-15T12:27:21.242910+0000","last_active":"2024-09-15T12:40:39.211113+0000","last_peered":"2024-09-15T12:40:39.211113+0000","last_clean":"2024-09-15T12:40:39.211113+0000","last_became_active":"2024-09-15T12:27:21.236120+0000","last_became_peered":"2024-09-15T12:27:21.236120+0000","last_unstale":"2024-09-15T12:40:39.211113+0000","last_undegraded":"2024-09-15T12:40:39.211113+0000","last_fullsized":"2024-09-15T12:40:39.211113+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.206000+0000","last_change":"2024-09-15T12:27:21.254314+0000","last_active":"2024-09-15T12:40:39.206000+0000","last_peered":"2024-09-15T12:40:39.206000+0000","last_clean":"2024-09-15T12:40:39.206000+0000","last_became_active":"2024-09-15T12:27:21.241138+0000","last_became_peered":"2024-09-15T12:27:21.241138+0000","last_unstale":"2024-09-15T12:40:39.206000+0000","last_undegraded":"2024-09-15T12:40:39.206000+0000","last_fullsized":"2024-09-15T12:40:39.206000+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214779+0000","last_change":"2024-09-15T12:27:21.251401+0000","last_active":"2024-09-15T12:40:39.214779+0000","last_peered":"2024-09-15T12:40:39.214779+0000","last_clean":"2024-09-15T12:40:39.214779+0000","last_became_active":"2024-09-15T12:27:21.243633+0000","last_became_peered":"2024-09-15T12:27:21.243633+0000","last_unstale":"2024-09-15T12:40:39.214779+0000","last_undegraded":"2024-09-15T12:40:39.214779+0000","last_fullsized":"2024-09-15T12:40:39.214779+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.203793+0000","last_change":"2024-09-15T12:27:21.342117+0000","last_active":"2024-09-15T12:40:39.203793+0000","last_peered":"2024-09-15T12:40:39.203793+0000","last_clean":"2024-09-15T12:40:39.203793+0000","last_became_active":"2024-09-15T12:27:21.335250+0000","last_became_peered":"2024-09-15T12:27:21.335250+0000","last_unstale":"2024-09-15T12:40:39.203793+0000","last_undegraded":"2024-09-15T12:40:39.203793+0000","last_fullsized":"2024-09-15T12:40:39.203793+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.208478+0000","last_change":"2024-09-15T12:27:21.318846+0000","last_active":"2024-09-15T12:40:39.208478+0000","last_peered":"2024-09-15T12:40:39.208478+0000","last_clean":"2024-09-15T12:40:39.208478+0000","last_became_active":"2024-09-15T12:27:21.306255+0000","last_became_peered":"2024-09-15T12:27:21.306255+0000","last_unstale":"2024-09-15T12:40:39.208478+0000","last_undegraded":"2024-09-15T12:40:39.208478+0000","last_fullsized":"2024-09-15T12:40:39.208478+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.200872+0000","last_change":"2024-09-15T12:27:21.254965+0000","last_active":"2024-09-15T12:40:39.200872+0000","last_peered":"2024-09-15T12:40:39.200872+0000","last_clean":"2024-09-15T12:40:39.200872+0000","last_became_active":"2024-09-15T12:27:21.232463+0000","last_became_peered":"2024-09-15T12:27:21.232463+0000","last_unstale":"2024-09-15T12:40:39.200872+0000","last_undegraded":"2024-09-15T12:40:39.200872+0000","last_fullsized":"2024-09-15T12:40:39.200872+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1464,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.212111+0000","last_change":"2024-09-15T12:27:21.188176+0000","last_active":"2024-09-15T12:40:39.212111+0000","last_peered":"2024-09-15T12:40:39.212111+0000","last_clean":"2024-09-15T12:40:39.212111+0000","last_became_active":"2024-09-15T12:27:21.171794+0000","last_became_peered":"2024-09-15T12:27:21.171794+0000","last_unstale":"2024-09-15T12:40:39.212111+0000","last_undegraded":"2024-09-15T12:40:39.212111+0000","last_fullsized":"2024-09-15T12:40:39.212111+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.209817+0000","last_change":"2024-09-15T12:27:21.182150+0000","last_active":"2024-09-15T12:40:39.209817+0000","last_peered":"2024-09-15T12:40:39.209817+0000","last_clean":"2024-09-15T12:40:39.209817+0000","last_became_active":"2024-09-15T12:27:21.169417+0000","last_became_peered":"2024-09-15T12:27:21.169417+0000","last_unstale":"2024-09-15T12:40:39.209817+0000","last_undegraded":"2024-09-15T12:40:39.209817+0000","last_fullsized":"2024-09-15T12:40:39.209817+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.201780+0000","last_change":"2024-09-15T12:22:21.439357+0000","last_active":"2024-09-15T12:40:39.201780+0000","last_peered":"2024-09-15T12:40:39.201780+0000","last_clean":"2024-09-15T12:40:39.201780+0000","last_became_active":"2024-09-15T12:22:19.461505+0000","last_became_peered":"2024-09-15T12:22:19.461505+0000","last_unstale":"2024-09-15T12:40:39.201780+0000","last_undegraded":"2024-09-15T12:40:39.201780+0000","last_fullsized":"2024-09-15T12:40:39.201780+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.203188+0000","last_change":"2024-09-15T12:22:21.437833+0000","last_active":"2024-09-15T12:40:39.203188+0000","last_peered":"2024-09-15T12:40:39.203188+0000","last_clean":"2024-09-15T12:40:39.203188+0000","last_became_active":"2024-09-15T12:22:19.483223+0000","last_became_peered":"2024-09-15T12:22:19.483223+0000","last_unstale":"2024-09-15T12:40:39.203188+0000","last_undegraded":"2024-09-15T12:40:39.203188+0000","last_fullsized":"2024-09-15T12:40:39.203188+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.216732+0000","last_change":"2024-09-15T12:22:21.438624+0000","last_active":"2024-09-15T12:40:39.216732+0000","last_peered":"2024-09-15T12:40:39.216732+0000","last_clean":"2024-09-15T12:40:39.216732+0000","last_became_active":"2024-09-15T12:22:19.461144+0000","last_became_peered":"2024-09-15T12:22:19.461144+0000","last_unstale":"2024-09-15T12:40:39.216732+0000","last_undegraded":"2024-09-15T12:40:39.216732+0000","last_fullsized":"2024-09-15T12:40:39.216732+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.198958+0000","last_change":"2024-09-15T12:22:21.436163+0000","last_active":"2024-09-15T12:40:39.198958+0000","last_peered":"2024-09-15T12:40:39.198958+0000","last_clean":"2024-09-15T12:40:39.198958+0000","last_became_active":"2024-09-15T12:22:19.461497+0000","last_became_peered":"2024-09-15T12:22:19.461497+0000","last_unstale":"2024-09-15T12:40:39.198958+0000","last_undegraded":"2024-09-15T12:40:39.198958+0000","last_fullsized":"2024-09-15T12:40:39.198958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2126,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.208144+0000","last_change":"2024-09-15T12:22:21.438691+0000","last_active":"2024-09-15T12:40:39.208144+0000","last_peered":"2024-09-15T12:40:39.208144+0000","last_clean":"2024-09-15T12:40:39.208144+0000","last_became_active":"2024-09-15T12:22:19.461584+0000","last_became_peered":"2024-09-15T12:22:19.461584+0000","last_unstale":"2024-09-15T12:40:39.208144+0000","last_undegraded":"2024-09-15T12:40:39.208144+0000","last_fullsized":"2024-09-15T12:40:39.208144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.204082+0000","last_change":"2024-09-15T12:22:21.438817+0000","last_active":"2024-09-15T12:40:39.204082+0000","last_peered":"2024-09-15T12:40:39.204082+0000","last_clean":"2024-09-15T12:40:39.204082+0000","last_became_active":"2024-09-15T12:22:19.466495+0000","last_became_peered":"2024-09-15T12:22:19.466495+0000","last_unstale":"2024-09-15T12:40:39.204082+0000","last_undegraded":"2024-09-15T12:40:39.204082+0000","last_fullsized":"2024-09-15T12:40:39.204082+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.207286+0000","last_change":"2024-09-15T12:22:21.438734+0000","last_active":"2024-09-15T12:40:39.207286+0000","last_peered":"2024-09-15T12:40:39.207286+0000","last_clean":"2024-09-15T12:40:39.207286+0000","last_became_active":"2024-09-15T12:22:19.475039+0000","last_became_peered":"2024-09-15T12:22:19.475039+0000","last_unstale":"2024-09-15T12:40:39.207286+0000","last_undegraded":"2024-09-15T12:40:39.207286+0000","last_fullsized":"2024-09-15T12:40:39.207286+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2125,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.210638+0000","last_change":"2024-09-15T12:22:21.441279+0000","last_active":"2024-09-15T12:40:39.210638+0000","last_peered":"2024-09-15T12:40:39.210638+0000","last_clean":"2024-09-15T12:40:39.210638+0000","last_became_active":"2024-09-15T12:22:19.485089+0000","last_became_peered":"2024-09-15T12:22:19.485089+0000","last_unstale":"2024-09-15T12:40:39.210638+0000","last_undegraded":"2024-09-15T12:40:39.210638+0000","last_fullsized":"2024-09-15T12:40:39.210638+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2193,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.200139+0000","last_change":"2024-09-15T12:22:18.465473+0000","last_active":"2024-09-15T12:40:39.200139+0000","last_peered":"2024-09-15T12:40:39.200139+0000","last_clean":"2024-09-15T12:40:39.200139+0000","last_became_active":"2024-09-15T12:22:18.457094+0000","last_became_peered":"2024-09-15T12:22:18.457094+0000","last_unstale":"2024-09-15T12:40:39.200139+0000","last_undegraded":"2024-09-15T12:40:39.200139+0000","last_fullsized":"2024-09-15T12:40:39.200139+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:17.395744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:17.395744+0000","last_clean_scrub_stamp":"2024-09-15T12:22:17.395744+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949674069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63352,"kb_used_data":1832,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94308488,"statfs":{"total":96636764160,"available":96571891712,"internally_reserved":0,"allocated":1875968,"data_stored":1240421,"data_compressed":106588,"data_compressed_allocated":147456,"data_compressed_original":733184,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59128,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94312712,"statfs":{"total":96636764160,"available":96576217088,"internally_reserved":0,"allocated":1810432,"data_stored":637202,"data_compressed":70656,"data_compressed_allocated":98304,"data_compressed_original":147456,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64680,"kb_used_data":1752,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94307160,"statfs":{"total":96636764160,"available":96570531840,"internally_reserved":0,"allocated":1794048,"data_stored":624308,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706772,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68936,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302904,"statfs":{"total":96636764160,"available":96566173696,"internally_reserved":0,"allocated":1892352,"data_stored":1253315,"data_compressed":112476,"data_compressed_allocated":155648,"data_compressed_original":745472,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:41:12.784 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:41:12.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.885+0000 7f41ace4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:12.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.890+0000 7f41ace4f640 1 Processor -- start 2024-09-15T12:41:12.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.890+0000 7f41ace4f640 1 -- start start 2024-09-15T12:41:12.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.891+0000 7f41ace4f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f41a809e910 0x7f41a8069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:12.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.891+0000 7f41ace4f640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a806d370 con 0x7f41a809f040 2024-09-15T12:41:12.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.891+0000 7f41ace4f640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f41a8070cb0 con 0x7f41a809e910 2024-09-15T12:41:12.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.892+0000 7f41a5d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f41a809e910 0x7f41a8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:12.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.892+0000 7f41a659c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f41a809f040 0x7f41a8068d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56596/0 (socket says 172.21.15.122:56596) 2024-09-15T12:41:12.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.892+0000 7f41a659c640 1 -- 172.21.15.122:0/1337933413 learned_addr learned my addr 172.21.15.122:0/1337933413 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:41:12.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.892+0000 7f41a5d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f41a809e910 0x7f41a8069450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43452/0 (socket says 172.21.15.122:43452) 2024-09-15T12:41:12.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.892+0000 7f41a5d9b640 1 -- 172.21.15.122:0/1337933413 >> v1:172.21.15.122:6789/0 conn(0x7f41a809f040 legacy=0x7f41a8068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:12.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.892+0000 7f41a5d9b640 1 -- 172.21.15.122:0/1337933413 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a809c1c0 con 0x7f41a809e910 2024-09-15T12:41:12.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.892+0000 7f41a559a640 1 -- 172.21.15.122:0/1337933413 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3318011143 0 0) 0x7f41a806d370 con 0x7f41a809f040 2024-09-15T12:41:12.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.892+0000 7f41a5d9b640 1 --2- 172.21.15.122:0/1337933413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41a809e910 0x7f41a8069450 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93470327e926c42d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:12.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.892+0000 7f41a559a640 1 -- 172.21.15.122:0/1337933413 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f419c009d90 con 0x7f41a809e910 2024-09-15T12:41:12.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.892+0000 7f41a559a640 1 -- 172.21.15.122:0/1337933413 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f419c00e230 con 0x7f41a809e910 2024-09-15T12:41:12.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.892+0000 7f41a559a640 1 -- 172.21.15.122:0/1337933413 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f419c00e4d0 con 0x7f41a809e910 2024-09-15T12:41:12.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.893+0000 7f41ace4f640 1 -- 172.21.15.122:0/1337933413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41a809e910 msgr2=0x7f41a8069450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:12.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.893+0000 7f41ace4f640 1 --2- 172.21.15.122:0/1337933413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41a809e910 0x7f41a8069450 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.897 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.893+0000 7f41ace4f640 1 -- 172.21.15.122:0/1337933413 shutdown_connections 2024-09-15T12:41:12.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.893+0000 7f41ace4f640 1 --2- 172.21.15.122:0/1337933413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41a809e910 0x7f41a8069450 unknown :-1 s=CLOSED pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:12.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.893+0000 7f41ace4f640 1 -- 172.21.15.122:0/1337933413 >> 172.21.15.122:0/1337933413 conn(0x7f41a80a32a0 msgr2=0x7f41a80a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:12.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.893+0000 7f41ace4f640 1 -- 172.21.15.122:0/1337933413 shutdown_connections 2024-09-15T12:41:12.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.893+0000 7f41ace4f640 1 -- 172.21.15.122:0/1337933413 wait complete. 2024-09-15T12:41:12.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.893+0000 7f41ace4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:12.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.895+0000 7f41ace4f640 1 Processor -- start 2024-09-15T12:41:12.898 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.895+0000 7f41ace4f640 1 -- start start 2024-09-15T12:41:12.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.896+0000 7f41ace4f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41a809e910 0x7f41a80990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:12.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.896+0000 7f41ace4f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f41a8099850 con 0x7f41a809e910 2024-09-15T12:41:12.900 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.896+0000 7f41a659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41a809e910 0x7f41a80990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:12.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.896+0000 7f41a659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41a809e910 0x7f41a80990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43466/0 (socket says 172.21.15.122:43466) 2024-09-15T12:41:12.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.896+0000 7f41a659c640 1 -- 172.21.15.122:0/727029509 learned_addr learned my addr 172.21.15.122:0/727029509 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:12.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.896+0000 7f41a659c640 1 -- 172.21.15.122:0/727029509 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a8097a30 con 0x7f41a809e910 2024-09-15T12:41:12.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.897+0000 7f41a659c640 1 --2- 172.21.15.122:0/727029509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41a809e910 0x7f41a80990e0 crc :-1 s=READY pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:12.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.897+0000 7f4196ffd640 1 -- 172.21.15.122:0/727029509 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4198005a60 con 0x7f41a809e910 2024-09-15T12:41:12.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.897+0000 7f4196ffd640 1 -- 172.21.15.122:0/727029509 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4198005bc0 con 0x7f41a809e910 2024-09-15T12:41:12.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.897+0000 7f41ace4f640 1 -- 172.21.15.122:0/727029509 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a8071790 con 0x7f41a809e910 2024-09-15T12:41:12.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.897+0000 7f4196ffd640 1 -- 172.21.15.122:0/727029509 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4198005e60 con 0x7f41a809e910 2024-09-15T12:41:12.901 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.897+0000 7f41ace4f640 1 -- 172.21.15.122:0/727029509 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a8099e90 con 0x7f41a809e910 2024-09-15T12:41:12.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.898+0000 7f41ace4f640 1 -- 172.21.15.122:0/727029509 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a8068d40 con 0x7f41a809e910 2024-09-15T12:41:12.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.898+0000 7f4196ffd640 1 -- 172.21.15.122:0/727029509 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f41980070b0 con 0x7f41a809e910 2024-09-15T12:41:12.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.898+0000 7f4196ffd640 1 --2- 172.21.15.122:0/727029509 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f418803e930 0x7f4188040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:12.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.898+0000 7f4196ffd640 1 -- 172.21.15.122:0/727029509 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(720..720 src has 621..720) ==== 3431+0+0 (crc 0 0 0) 0x7f419804f960 con 0x7f41a809e910 2024-09-15T12:41:12.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.898+0000 7f41a5d9b640 1 --2- 172.21.15.122:0/727029509 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f418803e930 0x7f4188040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:12.902 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.899+0000 7f41a5d9b640 1 --2- 172.21.15.122:0/727029509 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f418803e930 0x7f4188040e40 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:12.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:12.903+0000 7f4196ffd640 1 -- 172.21.15.122:0/727029509 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f419800dc60 con 0x7f41a809e910 2024-09-15T12:41:13.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:13.077+0000 7f41ace4f640 1 -- 172.21.15.122:0/727029509 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41a806c3b0 con 0x7f41a809e910 2024-09-15T12:41:13.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:13.078+0000 7f4196ffd640 1 -- 172.21.15.122:0/727029509 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v720) ==== 74+0+11296 (crc 0 0 0) 0x7f4198021040 con 0x7f41a809e910 2024-09-15T12:41:13.080 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:41:13.081 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":720,"fsid":"a718c858-230d-4784-bf30-b6c766b34745","created":"2024-09-15T12:22:07.924324+0000","modified":"2024-09-15T12:41:11.174631+0000","last_up_change":"2024-09-15T12:22:16.394814+0000","last_in_change":"2024-09-15T12:22:10.047645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":200,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:22:16.402082+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T12:22:18.158875+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":75,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-09-15T12:27:19.134254+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"238","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9dec0d05-2ec1-4006-9d4a-5af98be8e5e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":707,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":2464407069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6801","nonce":2464407069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6805","nonce":2464407069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":2464407069}]},"public_addr":"172.21.15.122:6800/2464407069","cluster_addr":"172.21.15.122:6801/2464407069","heartbeat_back_addr":"172.21.15.122:6805/2464407069","heartbeat_front_addr":"172.21.15.122:6802/2464407069","state":["exists","up"]},{"osd":1,"uuid":"b0b12d81-07a4-4437-b931-939ed1a94383","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":707,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6803","nonce":3904627990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3904627990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6809","nonce":3904627990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3904627990}]},"public_addr":"172.21.15.122:6803/3904627990","cluster_addr":"172.21.15.122:6804/3904627990","heartbeat_back_addr":"172.21.15.122:6809/3904627990","heartbeat_front_addr":"172.21.15.122:6808/3904627990","state":["exists","up"]},{"osd":2,"uuid":"f4153355-ac6b-4693-bea0-9e8c15a6bd88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":707,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":3269009979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3269009979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3269009979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3269009979}]},"public_addr":"172.21.15.142:6803/3269009979","cluster_addr":"172.21.15.142:6804/3269009979","heartbeat_back_addr":"172.21.15.142:6802/3269009979","heartbeat_front_addr":"172.21.15.142:6805/3269009979","state":["exists","up"]},{"osd":3,"uuid":"70efb372-12e1-471e-a1f6-0d2814bbf30f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":707,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6811","nonce":2150609480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2150609480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":2150609480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2150609480}]},"public_addr":"172.21.15.142:6811/2150609480","cluster_addr":"172.21.15.142:6810/2150609480","heartbeat_back_addr":"172.21.15.142:6807/2150609480","heartbeat_front_addr":"172.21.15.142:6806/2150609480","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":100,"snaps":[{"begin":1,"length":4}]},{"pool":101,"snaps":[{"begin":2,"length":4},{"begin":7,"length":2}]},{"pool":102,"snaps":[{"begin":1,"length":6}]},{"pool":103,"snaps":[{"begin":2,"length":9},{"begin":14,"length":1}]},{"pool":104,"snaps":[{"begin":2,"length":1}]},{"pool":179,"snaps":[{"begin":1,"length":1}]},{"pool":180,"snaps":[{"begin":1,"length":1}]},{"pool":182,"snaps":[{"begin":1,"length":1}]},{"pool":183,"snaps":[{"begin":1,"length":2}]},{"pool":184,"snaps":[{"begin":3,"length":1}]},{"pool":187,"snaps":[{"begin":2,"length":2}]},{"pool":189,"snaps":[{"begin":3,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:41:13.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:13.080+0000 7f41ace4f640 1 -- 172.21.15.122:0/727029509 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f418803e930 msgr2=0x7f4188040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:13.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:13.080+0000 7f41ace4f640 1 --2- 172.21.15.122:0/727029509 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f418803e930 0x7f4188040e40 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:13.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:13.080+0000 7f41ace4f640 1 -- 172.21.15.122:0/727029509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41a809e910 msgr2=0x7f41a80990e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:13.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:13.080+0000 7f41ace4f640 1 --2- 172.21.15.122:0/727029509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41a809e910 0x7f41a80990e0 crc :-1 s=READY pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:13.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:13.080+0000 7f41ace4f640 1 -- 172.21.15.122:0/727029509 shutdown_connections 2024-09-15T12:41:13.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:13.080+0000 7f41ace4f640 1 --2- 172.21.15.122:0/727029509 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f418803e930 0x7f4188040e40 unknown :-1 s=CLOSED pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:13.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:13.080+0000 7f41ace4f640 1 --2- 172.21.15.122:0/727029509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41a809e910 0x7f41a80990e0 unknown :-1 s=CLOSED pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:13.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:13.080+0000 7f41ace4f640 1 -- 172.21.15.122:0/727029509 >> 172.21.15.122:0/727029509 conn(0x7f41a80a32a0 msgr2=0x7f41a80729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:13.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:13.080+0000 7f41ace4f640 1 -- 172.21.15.122:0/727029509 shutdown_connections 2024-09-15T12:41:13.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:13.080+0000 7f41ace4f640 1 -- 172.21.15.122:0/727029509 wait complete. 2024-09-15T12:41:14.099 INFO:tasks.ceph:Scrubbing osd.0 2024-09-15T12:41:14.099 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-15T12:41:14.223 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.213+0000 7f223da74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:14.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.222+0000 7f223da74640 1 Processor -- start 2024-09-15T12:41:14.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.222+0000 7f223da74640 1 -- start start 2024-09-15T12:41:14.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.223+0000 7f223da74640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f223809e330 0x7f22381390e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:14.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.223+0000 7f223da74640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f223809eda0 con 0x7f223809d810 2024-09-15T12:41:14.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.223+0000 7f223da74640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f22380a29e0 con 0x7f223809e330 2024-09-15T12:41:14.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.224+0000 7f22377fe640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f223809d810 0x7f223809dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56602/0 (socket says 172.21.15.122:56602) 2024-09-15T12:41:14.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.224+0000 7f22377fe640 1 -- 172.21.15.122:0/3584731839 learned_addr learned my addr 172.21.15.122:0/3584731839 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:41:14.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.224+0000 7f2236ffd640 1 --2- 172.21.15.122:0/3584731839 >> v2:172.21.15.122:3300/0 conn(0x7f223809e330 0x7f22381390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:14.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.224+0000 7f22367fc640 1 -- 172.21.15.122:0/3584731839 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2269090659 0 0) 0x7f223809eda0 con 0x7f223809d810 2024-09-15T12:41:14.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.224+0000 7f22367fc640 1 -- 172.21.15.122:0/3584731839 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2220003580 con 0x7f223809d810 2024-09-15T12:41:14.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.224+0000 7f2236ffd640 1 -- 172.21.15.122:0/3584731839 >> v1:172.21.15.122:6789/0 conn(0x7f223809d810 legacy=0x7f223809dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:14.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.224+0000 7f2236ffd640 1 -- 172.21.15.122:0/3584731839 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22380a27b0 con 0x7f223809e330 2024-09-15T12:41:14.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.224+0000 7f2236ffd640 1 --2- 172.21.15.122:0/3584731839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223809e330 0x7f22381390e0 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6275e2e7c931baa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:14.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.224+0000 7f22367fc640 1 -- 172.21.15.122:0/3584731839 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f222c00e040 con 0x7f223809e330 2024-09-15T12:41:14.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.224+0000 7f22367fc640 1 -- 172.21.15.122:0/3584731839 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f222c007670 con 0x7f223809e330 2024-09-15T12:41:14.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.224+0000 7f22367fc640 1 -- 172.21.15.122:0/3584731839 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f222c007910 con 0x7f223809e330 2024-09-15T12:41:14.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.225+0000 7f223da74640 1 -- 172.21.15.122:0/3584731839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223809e330 msgr2=0x7f22381390e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:14.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.225+0000 7f223da74640 1 --2- 172.21.15.122:0/3584731839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223809e330 0x7f22381390e0 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.225+0000 7f223da74640 1 -- 172.21.15.122:0/3584731839 shutdown_connections 2024-09-15T12:41:14.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.225+0000 7f223da74640 1 --2- 172.21.15.122:0/3584731839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223809e330 0x7f22381390e0 unknown :-1 s=CLOSED pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.225+0000 7f223da74640 1 -- 172.21.15.122:0/3584731839 >> 172.21.15.122:0/3584731839 conn(0x7f22380a31b0 msgr2=0x7f22380a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:14.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.225+0000 7f223da74640 1 -- 172.21.15.122:0/3584731839 shutdown_connections 2024-09-15T12:41:14.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.225+0000 7f223da74640 1 -- 172.21.15.122:0/3584731839 wait complete. 2024-09-15T12:41:14.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.225+0000 7f223da74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:14.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.227+0000 7f223da74640 1 Processor -- start 2024-09-15T12:41:14.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.227+0000 7f223da74640 1 -- start start 2024-09-15T12:41:14.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.228+0000 7f223da74640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223809d810 0x7f2238120730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:14.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.228+0000 7f223da74640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2238133440 con 0x7f223809d810 2024-09-15T12:41:14.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.228+0000 7f22377fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223809d810 0x7f2238120730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:14.232 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.228+0000 7f22377fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223809d810 0x7f2238120730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43488/0 (socket says 172.21.15.122:43488) 2024-09-15T12:41:14.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.228+0000 7f22377fe640 1 -- 172.21.15.122:0/4130841591 learned_addr learned my addr 172.21.15.122:0/4130841591 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:14.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.228+0000 7f22377fe640 1 -- 172.21.15.122:0/4130841591 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22381221e0 con 0x7f223809d810 2024-09-15T12:41:14.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.228+0000 7f22377fe640 1 --2- 172.21.15.122:0/4130841591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223809d810 0x7f2238120730 crc :-1 s=READY pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:14.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.228+0000 7f221ffff640 1 -- 172.21.15.122:0/4130841591 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2228005a60 con 0x7f223809d810 2024-09-15T12:41:14.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.228+0000 7f221ffff640 1 -- 172.21.15.122:0/4130841591 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2228005bc0 con 0x7f223809d810 2024-09-15T12:41:14.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.228+0000 7f223da74640 1 -- 172.21.15.122:0/4130841591 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2238121970 con 0x7f223809d810 2024-09-15T12:41:14.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.229+0000 7f221ffff640 1 -- 172.21.15.122:0/4130841591 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2228005e60 con 0x7f223809d810 2024-09-15T12:41:14.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.229+0000 7f223da74640 1 -- 172.21.15.122:0/4130841591 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2238123000 con 0x7f223809d810 2024-09-15T12:41:14.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.229+0000 7f223da74640 1 -- 172.21.15.122:0/4130841591 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f22380a19f0 con 0x7f223809d810 2024-09-15T12:41:14.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.230+0000 7f221ffff640 1 -- 172.21.15.122:0/4130841591 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f22280070b0 con 0x7f223809d810 2024-09-15T12:41:14.233 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.230+0000 7f221ffff640 1 --2- 172.21.15.122:0/4130841591 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f222403e930 0x7f2224040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:14.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.230+0000 7f221ffff640 1 -- 172.21.15.122:0/4130841591 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(720..720 src has 621..720) ==== 3431+0+0 (crc 0 0 0) 0x7f222804f930 con 0x7f223809d810 2024-09-15T12:41:14.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.230+0000 7f221ffff640 1 --2- 172.21.15.122:0/4130841591 >> v2:172.21.15.122:6800/2464407069 conn(0x7f2224044a70 0x7f2224046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:14.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.230+0000 7f221ffff640 1 -- 172.21.15.122:0/4130841591 --> v2:172.21.15.122:6800/2464407069 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22240475f0 con 0x7f2224044a70 2024-09-15T12:41:14.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.230+0000 7f221ffff640 1 -- 172.21.15.122:0/4130841591 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=720) ==== 24+0+0 (crc 0 0 0) 0x7f222804fd40 con 0x7f223809d810 2024-09-15T12:41:14.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.230+0000 7f2236ffd640 1 --2- 172.21.15.122:0/4130841591 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f222403e930 0x7f2224040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:14.234 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.231+0000 7f2236ffd640 1 --2- 172.21.15.122:0/4130841591 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f222403e930 0x7f2224040e40 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:14.235 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.231+0000 7f2237fff640 1 --2- 172.21.15.122:0/4130841591 >> v2:172.21.15.122:6800/2464407069 conn(0x7f2224044a70 0x7f2224046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:41:14.236 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.234+0000 7f2237fff640 1 --2- 172.21.15.122:0/4130841591 >> v2:172.21.15.122:6800/2464407069 conn(0x7f2224044a70 0x7f2224046f60 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:14.238 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.236+0000 7f221ffff640 1 -- 172.21.15.122:0/4130841591 <== osd.0 v2:172.21.15.122:6800/2464407069 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f22240475f0 con 0x7f2224044a70 2024-09-15T12:41:14.241 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.239+0000 7f223da74640 1 -- 172.21.15.122:0/4130841591 --> v2:172.21.15.122:6800/2464407069 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f223809e580 con 0x7f2224044a70 2024-09-15T12:41:14.243 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.241+0000 7f221ffff640 1 -- 172.21.15.122:0/4130841591 <== osd.0 v2:172.21.15.122:6800/2464407069 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f223809e580 con 0x7f2224044a70 2024-09-15T12:41:14.243 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-15T12:41:14.243 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "" 2024-09-15T12:41:14.243 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-15T12:41:14.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.241+0000 7f223da74640 1 -- 172.21.15.122:0/4130841591 >> v2:172.21.15.122:6800/2464407069 conn(0x7f2224044a70 msgr2=0x7f2224046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:14.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.241+0000 7f223da74640 1 --2- 172.21.15.122:0/4130841591 >> v2:172.21.15.122:6800/2464407069 conn(0x7f2224044a70 0x7f2224046f60 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.241+0000 7f223da74640 1 -- 172.21.15.122:0/4130841591 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f222403e930 msgr2=0x7f2224040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:14.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.241+0000 7f223da74640 1 --2- 172.21.15.122:0/4130841591 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f222403e930 0x7f2224040e40 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.241+0000 7f223da74640 1 -- 172.21.15.122:0/4130841591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223809d810 msgr2=0x7f2238120730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:14.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.241+0000 7f223da74640 1 --2- 172.21.15.122:0/4130841591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223809d810 0x7f2238120730 crc :-1 s=READY pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.241+0000 7f223da74640 1 -- 172.21.15.122:0/4130841591 shutdown_connections 2024-09-15T12:41:14.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.241+0000 7f223da74640 1 --2- 172.21.15.122:0/4130841591 >> v2:172.21.15.122:6800/2464407069 conn(0x7f2224044a70 0x7f2224046f60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.241+0000 7f223da74640 1 --2- 172.21.15.122:0/4130841591 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f222403e930 0x7f2224040e40 unknown :-1 s=CLOSED pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.241+0000 7f223da74640 1 --2- 172.21.15.122:0/4130841591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223809d810 0x7f2238120730 unknown :-1 s=CLOSED pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.241+0000 7f223da74640 1 -- 172.21.15.122:0/4130841591 >> 172.21.15.122:0/4130841591 conn(0x7f22380a31b0 msgr2=0x7f22380a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:14.245 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.242+0000 7f223da74640 1 -- 172.21.15.122:0/4130841591 shutdown_connections 2024-09-15T12:41:14.246 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.242+0000 7f223da74640 1 -- 172.21.15.122:0/4130841591 wait complete. 2024-09-15T12:41:14.255 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-15T12:41:14.363 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.356+0000 7f5337c9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:14.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.362+0000 7f5337c9c640 1 Processor -- start 2024-09-15T12:41:14.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.362+0000 7f5337c9c640 1 -- start start 2024-09-15T12:41:14.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.363+0000 7f5337c9c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5330132790 0x7f5330132ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:14.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.363+0000 7f5337c9c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5330098840 con 0x7f533009b680 2024-09-15T12:41:14.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.363+0000 7f5337c9c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f533009ac90 con 0x7f5330132790 2024-09-15T12:41:14.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.364+0000 7f5335a38640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5330132790 0x7f5330132ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:14.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.364+0000 7f5335a38640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5330132790 0x7f5330132ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43490/0 (socket says 172.21.15.122:43490) 2024-09-15T12:41:14.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.364+0000 7f5335a38640 1 -- 172.21.15.122:0/3946548288 learned_addr learned my addr 172.21.15.122:0/3946548288 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:14.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.364+0000 7f5335237640 1 --1- 172.21.15.122:0/3946548288 >> v1:172.21.15.122:6789/0 conn(0x7f533009b680 0x7f533009ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56604/0 (socket says 172.21.15.122:56604) 2024-09-15T12:41:14.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.364+0000 7f5335a38640 1 -- 172.21.15.122:0/3946548288 >> v1:172.21.15.122:6789/0 conn(0x7f533009b680 legacy=0x7f533009ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:14.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.364+0000 7f5335a38640 1 -- 172.21.15.122:0/3946548288 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533009cb70 con 0x7f5330132790 2024-09-15T12:41:14.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.364+0000 7f5334a36640 1 -- 172.21.15.122:0/3946548288 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4284864041 0 0) 0x7f5330098840 con 0x7f533009b680 2024-09-15T12:41:14.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.364+0000 7f5335a38640 1 --2- 172.21.15.122:0/3946548288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5330132790 0x7f5330132ba0 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419ce9d043025006 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:14.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.364+0000 7f5334a36640 1 -- 172.21.15.122:0/3946548288 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f532c00d580 con 0x7f5330132790 2024-09-15T12:41:14.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.364+0000 7f5334a36640 1 -- 172.21.15.122:0/3946548288 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f532c00d6e0 con 0x7f5330132790 2024-09-15T12:41:14.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.364+0000 7f5334a36640 1 -- 172.21.15.122:0/3946548288 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f532c00d980 con 0x7f5330132790 2024-09-15T12:41:14.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.365+0000 7f5337c9c640 1 -- 172.21.15.122:0/3946548288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5330132790 msgr2=0x7f5330132ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:14.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.365+0000 7f5337c9c640 1 --2- 172.21.15.122:0/3946548288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5330132790 0x7f5330132ba0 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.365+0000 7f5337c9c640 1 -- 172.21.15.122:0/3946548288 shutdown_connections 2024-09-15T12:41:14.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.365+0000 7f5337c9c640 1 --2- 172.21.15.122:0/3946548288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5330132790 0x7f5330132ba0 unknown :-1 s=CLOSED pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.365+0000 7f5337c9c640 1 -- 172.21.15.122:0/3946548288 >> 172.21.15.122:0/3946548288 conn(0x7f53300a11f0 msgr2=0x7f53300a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:14.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.365+0000 7f5337c9c640 1 -- 172.21.15.122:0/3946548288 shutdown_connections 2024-09-15T12:41:14.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.365+0000 7f5337c9c640 1 -- 172.21.15.122:0/3946548288 wait complete. 2024-09-15T12:41:14.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.365+0000 7f5337c9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:14.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.367+0000 7f5337c9c640 1 Processor -- start 2024-09-15T12:41:14.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.367+0000 7f5337c9c640 1 -- start start 2024-09-15T12:41:14.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.368+0000 7f5337c9c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009b680 0x7f5330129a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:14.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.368+0000 7f5337c9c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f533009c960 con 0x7f533009b680 2024-09-15T12:41:14.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.368+0000 7f5335a38640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009b680 0x7f5330129a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:14.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.368+0000 7f5335a38640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009b680 0x7f5330129a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43492/0 (socket says 172.21.15.122:43492) 2024-09-15T12:41:14.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.368+0000 7f5335a38640 1 -- 172.21.15.122:0/908942933 learned_addr learned my addr 172.21.15.122:0/908942933 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:14.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.368+0000 7f5335a38640 1 -- 172.21.15.122:0/908942933 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53301296b0 con 0x7f533009b680 2024-09-15T12:41:14.372 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.368+0000 7f5335a38640 1 --2- 172.21.15.122:0/908942933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009b680 0x7f5330129a70 crc :-1 s=READY pgs=12983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:14.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.368+0000 7f53267fc640 1 -- 172.21.15.122:0/908942933 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f532c00c880 con 0x7f533009b680 2024-09-15T12:41:14.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.368+0000 7f53267fc640 1 -- 172.21.15.122:0/908942933 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f532c00c9e0 con 0x7f533009b680 2024-09-15T12:41:14.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.368+0000 7f5337c9c640 1 -- 172.21.15.122:0/908942933 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533012cc40 con 0x7f533009b680 2024-09-15T12:41:14.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.368+0000 7f53267fc640 1 -- 172.21.15.122:0/908942933 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f532c00cc80 con 0x7f533009b680 2024-09-15T12:41:14.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.368+0000 7f5337c9c640 1 -- 172.21.15.122:0/908942933 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5330129350 con 0x7f533009b680 2024-09-15T12:41:14.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.369+0000 7f5337c9c640 1 -- 172.21.15.122:0/908942933 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f533009e480 con 0x7f533009b680 2024-09-15T12:41:14.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.370+0000 7f53267fc640 1 -- 172.21.15.122:0/908942933 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f532c015040 con 0x7f533009b680 2024-09-15T12:41:14.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.370+0000 7f53267fc640 1 --2- 172.21.15.122:0/908942933 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f531403e930 0x7f5314040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:14.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.370+0000 7f53267fc640 1 -- 172.21.15.122:0/908942933 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(720..720 src has 621..720) ==== 3431+0+0 (crc 0 0 0) 0x7f532c012040 con 0x7f533009b680 2024-09-15T12:41:14.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.370+0000 7f5335237640 1 --2- 172.21.15.122:0/908942933 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f531403e930 0x7f5314040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:14.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.371+0000 7f5335237640 1 --2- 172.21.15.122:0/908942933 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f531403e930 0x7f5314040e40 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:14.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.375+0000 7f53267fc640 1 -- 172.21.15.122:0/908942933 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f532c0175c0 con 0x7f533009b680 2024-09-15T12:41:14.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.551+0000 7f5337c9c640 1 -- 172.21.15.122:0/908942933 --> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f533009df90 con 0x7f531403e930 2024-09-15T12:41:14.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.552+0000 7f53267fc640 1 -- 172.21.15.122:0/908942933 <== mgr.4100 v2:172.21.15.142:6800/73136857 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f53200070b0 con 0x7f531403e930 2024-09-15T12:41:14.554 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 0 to deep-scrub 2024-09-15T12:41:14.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.555+0000 7f5337c9c640 1 -- 172.21.15.122:0/908942933 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f531403e930 msgr2=0x7f5314040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:14.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.555+0000 7f5337c9c640 1 --2- 172.21.15.122:0/908942933 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f531403e930 0x7f5314040e40 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.555+0000 7f5337c9c640 1 -- 172.21.15.122:0/908942933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009b680 msgr2=0x7f5330129a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:14.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.555+0000 7f5337c9c640 1 --2- 172.21.15.122:0/908942933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009b680 0x7f5330129a70 crc :-1 s=READY pgs=12983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.555+0000 7f5337c9c640 1 -- 172.21.15.122:0/908942933 shutdown_connections 2024-09-15T12:41:14.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.555+0000 7f5337c9c640 1 --2- 172.21.15.122:0/908942933 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f531403e930 0x7f5314040e40 unknown :-1 s=CLOSED pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.555+0000 7f5337c9c640 1 --2- 172.21.15.122:0/908942933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533009b680 0x7f5330129a70 unknown :-1 s=CLOSED pgs=12983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.555+0000 7f5337c9c640 1 -- 172.21.15.122:0/908942933 >> 172.21.15.122:0/908942933 conn(0x7f53300a11f0 msgr2=0x7f53300a2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:14.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.555+0000 7f5337c9c640 1 -- 172.21.15.122:0/908942933 shutdown_connections 2024-09-15T12:41:14.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.555+0000 7f5337c9c640 1 -- 172.21.15.122:0/908942933 wait complete. 2024-09-15T12:41:14.578 INFO:tasks.ceph:Scrubbing osd.1 2024-09-15T12:41:14.578 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-15T12:41:14.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.681+0000 7fe176591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:14.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.691+0000 7fe176591640 1 Processor -- start 2024-09-15T12:41:14.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.691+0000 7fe176591640 1 -- start start 2024-09-15T12:41:14.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.692+0000 7fe176591640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe17009b7f0 0x7fe17009bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:14.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.692+0000 7fe176591640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17006f150 con 0x7fe17009c140 2024-09-15T12:41:14.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.692+0000 7fe176591640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fe17009d620 con 0x7fe17009b7f0 2024-09-15T12:41:14.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.692+0000 7fe16ffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe17009b7f0 0x7fe17009bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:14.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.692+0000 7fe16ffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe17009b7f0 0x7fe17009bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43502/0 (socket says 172.21.15.122:43502) 2024-09-15T12:41:14.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.692+0000 7fe167fff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fe17009c140 0x7fe170136460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56610/0 (socket says 172.21.15.122:56610) 2024-09-15T12:41:14.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.692+0000 7fe16ffff640 1 -- 172.21.15.122:0/2639802220 learned_addr learned my addr 172.21.15.122:0/2639802220 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:14.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.692+0000 7fe16ffff640 1 -- 172.21.15.122:0/2639802220 >> v1:172.21.15.122:6789/0 conn(0x7fe17009c140 legacy=0x7fe170136460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:14.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.692+0000 7fe16ffff640 1 -- 172.21.15.122:0/2639802220 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17009e090 con 0x7fe17009b7f0 2024-09-15T12:41:14.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.692+0000 7fe16ffff640 1 --2- 172.21.15.122:0/2639802220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe17009b7f0 0x7fe17009bc00 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af70ca276e294d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:14.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.693+0000 7fe16f7fe640 1 -- 172.21.15.122:0/2639802220 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe16000e040 con 0x7fe17009b7f0 2024-09-15T12:41:14.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.693+0000 7fe16f7fe640 1 -- 172.21.15.122:0/2639802220 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe160007c10 con 0x7fe17009b7f0 2024-09-15T12:41:14.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.693+0000 7fe16f7fe640 1 -- 172.21.15.122:0/2639802220 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe1600090b0 con 0x7fe17009b7f0 2024-09-15T12:41:14.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.693+0000 7fe176591640 1 -- 172.21.15.122:0/2639802220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe17009b7f0 msgr2=0x7fe17009bc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:14.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.693+0000 7fe176591640 1 --2- 172.21.15.122:0/2639802220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe17009b7f0 0x7fe17009bc00 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.693+0000 7fe176591640 1 -- 172.21.15.122:0/2639802220 shutdown_connections 2024-09-15T12:41:14.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.693+0000 7fe176591640 1 --2- 172.21.15.122:0/2639802220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe17009b7f0 0x7fe17009bc00 unknown :-1 s=CLOSED pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.693+0000 7fe176591640 1 -- 172.21.15.122:0/2639802220 >> 172.21.15.122:0/2639802220 conn(0x7fe1700a1580 msgr2=0x7fe17009ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:14.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.693+0000 7fe176591640 1 -- 172.21.15.122:0/2639802220 shutdown_connections 2024-09-15T12:41:14.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.693+0000 7fe176591640 1 -- 172.21.15.122:0/2639802220 wait complete. 2024-09-15T12:41:14.697 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.694+0000 7fe176591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:14.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.695+0000 7fe176591640 1 Processor -- start 2024-09-15T12:41:14.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.695+0000 7fe176591640 1 -- start start 2024-09-15T12:41:14.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.696+0000 7fe176591640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe17009b7f0 0x7fe1700971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:14.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.696+0000 7fe176591640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe17009acc0 con 0x7fe17009b7f0 2024-09-15T12:41:14.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.697+0000 7fe16ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe17009b7f0 0x7fe1700971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:14.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.697+0000 7fe16ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe17009b7f0 0x7fe1700971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43508/0 (socket says 172.21.15.122:43508) 2024-09-15T12:41:14.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.697+0000 7fe16ffff640 1 -- 172.21.15.122:0/3141883140 learned_addr learned my addr 172.21.15.122:0/3141883140 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:14.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.697+0000 7fe16ffff640 1 -- 172.21.15.122:0/3141883140 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17009af80 con 0x7fe17009b7f0 2024-09-15T12:41:14.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.697+0000 7fe16ffff640 1 --2- 172.21.15.122:0/3141883140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe17009b7f0 0x7fe1700971f0 crc :-1 s=READY pgs=12986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:14.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.697+0000 7fe16d7fa640 1 -- 172.21.15.122:0/3141883140 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe16000e040 con 0x7fe17009b7f0 2024-09-15T12:41:14.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.697+0000 7fe176591640 1 -- 172.21.15.122:0/3141883140 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe170095b40 con 0x7fe17009b7f0 2024-09-15T12:41:14.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.697+0000 7fe16d7fa640 1 -- 172.21.15.122:0/3141883140 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe160009670 con 0x7fe17009b7f0 2024-09-15T12:41:14.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.697+0000 7fe16d7fa640 1 -- 172.21.15.122:0/3141883140 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe1600143e0 con 0x7fe17009b7f0 2024-09-15T12:41:14.700 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.697+0000 7fe176591640 1 -- 172.21.15.122:0/3141883140 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe170097fa0 con 0x7fe17009b7f0 2024-09-15T12:41:14.701 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.698+0000 7fe176591640 1 -- 172.21.15.122:0/3141883140 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe170097e30 con 0x7fe17009b7f0 2024-09-15T12:41:14.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.698+0000 7fe16d7fa640 1 -- 172.21.15.122:0/3141883140 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe160011040 con 0x7fe17009b7f0 2024-09-15T12:41:14.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.698+0000 7fe16d7fa640 1 --2- 172.21.15.122:0/3141883140 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fe15003e8e0 0x7fe150040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:14.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.698+0000 7fe16d7fa640 1 -- 172.21.15.122:0/3141883140 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(720..720 src has 621..720) ==== 3431+0+0 (crc 0 0 0) 0x7fe160050aa0 con 0x7fe17009b7f0 2024-09-15T12:41:14.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.699+0000 7fe16d7fa640 1 --2- 172.21.15.122:0/3141883140 >> v2:172.21.15.122:6803/3904627990 conn(0x7fe150044a80 0x7fe150046f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:14.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.699+0000 7fe16d7fa640 1 -- 172.21.15.122:0/3141883140 --> v2:172.21.15.122:6803/3904627990 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe150047600 con 0x7fe150044a80 2024-09-15T12:41:14.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.699+0000 7fe16d7fa640 1 -- 172.21.15.122:0/3141883140 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=720) ==== 24+0+0 (crc 0 0 0) 0x7fe160050f30 con 0x7fe17009b7f0 2024-09-15T12:41:14.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.699+0000 7fe167fff640 1 --2- 172.21.15.122:0/3141883140 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fe15003e8e0 0x7fe150040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:14.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.699+0000 7fe167fff640 1 --2- 172.21.15.122:0/3141883140 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fe15003e8e0 0x7fe150040df0 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:14.702 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.699+0000 7fe174b2e640 1 --2- 172.21.15.122:0/3141883140 >> v2:172.21.15.122:6803/3904627990 conn(0x7fe150044a80 0x7fe150046f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:41:14.705 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.703+0000 7fe174b2e640 1 --2- 172.21.15.122:0/3141883140 >> v2:172.21.15.122:6803/3904627990 conn(0x7fe150044a80 0x7fe150046f70 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:14.706 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.704+0000 7fe16d7fa640 1 -- 172.21.15.122:0/3141883140 <== osd.1 v2:172.21.15.122:6803/3904627990 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7fe150047600 con 0x7fe150044a80 2024-09-15T12:41:14.710 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.708+0000 7fe176591640 1 -- 172.21.15.122:0/3141883140 --> v2:172.21.15.122:6803/3904627990 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe17006e9b0 con 0x7fe150044a80 2024-09-15T12:41:14.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.709+0000 7fe16d7fa640 1 -- 172.21.15.122:0/3141883140 <== osd.1 v2:172.21.15.122:6803/3904627990 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7fe17006e9b0 con 0x7fe150044a80 2024-09-15T12:41:14.712 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-15T12:41:14.712 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "" 2024-09-15T12:41:14.712 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-15T12:41:14.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.710+0000 7fe176591640 1 -- 172.21.15.122:0/3141883140 >> v2:172.21.15.122:6803/3904627990 conn(0x7fe150044a80 msgr2=0x7fe150046f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:14.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.710+0000 7fe176591640 1 --2- 172.21.15.122:0/3141883140 >> v2:172.21.15.122:6803/3904627990 conn(0x7fe150044a80 0x7fe150046f70 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.710+0000 7fe176591640 1 -- 172.21.15.122:0/3141883140 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fe15003e8e0 msgr2=0x7fe150040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:14.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.710+0000 7fe176591640 1 --2- 172.21.15.122:0/3141883140 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fe15003e8e0 0x7fe150040df0 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.710+0000 7fe176591640 1 -- 172.21.15.122:0/3141883140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe17009b7f0 msgr2=0x7fe1700971f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:14.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.710+0000 7fe176591640 1 --2- 172.21.15.122:0/3141883140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe17009b7f0 0x7fe1700971f0 crc :-1 s=READY pgs=12986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.710+0000 7fe176591640 1 -- 172.21.15.122:0/3141883140 shutdown_connections 2024-09-15T12:41:14.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.710+0000 7fe176591640 1 --2- 172.21.15.122:0/3141883140 >> v2:172.21.15.122:6803/3904627990 conn(0x7fe150044a80 0x7fe150046f70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.710+0000 7fe176591640 1 --2- 172.21.15.122:0/3141883140 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fe15003e8e0 0x7fe150040df0 unknown :-1 s=CLOSED pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.710+0000 7fe176591640 1 --2- 172.21.15.122:0/3141883140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe17009b7f0 0x7fe1700971f0 unknown :-1 s=CLOSED pgs=12986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.710+0000 7fe176591640 1 -- 172.21.15.122:0/3141883140 >> 172.21.15.122:0/3141883140 conn(0x7fe1700a1580 msgr2=0x7fe170073040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:14.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.710+0000 7fe176591640 1 -- 172.21.15.122:0/3141883140 shutdown_connections 2024-09-15T12:41:14.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.710+0000 7fe176591640 1 -- 172.21.15.122:0/3141883140 wait complete. 2024-09-15T12:41:14.724 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-15T12:41:14.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.825+0000 7fc106f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:14.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.831+0000 7fc106f91640 1 Processor -- start 2024-09-15T12:41:14.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.831+0000 7fc106f91640 1 -- start start 2024-09-15T12:41:14.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.832+0000 7fc106f91640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc100130250 0x7fc100137ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:14.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.832+0000 7fc106f91640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc10009ddb0 con 0x7fc10012f730 2024-09-15T12:41:14.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.832+0000 7fc106f91640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fc10009dfe0 con 0x7fc100130250 2024-09-15T12:41:14.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.833+0000 7fc104d2d640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fc10012f730 0x7fc10012fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56612/0 (socket says 172.21.15.122:56612) 2024-09-15T12:41:14.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.833+0000 7fc104d2d640 1 -- 172.21.15.122:0/1789834828 learned_addr learned my addr 172.21.15.122:0/1789834828 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:41:14.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.833+0000 7fc0fffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc100130250 0x7fc100137ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:14.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.833+0000 7fc0fffff640 1 -- 172.21.15.122:0/1789834828 >> v1:172.21.15.122:6789/0 conn(0x7fc10012f730 legacy=0x7fc10012fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:14.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.833+0000 7fc0fffff640 1 -- 172.21.15.122:0/1789834828 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc100098180 con 0x7fc100130250 2024-09-15T12:41:14.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.833+0000 7fc0fffff640 1 --2- 172.21.15.122:0/1789834828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc100130250 0x7fc100137ec0 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02c1ae31e85443a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:14.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.833+0000 7fc0ff7fe640 1 -- 172.21.15.122:0/1789834828 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc0f4009d90 con 0x7fc100130250 2024-09-15T12:41:14.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.833+0000 7fc0ff7fe640 1 -- 172.21.15.122:0/1789834828 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc0f400e230 con 0x7fc100130250 2024-09-15T12:41:14.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.833+0000 7fc0ff7fe640 1 -- 172.21.15.122:0/1789834828 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc0f400e4d0 con 0x7fc100130250 2024-09-15T12:41:14.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.834+0000 7fc106f91640 1 -- 172.21.15.122:0/1789834828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc100130250 msgr2=0x7fc100137ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:14.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.834+0000 7fc106f91640 1 --2- 172.21.15.122:0/1789834828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc100130250 0x7fc100137ec0 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.834+0000 7fc106f91640 1 -- 172.21.15.122:0/1789834828 shutdown_connections 2024-09-15T12:41:14.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.834+0000 7fc106f91640 1 --2- 172.21.15.122:0/1789834828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc100130250 0x7fc100137ec0 unknown :-1 s=CLOSED pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:14.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.834+0000 7fc106f91640 1 -- 172.21.15.122:0/1789834828 >> 172.21.15.122:0/1789834828 conn(0x7fc1000a11f0 msgr2=0x7fc1000a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:14.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.834+0000 7fc106f91640 1 -- 172.21.15.122:0/1789834828 shutdown_connections 2024-09-15T12:41:14.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.834+0000 7fc106f91640 1 -- 172.21.15.122:0/1789834828 wait complete. 2024-09-15T12:41:14.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.834+0000 7fc106f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:14.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.836+0000 7fc106f91640 1 Processor -- start 2024-09-15T12:41:14.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.836+0000 7fc106f91640 1 -- start start 2024-09-15T12:41:14.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.837+0000 7fc106f91640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc10012f730 0x7fc10006efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:14.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.837+0000 7fc106f91640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc100071a40 con 0x7fc10012f730 2024-09-15T12:41:14.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.837+0000 7fc104d2d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc10012f730 0x7fc10006efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:14.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.837+0000 7fc104d2d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc10012f730 0x7fc10006efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43522/0 (socket says 172.21.15.122:43522) 2024-09-15T12:41:14.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.837+0000 7fc104d2d640 1 -- 172.21.15.122:0/2809676063 learned_addr learned my addr 172.21.15.122:0/2809676063 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:14.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.838+0000 7fc104d2d640 1 -- 172.21.15.122:0/2809676063 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10012eb40 con 0x7fc10012f730 2024-09-15T12:41:14.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.838+0000 7fc104d2d640 1 --2- 172.21.15.122:0/2809676063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc10012f730 0x7fc10006efd0 crc :-1 s=READY pgs=12989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:14.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.838+0000 7fc0fd7fa640 1 -- 172.21.15.122:0/2809676063 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc0f000f570 con 0x7fc10012f730 2024-09-15T12:41:14.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.838+0000 7fc0fd7fa640 1 -- 172.21.15.122:0/2809676063 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc0f000f6d0 con 0x7fc10012f730 2024-09-15T12:41:14.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.838+0000 7fc106f91640 1 -- 172.21.15.122:0/2809676063 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc100071730 con 0x7fc10012f730 2024-09-15T12:41:14.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.838+0000 7fc0fd7fa640 1 -- 172.21.15.122:0/2809676063 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc0f000f970 con 0x7fc10012f730 2024-09-15T12:41:14.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.838+0000 7fc106f91640 1 -- 172.21.15.122:0/2809676063 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc100074a50 con 0x7fc10012f730 2024-09-15T12:41:14.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.839+0000 7fc106f91640 1 -- 172.21.15.122:0/2809676063 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc10012fb40 con 0x7fc10012f730 2024-09-15T12:41:14.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.839+0000 7fc0fd7fa640 1 -- 172.21.15.122:0/2809676063 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc0f000fb20 con 0x7fc10012f730 2024-09-15T12:41:14.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.839+0000 7fc0fd7fa640 1 --2- 172.21.15.122:0/2809676063 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc0ec03e930 0x7fc0ec040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:14.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.840+0000 7fc0fd7fa640 1 -- 172.21.15.122:0/2809676063 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(720..720 src has 621..720) ==== 3431+0+0 (crc 0 0 0) 0x7fc0f0053180 con 0x7fc10012f730 2024-09-15T12:41:14.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.840+0000 7fc0fffff640 1 --2- 172.21.15.122:0/2809676063 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc0ec03e930 0x7fc0ec040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:14.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.840+0000 7fc0fffff640 1 --2- 172.21.15.122:0/2809676063 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc0ec03e930 0x7fc0ec040e40 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:14.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:14.845+0000 7fc0fd7fa640 1 -- 172.21.15.122:0/2809676063 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc0f00070b0 con 0x7fc10012f730 2024-09-15T12:41:15.022 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.020+0000 7fc106f91640 1 -- 172.21.15.122:0/2809676063 --> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fc10012e570 con 0x7fc0ec03e930 2024-09-15T12:41:15.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.021+0000 7fc0fd7fa640 1 -- 172.21.15.122:0/2809676063 <== mgr.4100 v2:172.21.15.142:6800/73136857 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fc0f4009e80 con 0x7fc0ec03e930 2024-09-15T12:41:15.023 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 1 to deep-scrub 2024-09-15T12:41:15.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.023+0000 7fc106f91640 1 -- 172.21.15.122:0/2809676063 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc0ec03e930 msgr2=0x7fc0ec040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.023+0000 7fc106f91640 1 --2- 172.21.15.122:0/2809676063 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc0ec03e930 0x7fc0ec040e40 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.023+0000 7fc106f91640 1 -- 172.21.15.122:0/2809676063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc10012f730 msgr2=0x7fc10006efd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.023+0000 7fc106f91640 1 --2- 172.21.15.122:0/2809676063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc10012f730 0x7fc10006efd0 crc :-1 s=READY pgs=12989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.023+0000 7fc106f91640 1 -- 172.21.15.122:0/2809676063 shutdown_connections 2024-09-15T12:41:15.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.023+0000 7fc106f91640 1 --2- 172.21.15.122:0/2809676063 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc0ec03e930 0x7fc0ec040e40 unknown :-1 s=CLOSED pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.023+0000 7fc106f91640 1 --2- 172.21.15.122:0/2809676063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc10012f730 0x7fc10006efd0 unknown :-1 s=CLOSED pgs=12989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.023+0000 7fc106f91640 1 -- 172.21.15.122:0/2809676063 >> 172.21.15.122:0/2809676063 conn(0x7fc1000a11f0 msgr2=0x7fc100099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:15.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.023+0000 7fc106f91640 1 -- 172.21.15.122:0/2809676063 shutdown_connections 2024-09-15T12:41:15.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.023+0000 7fc106f91640 1 -- 172.21.15.122:0/2809676063 wait complete. 2024-09-15T12:41:15.040 INFO:tasks.ceph:Scrubbing osd.2 2024-09-15T12:41:15.040 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-15T12:41:15.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.145+0000 7efdd2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:15.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.154+0000 7efdd2f91640 1 Processor -- start 2024-09-15T12:41:15.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.154+0000 7efdd2f91640 1 -- start start 2024-09-15T12:41:15.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.155+0000 7efdd2f91640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efdcc069860 0x7efdcc139390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:15.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.155+0000 7efdd2f91640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdcc09f040 con 0x7efdcc068d40 2024-09-15T12:41:15.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.155+0000 7efdd2f91640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7efdcc09c1c0 con 0x7efdcc069860 2024-09-15T12:41:15.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.156+0000 7efdcbfff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efdcc069860 0x7efdcc139390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:15.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.156+0000 7efdcbfff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efdcc069860 0x7efdcc139390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43524/0 (socket says 172.21.15.122:43524) 2024-09-15T12:41:15.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.156+0000 7efdcbfff640 1 -- 172.21.15.122:0/3446938177 learned_addr learned my addr 172.21.15.122:0/3446938177 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:15.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.156+0000 7efdd0d2d640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7efdcc068d40 0x7efdcc069150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56620/0 (socket says 172.21.15.122:56620) 2024-09-15T12:41:15.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.156+0000 7efdcbfff640 1 -- 172.21.15.122:0/3446938177 >> v1:172.21.15.122:6789/0 conn(0x7efdcc068d40 legacy=0x7efdcc069150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.156+0000 7efdcbfff640 1 -- 172.21.15.122:0/3446938177 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdcc070960 con 0x7efdcc069860 2024-09-15T12:41:15.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.156+0000 7efdcbfff640 1 --2- 172.21.15.122:0/3446938177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc069860 0x7efdcc139390 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e624f975f25b3c51 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:15.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.156+0000 7efdcb7fe640 1 -- 172.21.15.122:0/3446938177 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efdc0009e50 con 0x7efdcc069860 2024-09-15T12:41:15.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.156+0000 7efdcb7fe640 1 -- 172.21.15.122:0/3446938177 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efdc000e230 con 0x7efdcc069860 2024-09-15T12:41:15.159 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.156+0000 7efdcb7fe640 1 -- 172.21.15.122:0/3446938177 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efdc000e4d0 con 0x7efdcc069860 2024-09-15T12:41:15.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.157+0000 7efdd2f91640 1 -- 172.21.15.122:0/3446938177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc069860 msgr2=0x7efdcc139390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.157+0000 7efdd2f91640 1 --2- 172.21.15.122:0/3446938177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc069860 0x7efdcc139390 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.157+0000 7efdd2f91640 1 -- 172.21.15.122:0/3446938177 shutdown_connections 2024-09-15T12:41:15.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.157+0000 7efdd2f91640 1 --2- 172.21.15.122:0/3446938177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc069860 0x7efdcc139390 unknown :-1 s=CLOSED pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.157+0000 7efdd2f91640 1 -- 172.21.15.122:0/3446938177 >> 172.21.15.122:0/3446938177 conn(0x7efdcc0a3100 msgr2=0x7efdcc0a3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:15.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.157+0000 7efdd2f91640 1 -- 172.21.15.122:0/3446938177 shutdown_connections 2024-09-15T12:41:15.160 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.157+0000 7efdd2f91640 1 -- 172.21.15.122:0/3446938177 wait complete. 2024-09-15T12:41:15.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.157+0000 7efdd2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:15.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.159+0000 7efdd2f91640 1 Processor -- start 2024-09-15T12:41:15.161 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.159+0000 7efdd2f91640 1 -- start start 2024-09-15T12:41:15.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.160+0000 7efdd2f91640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc068d40 0x7efdcc1b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:15.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.160+0000 7efdd2f91640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc1b7da0 con 0x7efdcc068d40 2024-09-15T12:41:15.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.160+0000 7efdd0d2d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc068d40 0x7efdcc1b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:15.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.160+0000 7efdd0d2d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc068d40 0x7efdcc1b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43540/0 (socket says 172.21.15.122:43540) 2024-09-15T12:41:15.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.160+0000 7efdd0d2d640 1 -- 172.21.15.122:0/611632424 learned_addr learned my addr 172.21.15.122:0/611632424 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:15.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.160+0000 7efdd0d2d640 1 -- 172.21.15.122:0/611632424 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdcc1b7b10 con 0x7efdcc068d40 2024-09-15T12:41:15.163 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.161+0000 7efdd0d2d640 1 --2- 172.21.15.122:0/611632424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc068d40 0x7efdcc1b4010 crc :-1 s=READY pgs=12992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:15.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.161+0000 7efdc97fa640 1 -- 172.21.15.122:0/611632424 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efdbc0059a0 con 0x7efdcc068d40 2024-09-15T12:41:15.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.161+0000 7efdc97fa640 1 -- 172.21.15.122:0/611632424 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efdbc005b00 con 0x7efdcc068d40 2024-09-15T12:41:15.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.161+0000 7efdd2f91640 1 -- 172.21.15.122:0/611632424 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdcc1b6120 con 0x7efdcc068d40 2024-09-15T12:41:15.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.161+0000 7efdc97fa640 1 -- 172.21.15.122:0/611632424 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efdbc005da0 con 0x7efdcc068d40 2024-09-15T12:41:15.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.161+0000 7efdd2f91640 1 -- 172.21.15.122:0/611632424 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdcc1b7190 con 0x7efdcc068d40 2024-09-15T12:41:15.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.162+0000 7efdd2f91640 1 -- 172.21.15.122:0/611632424 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efdcc1b79a0 con 0x7efdcc068d40 2024-09-15T12:41:15.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.162+0000 7efdc97fa640 1 -- 172.21.15.122:0/611632424 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7efdbc0070b0 con 0x7efdcc068d40 2024-09-15T12:41:15.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.162+0000 7efdc97fa640 1 --2- 172.21.15.122:0/611632424 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efdb803e930 0x7efdb8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:15.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.162+0000 7efdc97fa640 1 -- 172.21.15.122:0/611632424 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(720..720 src has 621..720) ==== 3431+0+0 (crc 0 0 0) 0x7efdbc04f980 con 0x7efdcc068d40 2024-09-15T12:41:15.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.162+0000 7efdc97fa640 1 --2- 172.21.15.122:0/611632424 >> v2:172.21.15.142:6803/3269009979 conn(0x7efdb8044a70 0x7efdb8046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:15.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.162+0000 7efdc97fa640 1 -- 172.21.15.122:0/611632424 --> v2:172.21.15.142:6803/3269009979 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efdb80475f0 con 0x7efdb8044a70 2024-09-15T12:41:15.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.162+0000 7efdc97fa640 1 -- 172.21.15.122:0/611632424 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=720) ==== 24+0+0 (crc 0 0 0) 0x7efdbc04fd90 con 0x7efdcc068d40 2024-09-15T12:41:15.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.163+0000 7efdcbfff640 1 --2- 172.21.15.122:0/611632424 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efdb803e930 0x7efdb8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:15.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.163+0000 7efdcbfff640 1 --2- 172.21.15.122:0/611632424 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efdb803e930 0x7efdb8040e40 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:15.166 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.164+0000 7efdd152e640 1 --2- 172.21.15.122:0/611632424 >> v2:172.21.15.142:6803/3269009979 conn(0x7efdb8044a70 0x7efdb8046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:41:15.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.168+0000 7efdd152e640 1 --2- 172.21.15.122:0/611632424 >> v2:172.21.15.142:6803/3269009979 conn(0x7efdb8044a70 0x7efdb8046f60 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:15.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.170+0000 7efdc97fa640 1 -- 172.21.15.122:0/611632424 <== osd.2 v2:172.21.15.142:6803/3269009979 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7efdb80475f0 con 0x7efdb8044a70 2024-09-15T12:41:15.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.173+0000 7efdd2f91640 1 -- 172.21.15.122:0/611632424 --> v2:172.21.15.142:6803/3269009979 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efdcc0a12c0 con 0x7efdb8044a70 2024-09-15T12:41:15.177 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.176+0000 7efdc97fa640 1 -- 172.21.15.122:0/611632424 <== osd.2 v2:172.21.15.142:6803/3269009979 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7efdc400a820 con 0x7efdb8044a70 2024-09-15T12:41:15.178 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-15T12:41:15.178 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "" 2024-09-15T12:41:15.178 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-15T12:41:15.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.176+0000 7efdd2f91640 1 -- 172.21.15.122:0/611632424 >> v2:172.21.15.142:6803/3269009979 conn(0x7efdb8044a70 msgr2=0x7efdb8046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.176+0000 7efdd2f91640 1 --2- 172.21.15.122:0/611632424 >> v2:172.21.15.142:6803/3269009979 conn(0x7efdb8044a70 0x7efdb8046f60 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.176+0000 7efdd2f91640 1 -- 172.21.15.122:0/611632424 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efdb803e930 msgr2=0x7efdb8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.176+0000 7efdd2f91640 1 --2- 172.21.15.122:0/611632424 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efdb803e930 0x7efdb8040e40 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.176+0000 7efdd2f91640 1 -- 172.21.15.122:0/611632424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc068d40 msgr2=0x7efdcc1b4010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.176+0000 7efdd2f91640 1 --2- 172.21.15.122:0/611632424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc068d40 0x7efdcc1b4010 crc :-1 s=READY pgs=12992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.176+0000 7efdd2f91640 1 -- 172.21.15.122:0/611632424 shutdown_connections 2024-09-15T12:41:15.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.176+0000 7efdd2f91640 1 --2- 172.21.15.122:0/611632424 >> v2:172.21.15.142:6803/3269009979 conn(0x7efdb8044a70 0x7efdb8046f60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.176+0000 7efdd2f91640 1 --2- 172.21.15.122:0/611632424 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7efdb803e930 0x7efdb8040e40 unknown :-1 s=CLOSED pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.176+0000 7efdd2f91640 1 --2- 172.21.15.122:0/611632424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc068d40 0x7efdcc1b4010 unknown :-1 s=CLOSED pgs=12992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.176+0000 7efdd2f91640 1 -- 172.21.15.122:0/611632424 >> 172.21.15.122:0/611632424 conn(0x7efdcc0a3100 msgr2=0x7efdcc09fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:15.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.176+0000 7efdd2f91640 1 -- 172.21.15.122:0/611632424 shutdown_connections 2024-09-15T12:41:15.180 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.176+0000 7efdd2f91640 1 -- 172.21.15.122:0/611632424 wait complete. 2024-09-15T12:41:15.188 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-15T12:41:15.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.290+0000 7fa9ea288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:15.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.296+0000 7fa9ea288640 1 Processor -- start 2024-09-15T12:41:15.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.296+0000 7fa9ea288640 1 -- start start 2024-09-15T12:41:15.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.298+0000 7fa9ea288640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa9e412fd20 0x7fa9e4137c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:15.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.298+0000 7fa9ea288640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9e412f370 con 0x7fa9e40a44a0 2024-09-15T12:41:15.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.298+0000 7fa9ea288640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa9e406d1d0 con 0x7fa9e412fd20 2024-09-15T12:41:15.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.298+0000 7fa9e37fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa9e412fd20 0x7fa9e4137c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:15.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.298+0000 7fa9e37fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa9e412fd20 0x7fa9e4137c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43546/0 (socket says 172.21.15.122:43546) 2024-09-15T12:41:15.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.298+0000 7fa9e37fe640 1 -- 172.21.15.122:0/596488122 learned_addr learned my addr 172.21.15.122:0/596488122 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:15.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.298+0000 7fa9e3fff640 1 --1- 172.21.15.122:0/596488122 >> v1:172.21.15.122:6789/0 conn(0x7fa9e40a44a0 0x7fa9e412f610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56634/0 (socket says 172.21.15.122:56634) 2024-09-15T12:41:15.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.298+0000 7fa9e37fe640 1 -- 172.21.15.122:0/596488122 >> v1:172.21.15.122:6789/0 conn(0x7fa9e40a44a0 legacy=0x7fa9e412f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.298+0000 7fa9e2ffd640 1 -- 172.21.15.122:0/596488122 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2787391343 0 0) 0x7fa9e412f370 con 0x7fa9e40a44a0 2024-09-15T12:41:15.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.298+0000 7fa9e37fe640 1 -- 172.21.15.122:0/596488122 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e409ebe0 con 0x7fa9e412fd20 2024-09-15T12:41:15.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.298+0000 7fa9e37fe640 1 --2- 172.21.15.122:0/596488122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e412fd20 0x7fa9e4137c50 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1cd57dd595808d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:15.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.298+0000 7fa9e2ffd640 1 -- 172.21.15.122:0/596488122 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa9d8009e40 con 0x7fa9e412fd20 2024-09-15T12:41:15.301 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.298+0000 7fa9e2ffd640 1 -- 172.21.15.122:0/596488122 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa9d800e230 con 0x7fa9e412fd20 2024-09-15T12:41:15.302 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.298+0000 7fa9e2ffd640 1 -- 172.21.15.122:0/596488122 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa9d800e4d0 con 0x7fa9e412fd20 2024-09-15T12:41:15.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.299+0000 7fa9ea288640 1 -- 172.21.15.122:0/596488122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e412fd20 msgr2=0x7fa9e4137c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.299+0000 7fa9ea288640 1 --2- 172.21.15.122:0/596488122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e412fd20 0x7fa9e4137c50 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.299+0000 7fa9ea288640 1 -- 172.21.15.122:0/596488122 shutdown_connections 2024-09-15T12:41:15.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.299+0000 7fa9ea288640 1 --2- 172.21.15.122:0/596488122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e412fd20 0x7fa9e4137c50 unknown :-1 s=CLOSED pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.299+0000 7fa9ea288640 1 -- 172.21.15.122:0/596488122 >> 172.21.15.122:0/596488122 conn(0x7fa9e40a2970 msgr2=0x7fa9e40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:15.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.299+0000 7fa9ea288640 1 -- 172.21.15.122:0/596488122 shutdown_connections 2024-09-15T12:41:15.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.299+0000 7fa9ea288640 1 -- 172.21.15.122:0/596488122 wait complete. 2024-09-15T12:41:15.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.299+0000 7fa9ea288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:15.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.301+0000 7fa9ea288640 1 Processor -- start 2024-09-15T12:41:15.303 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.301+0000 7fa9ea288640 1 -- start start 2024-09-15T12:41:15.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.302+0000 7fa9ea288640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e40a44a0 0x7fa9e41c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:15.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.302+0000 7fa9ea288640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e4135b90 con 0x7fa9e40a44a0 2024-09-15T12:41:15.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.302+0000 7fa9e3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e40a44a0 0x7fa9e41c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:15.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.302+0000 7fa9e3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e40a44a0 0x7fa9e41c7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43552/0 (socket says 172.21.15.122:43552) 2024-09-15T12:41:15.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.302+0000 7fa9e3fff640 1 -- 172.21.15.122:0/100230254 learned_addr learned my addr 172.21.15.122:0/100230254 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:15.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.302+0000 7fa9e3fff640 1 -- 172.21.15.122:0/100230254 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e4136950 con 0x7fa9e40a44a0 2024-09-15T12:41:15.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.302+0000 7fa9e3fff640 1 --2- 172.21.15.122:0/100230254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e40a44a0 0x7fa9e41c7230 crc :-1 s=READY pgs=12995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:15.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.303+0000 7fa9e0ff9640 1 -- 172.21.15.122:0/100230254 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa9d4004b80 con 0x7fa9e40a44a0 2024-09-15T12:41:15.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.303+0000 7fa9e0ff9640 1 -- 172.21.15.122:0/100230254 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa9d4004ce0 con 0x7fa9e40a44a0 2024-09-15T12:41:15.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.303+0000 7fa9ea288640 1 -- 172.21.15.122:0/100230254 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e41373c0 con 0x7fa9e40a44a0 2024-09-15T12:41:15.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.303+0000 7fa9e0ff9640 1 -- 172.21.15.122:0/100230254 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa9d4007120 con 0x7fa9e40a44a0 2024-09-15T12:41:15.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.303+0000 7fa9ea288640 1 -- 172.21.15.122:0/100230254 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e411ba20 con 0x7fa9e40a44a0 2024-09-15T12:41:15.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.304+0000 7fa9ea288640 1 -- 172.21.15.122:0/100230254 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9e412f610 con 0x7fa9e40a44a0 2024-09-15T12:41:15.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.304+0000 7fa9e0ff9640 1 -- 172.21.15.122:0/100230254 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa9d4007320 con 0x7fa9e40a44a0 2024-09-15T12:41:15.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.304+0000 7fa9e0ff9640 1 --2- 172.21.15.122:0/100230254 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa9d003e8e0 0x7fa9d0040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:15.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.304+0000 7fa9e0ff9640 1 -- 172.21.15.122:0/100230254 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(720..720 src has 621..720) ==== 3431+0+0 (crc 0 0 0) 0x7fa9d404fa30 con 0x7fa9e40a44a0 2024-09-15T12:41:15.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.304+0000 7fa9e37fe640 1 --2- 172.21.15.122:0/100230254 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa9d003e8e0 0x7fa9d0040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:15.308 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.305+0000 7fa9e37fe640 1 --2- 172.21.15.122:0/100230254 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa9d003e8e0 0x7fa9d0040df0 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:15.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.309+0000 7fa9e0ff9640 1 -- 172.21.15.122:0/100230254 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fa9d400f230 con 0x7fa9e40a44a0 2024-09-15T12:41:15.485 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.483+0000 7fa9ea288640 1 -- 172.21.15.122:0/100230254 --> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fa9e4137240 con 0x7fa9d003e8e0 2024-09-15T12:41:15.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.484+0000 7fa9e0ff9640 1 -- 172.21.15.122:0/100230254 <== mgr.4100 v2:172.21.15.142:6800/73136857 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fa9d8009d90 con 0x7fa9d003e8e0 2024-09-15T12:41:15.486 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 2 to deep-scrub 2024-09-15T12:41:15.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.486+0000 7fa9ea288640 1 -- 172.21.15.122:0/100230254 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa9d003e8e0 msgr2=0x7fa9d0040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.486+0000 7fa9ea288640 1 --2- 172.21.15.122:0/100230254 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa9d003e8e0 0x7fa9d0040df0 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.486+0000 7fa9ea288640 1 -- 172.21.15.122:0/100230254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e40a44a0 msgr2=0x7fa9e41c7230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.486+0000 7fa9ea288640 1 --2- 172.21.15.122:0/100230254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e40a44a0 0x7fa9e41c7230 crc :-1 s=READY pgs=12995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.486+0000 7fa9ea288640 1 -- 172.21.15.122:0/100230254 shutdown_connections 2024-09-15T12:41:15.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.486+0000 7fa9ea288640 1 --2- 172.21.15.122:0/100230254 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa9d003e8e0 0x7fa9d0040df0 unknown :-1 s=CLOSED pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.486+0000 7fa9ea288640 1 --2- 172.21.15.122:0/100230254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9e40a44a0 0x7fa9e41c7230 unknown :-1 s=CLOSED pgs=12995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.486+0000 7fa9ea288640 1 -- 172.21.15.122:0/100230254 >> 172.21.15.122:0/100230254 conn(0x7fa9e40a2970 msgr2=0x7fa9e409f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:15.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.487+0000 7fa9ea288640 1 -- 172.21.15.122:0/100230254 shutdown_connections 2024-09-15T12:41:15.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.487+0000 7fa9ea288640 1 -- 172.21.15.122:0/100230254 wait complete. 2024-09-15T12:41:15.502 INFO:tasks.ceph:Scrubbing osd.3 2024-09-15T12:41:15.502 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-15T12:41:15.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.608+0000 7fb031d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:15.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.617+0000 7fb031d91640 1 Processor -- start 2024-09-15T12:41:15.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.617+0000 7fb031d91640 1 -- start start 2024-09-15T12:41:15.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.618+0000 7fb031d91640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb02c072470 0x7fb02c072880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:15.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.618+0000 7fb031d91640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb02c073690 con 0x7fb02c072dc0 2024-09-15T12:41:15.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.618+0000 7fb031d91640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fb02c0738c0 con 0x7fb02c072470 2024-09-15T12:41:15.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.619+0000 7fb02b7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb02c072470 0x7fb02c072880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:15.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.619+0000 7fb02affd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fb02c072dc0 0x7fb02c133df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56642/0 (socket says 172.21.15.122:56642) 2024-09-15T12:41:15.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.619+0000 7fb02b7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb02c072470 0x7fb02c072880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43564/0 (socket says 172.21.15.122:43564) 2024-09-15T12:41:15.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.619+0000 7fb02affd640 1 -- 172.21.15.122:0/4088884802 learned_addr learned my addr 172.21.15.122:0/4088884802 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:41:15.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.619+0000 7fb02b7fe640 1 -- 172.21.15.122:0/4088884802 >> v1:172.21.15.122:6789/0 conn(0x7fb02c072dc0 legacy=0x7fb02c133df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.619+0000 7fb02a7fc640 1 -- 172.21.15.122:0/4088884802 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4237255148 0 0) 0x7fb02c073690 con 0x7fb02c072dc0 2024-09-15T12:41:15.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.619+0000 7fb02b7fe640 1 -- 172.21.15.122:0/4088884802 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02c069fb0 con 0x7fb02c072470 2024-09-15T12:41:15.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.619+0000 7fb02b7fe640 1 --2- 172.21.15.122:0/4088884802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb02c072470 0x7fb02c072880 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b1b8532cb50ae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:15.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.619+0000 7fb02a7fc640 1 -- 172.21.15.122:0/4088884802 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb01c009d90 con 0x7fb02c072470 2024-09-15T12:41:15.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.619+0000 7fb02a7fc640 1 -- 172.21.15.122:0/4088884802 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb01c00e230 con 0x7fb02c072470 2024-09-15T12:41:15.622 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.619+0000 7fb02a7fc640 1 -- 172.21.15.122:0/4088884802 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb01c00e4d0 con 0x7fb02c072470 2024-09-15T12:41:15.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.620+0000 7fb031d91640 1 -- 172.21.15.122:0/4088884802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb02c072470 msgr2=0x7fb02c072880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.620+0000 7fb031d91640 1 --2- 172.21.15.122:0/4088884802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb02c072470 0x7fb02c072880 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.620+0000 7fb031d91640 1 -- 172.21.15.122:0/4088884802 shutdown_connections 2024-09-15T12:41:15.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.620+0000 7fb031d91640 1 --2- 172.21.15.122:0/4088884802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb02c072470 0x7fb02c072880 unknown :-1 s=CLOSED pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.620+0000 7fb031d91640 1 -- 172.21.15.122:0/4088884802 >> 172.21.15.122:0/4088884802 conn(0x7fb02c0a33b0 msgr2=0x7fb02c0a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:15.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.620+0000 7fb031d91640 1 -- 172.21.15.122:0/4088884802 shutdown_connections 2024-09-15T12:41:15.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.620+0000 7fb031d91640 1 -- 172.21.15.122:0/4088884802 wait complete. 2024-09-15T12:41:15.623 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.620+0000 7fb031d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:15.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.621+0000 7fb031d91640 1 Processor -- start 2024-09-15T12:41:15.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.622+0000 7fb031d91640 1 -- start start 2024-09-15T12:41:15.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.623+0000 7fb031d91640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb02c072470 0x7fb02c1223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:15.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.623+0000 7fb031d91640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c121ef0 con 0x7fb02c072470 2024-09-15T12:41:15.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.623+0000 7fb02b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb02c072470 0x7fb02c1223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:15.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.623+0000 7fb02b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb02c072470 0x7fb02c1223b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43578/0 (socket says 172.21.15.122:43578) 2024-09-15T12:41:15.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.623+0000 7fb02b7fe640 1 -- 172.21.15.122:0/405320511 learned_addr learned my addr 172.21.15.122:0/405320511 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:15.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.623+0000 7fb02b7fe640 1 -- 172.21.15.122:0/405320511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02c123450 con 0x7fb02c072470 2024-09-15T12:41:15.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.623+0000 7fb02b7fe640 1 --2- 172.21.15.122:0/405320511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb02c072470 0x7fb02c1223b0 crc :-1 s=READY pgs=12998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:15.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.623+0000 7fb013fff640 1 -- 172.21.15.122:0/405320511 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb01c014620 con 0x7fb02c072470 2024-09-15T12:41:15.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.623+0000 7fb013fff640 1 -- 172.21.15.122:0/405320511 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb01c014780 con 0x7fb02c072470 2024-09-15T12:41:15.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.623+0000 7fb013fff640 1 -- 172.21.15.122:0/405320511 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb01c014a20 con 0x7fb02c072470 2024-09-15T12:41:15.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.623+0000 7fb031d91640 1 -- 172.21.15.122:0/405320511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb02c121b50 con 0x7fb02c072470 2024-09-15T12:41:15.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.623+0000 7fb031d91640 1 -- 172.21.15.122:0/405320511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb02c124cf0 con 0x7fb02c072470 2024-09-15T12:41:15.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.624+0000 7fb031d91640 1 -- 172.21.15.122:0/405320511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb02c073f80 con 0x7fb02c072470 2024-09-15T12:41:15.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.624+0000 7fb013fff640 1 -- 172.21.15.122:0/405320511 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb01c014c20 con 0x7fb02c072470 2024-09-15T12:41:15.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.625+0000 7fb013fff640 1 --2- 172.21.15.122:0/405320511 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb01803e8e0 0x7fb018040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:15.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.625+0000 7fb013fff640 1 -- 172.21.15.122:0/405320511 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(720..720 src has 621..720) ==== 3431+0+0 (crc 0 0 0) 0x7fb01c019040 con 0x7fb02c072470 2024-09-15T12:41:15.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.625+0000 7fb013fff640 1 --2- 172.21.15.122:0/405320511 >> v2:172.21.15.142:6811/2150609480 conn(0x7fb018044a80 0x7fb018046f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:15.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.625+0000 7fb013fff640 1 -- 172.21.15.122:0/405320511 --> v2:172.21.15.142:6811/2150609480 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb018047600 con 0x7fb018044a80 2024-09-15T12:41:15.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.625+0000 7fb013fff640 1 -- 172.21.15.122:0/405320511 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=720) ==== 24+0+0 (crc 0 0 0) 0x7fb01c053750 con 0x7fb02c072470 2024-09-15T12:41:15.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.625+0000 7fb02affd640 1 --2- 172.21.15.122:0/405320511 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb01803e8e0 0x7fb018040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:15.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.626+0000 7fb02affd640 1 --2- 172.21.15.122:0/405320511 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb01803e8e0 0x7fb018040df0 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:15.628 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.626+0000 7fb02bfff640 1 --2- 172.21.15.122:0/405320511 >> v2:172.21.15.142:6811/2150609480 conn(0x7fb018044a80 0x7fb018046f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-15T12:41:15.632 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.630+0000 7fb02bfff640 1 --2- 172.21.15.122:0/405320511 >> v2:172.21.15.142:6811/2150609480 conn(0x7fb018044a80 0x7fb018046f70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:15.633 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.632+0000 7fb013fff640 1 -- 172.21.15.122:0/405320511 <== osd.3 v2:172.21.15.142:6811/2150609480 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7fb018047600 con 0x7fb018044a80 2024-09-15T12:41:15.636 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.635+0000 7fb031d91640 1 -- 172.21.15.122:0/405320511 --> v2:172.21.15.142:6811/2150609480 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb02c0a4070 con 0x7fb018044a80 2024-09-15T12:41:15.638 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.637+0000 7fb013fff640 1 -- 172.21.15.122:0/405320511 <== osd.3 v2:172.21.15.142:6811/2150609480 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7fb02c0a4070 con 0x7fb018044a80 2024-09-15T12:41:15.639 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-15T12:41:15.639 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "" 2024-09-15T12:41:15.639 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-15T12:41:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.637+0000 7fb031d91640 1 -- 172.21.15.122:0/405320511 >> v2:172.21.15.142:6811/2150609480 conn(0x7fb018044a80 msgr2=0x7fb018046f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.637+0000 7fb031d91640 1 --2- 172.21.15.122:0/405320511 >> v2:172.21.15.142:6811/2150609480 conn(0x7fb018044a80 0x7fb018046f70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.637+0000 7fb031d91640 1 -- 172.21.15.122:0/405320511 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb01803e8e0 msgr2=0x7fb018040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.637+0000 7fb031d91640 1 --2- 172.21.15.122:0/405320511 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb01803e8e0 0x7fb018040df0 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.637+0000 7fb031d91640 1 -- 172.21.15.122:0/405320511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb02c072470 msgr2=0x7fb02c1223b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.637+0000 7fb031d91640 1 --2- 172.21.15.122:0/405320511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb02c072470 0x7fb02c1223b0 crc :-1 s=READY pgs=12998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.637+0000 7fb031d91640 1 -- 172.21.15.122:0/405320511 shutdown_connections 2024-09-15T12:41:15.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.637+0000 7fb031d91640 1 --2- 172.21.15.122:0/405320511 >> v2:172.21.15.142:6811/2150609480 conn(0x7fb018044a80 0x7fb018046f70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.637+0000 7fb031d91640 1 --2- 172.21.15.122:0/405320511 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fb01803e8e0 0x7fb018040df0 unknown :-1 s=CLOSED pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.637+0000 7fb031d91640 1 --2- 172.21.15.122:0/405320511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb02c072470 0x7fb02c1223b0 unknown :-1 s=CLOSED pgs=12998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.637+0000 7fb031d91640 1 -- 172.21.15.122:0/405320511 >> 172.21.15.122:0/405320511 conn(0x7fb02c0a33b0 msgr2=0x7fb02c11ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:15.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.637+0000 7fb031d91640 1 -- 172.21.15.122:0/405320511 shutdown_connections 2024-09-15T12:41:15.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.637+0000 7fb031d91640 1 -- 172.21.15.122:0/405320511 wait complete. 2024-09-15T12:41:15.650 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-15T12:41:15.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.753+0000 7fa882591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:15.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.759+0000 7fa882591640 1 Processor -- start 2024-09-15T12:41:15.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.759+0000 7fa882591640 1 -- start start 2024-09-15T12:41:15.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.760+0000 7fa882591640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa87c09f040 0x7fa87c068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:15.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.760+0000 7fa882591640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa87c06d370 con 0x7fa87c09e910 2024-09-15T12:41:15.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.760+0000 7fa882591640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa87c070cb0 con 0x7fa87c09f040 2024-09-15T12:41:15.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.760+0000 7fa87bfff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa87c09f040 0x7fa87c068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:15.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.760+0000 7fa87b7fe640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fa87c09e910 0x7fa87c069280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56646/0 (socket says 172.21.15.122:56646) 2024-09-15T12:41:15.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.760+0000 7fa87b7fe640 1 -- 172.21.15.122:0/2637687974 learned_addr learned my addr 172.21.15.122:0/2637687974 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:41:15.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.760+0000 7fa87bfff640 1 -- 172.21.15.122:0/2637687974 >> v1:172.21.15.122:6789/0 conn(0x7fa87c09e910 legacy=0x7fa87c069280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.760+0000 7fa87affd640 1 -- 172.21.15.122:0/2637687974 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3769381957 0 0) 0x7fa87c06d370 con 0x7fa87c09e910 2024-09-15T12:41:15.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.760+0000 7fa87bfff640 1 -- 172.21.15.122:0/2637687974 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87c09c1c0 con 0x7fa87c09f040 2024-09-15T12:41:15.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.761+0000 7fa87bfff640 1 --2- 172.21.15.122:0/2637687974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa87c09f040 0x7fa87c068d40 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d117960b83e4a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:15.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.761+0000 7fa87affd640 1 -- 172.21.15.122:0/2637687974 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa86c009d90 con 0x7fa87c09f040 2024-09-15T12:41:15.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.761+0000 7fa87affd640 1 -- 172.21.15.122:0/2637687974 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa86c00e230 con 0x7fa87c09f040 2024-09-15T12:41:15.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.761+0000 7fa87affd640 1 -- 172.21.15.122:0/2637687974 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa86c00e4d0 con 0x7fa87c09f040 2024-09-15T12:41:15.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.761+0000 7fa882591640 1 -- 172.21.15.122:0/2637687974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa87c09f040 msgr2=0x7fa87c068d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.761+0000 7fa882591640 1 --2- 172.21.15.122:0/2637687974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa87c09f040 0x7fa87c068d40 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.761+0000 7fa882591640 1 -- 172.21.15.122:0/2637687974 shutdown_connections 2024-09-15T12:41:15.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.761+0000 7fa882591640 1 --2- 172.21.15.122:0/2637687974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa87c09f040 0x7fa87c068d40 unknown :-1 s=CLOSED pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.761+0000 7fa882591640 1 -- 172.21.15.122:0/2637687974 >> 172.21.15.122:0/2637687974 conn(0x7fa87c0a32a0 msgr2=0x7fa87c0a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:15.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.762+0000 7fa882591640 1 -- 172.21.15.122:0/2637687974 shutdown_connections 2024-09-15T12:41:15.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.762+0000 7fa882591640 1 -- 172.21.15.122:0/2637687974 wait complete. 2024-09-15T12:41:15.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.762+0000 7fa882591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:15.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.763+0000 7fa882591640 1 Processor -- start 2024-09-15T12:41:15.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.763+0000 7fa882591640 1 -- start start 2024-09-15T12:41:15.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.764+0000 7fa882591640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa87c09e910 0x7fa87c1383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:15.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.764+0000 7fa882591640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c09bc90 con 0x7fa87c09e910 2024-09-15T12:41:15.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.764+0000 7fa87bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa87c09e910 0x7fa87c1383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:15.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.764+0000 7fa87bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa87c09e910 0x7fa87c1383a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43602/0 (socket says 172.21.15.122:43602) 2024-09-15T12:41:15.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.764+0000 7fa87bfff640 1 -- 172.21.15.122:0/381003245 learned_addr learned my addr 172.21.15.122:0/381003245 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:15.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.765+0000 7fa87bfff640 1 -- 172.21.15.122:0/381003245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87c0716e0 con 0x7fa87c09e910 2024-09-15T12:41:15.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.765+0000 7fa87bfff640 1 --2- 172.21.15.122:0/381003245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa87c09e910 0x7fa87c1383a0 crc :-1 s=READY pgs=13001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:15.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.765+0000 7fa878ff9640 1 -- 172.21.15.122:0/381003245 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa86c013530 con 0x7fa87c09e910 2024-09-15T12:41:15.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.765+0000 7fa878ff9640 1 -- 172.21.15.122:0/381003245 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa86c013690 con 0x7fa87c09e910 2024-09-15T12:41:15.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.765+0000 7fa882591640 1 -- 172.21.15.122:0/381003245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87c099c60 con 0x7fa87c09e910 2024-09-15T12:41:15.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.765+0000 7fa878ff9640 1 -- 172.21.15.122:0/381003245 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa86c013930 con 0x7fa87c09e910 2024-09-15T12:41:15.768 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.765+0000 7fa882591640 1 -- 172.21.15.122:0/381003245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87c097a00 con 0x7fa87c09e910 2024-09-15T12:41:15.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.766+0000 7fa878ff9640 1 -- 172.21.15.122:0/381003245 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa86c013ae0 con 0x7fa87c09e910 2024-09-15T12:41:15.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.766+0000 7fa882591640 1 -- 172.21.15.122:0/381003245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa87c068d40 con 0x7fa87c09e910 2024-09-15T12:41:15.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.766+0000 7fa878ff9640 1 --2- 172.21.15.122:0/381003245 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa86803e930 0x7fa868040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:15.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.766+0000 7fa878ff9640 1 -- 172.21.15.122:0/381003245 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(720..720 src has 621..720) ==== 3431+0+0 (crc 0 0 0) 0x7fa86c018040 con 0x7fa87c09e910 2024-09-15T12:41:15.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.767+0000 7fa87b7fe640 1 --2- 172.21.15.122:0/381003245 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa86803e930 0x7fa868040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:15.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.767+0000 7fa87b7fe640 1 --2- 172.21.15.122:0/381003245 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa86803e930 0x7fa868040e40 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:15.773 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.772+0000 7fa878ff9640 1 -- 172.21.15.122:0/381003245 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fa86c017190 con 0x7fa87c09e910 2024-09-15T12:41:15.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.948+0000 7fa882591640 1 -- 172.21.15.122:0/381003245 --> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fa87c072680 con 0x7fa86803e930 2024-09-15T12:41:15.951 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.949+0000 7fa878ff9640 1 -- 172.21.15.122:0/381003245 <== mgr.4100 v2:172.21.15.142:6800/73136857 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fa8700070b0 con 0x7fa86803e930 2024-09-15T12:41:15.951 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 3 to deep-scrub 2024-09-15T12:41:15.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.951+0000 7fa882591640 1 -- 172.21.15.122:0/381003245 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa86803e930 msgr2=0x7fa868040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.951+0000 7fa882591640 1 --2- 172.21.15.122:0/381003245 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa86803e930 0x7fa868040e40 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.953 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.951+0000 7fa882591640 1 -- 172.21.15.122:0/381003245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa87c09e910 msgr2=0x7fa87c1383a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:15.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.951+0000 7fa882591640 1 --2- 172.21.15.122:0/381003245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa87c09e910 0x7fa87c1383a0 crc :-1 s=READY pgs=13001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.951+0000 7fa882591640 1 -- 172.21.15.122:0/381003245 shutdown_connections 2024-09-15T12:41:15.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.951+0000 7fa882591640 1 --2- 172.21.15.122:0/381003245 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fa86803e930 0x7fa868040e40 unknown :-1 s=CLOSED pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.951+0000 7fa882591640 1 --2- 172.21.15.122:0/381003245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa87c09e910 0x7fa87c1383a0 unknown :-1 s=CLOSED pgs=13001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:15.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.951+0000 7fa882591640 1 -- 172.21.15.122:0/381003245 >> 172.21.15.122:0/381003245 conn(0x7fa87c0a32a0 msgr2=0x7fa87c072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:15.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.951+0000 7fa882591640 1 -- 172.21.15.122:0/381003245 shutdown_connections 2024-09-15T12:41:15.954 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:15.951+0000 7fa882591640 1 -- 172.21.15.122:0/381003245 wait complete. 2024-09-15T12:41:15.966 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:41:16.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.069+0000 7f55b2151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:16.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.074+0000 7f55b2151640 1 Processor -- start 2024-09-15T12:41:16.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.074+0000 7f55b2151640 1 -- start start 2024-09-15T12:41:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.075+0000 7f55b2151640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f55ac069860 0x7f55ac13b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.075+0000 7f55b2151640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55ac09d6b0 con 0x7f55ac068d40 2024-09-15T12:41:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.075+0000 7f55b2151640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f55ac09f6f0 con 0x7f55ac069860 2024-09-15T12:41:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.075+0000 7f55aaffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f55ac069860 0x7f55ac13b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.075+0000 7f55ab7fe640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f55ac068d40 0x7f55ac069150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:56650/0 (socket says 172.21.15.122:56650) 2024-09-15T12:41:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.075+0000 7f55aaffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f55ac069860 0x7f55ac13b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43604/0 (socket says 172.21.15.122:43604) 2024-09-15T12:41:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.075+0000 7f55ab7fe640 1 -- 172.21.15.122:0/595680794 learned_addr learned my addr 172.21.15.122:0/595680794 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:41:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.075+0000 7f55aaffd640 1 -- 172.21.15.122:0/595680794 >> v1:172.21.15.122:6789/0 conn(0x7f55ac068d40 legacy=0x7f55ac069150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.075+0000 7f55aaffd640 1 -- 172.21.15.122:0/595680794 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ac06d370 con 0x7f55ac069860 2024-09-15T12:41:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.076+0000 7f55aaffd640 1 --2- 172.21.15.122:0/595680794 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55ac069860 0x7f55ac13b3b0 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e93f0692acaf305 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:16.079 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.076+0000 7f55aa7fc640 1 -- 172.21.15.122:0/595680794 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f55a0009d90 con 0x7f55ac069860 2024-09-15T12:41:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.076+0000 7f55aa7fc640 1 -- 172.21.15.122:0/595680794 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f55a000e230 con 0x7f55ac069860 2024-09-15T12:41:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.076+0000 7f55aa7fc640 1 -- 172.21.15.122:0/595680794 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f55a000e4d0 con 0x7f55ac069860 2024-09-15T12:41:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.076+0000 7f55b2151640 1 -- 172.21.15.122:0/595680794 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55ac069860 msgr2=0x7f55ac13b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.076+0000 7f55b2151640 1 --2- 172.21.15.122:0/595680794 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55ac069860 0x7f55ac13b3b0 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.076+0000 7f55b2151640 1 -- 172.21.15.122:0/595680794 shutdown_connections 2024-09-15T12:41:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.076+0000 7f55b2151640 1 --2- 172.21.15.122:0/595680794 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55ac069860 0x7f55ac13b3b0 unknown :-1 s=CLOSED pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.076+0000 7f55b2151640 1 -- 172.21.15.122:0/595680794 >> 172.21.15.122:0/595680794 conn(0x7f55ac0a32a0 msgr2=0x7f55ac0a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.077+0000 7f55b2151640 1 -- 172.21.15.122:0/595680794 shutdown_connections 2024-09-15T12:41:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.077+0000 7f55b2151640 1 -- 172.21.15.122:0/595680794 wait complete. 2024-09-15T12:41:16.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.077+0000 7f55b2151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:16.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.078+0000 7f55b2151640 1 Processor -- start 2024-09-15T12:41:16.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.078+0000 7f55b2151640 1 -- start start 2024-09-15T12:41:16.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.079+0000 7f55b2151640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55ac068d40 0x7f55ac1b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:16.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.079+0000 7f55b2151640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac1b72f0 con 0x7f55ac068d40 2024-09-15T12:41:16.082 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.079+0000 7f55ab7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55ac068d40 0x7f55ac1b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:16.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.079+0000 7f55ab7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55ac068d40 0x7f55ac1b5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:43606/0 (socket says 172.21.15.122:43606) 2024-09-15T12:41:16.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.079+0000 7f55ab7fe640 1 -- 172.21.15.122:0/3588864140 learned_addr learned my addr 172.21.15.122:0/3588864140 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:16.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.080+0000 7f55ab7fe640 1 -- 172.21.15.122:0/3588864140 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ac1b64b0 con 0x7f55ac068d40 2024-09-15T12:41:16.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.080+0000 7f55ab7fe640 1 --2- 172.21.15.122:0/3588864140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55ac068d40 0x7f55ac1b5150 crc :-1 s=READY pgs=13004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:16.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.080+0000 7f5593fff640 1 -- 172.21.15.122:0/3588864140 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f559c005a60 con 0x7f55ac068d40 2024-09-15T12:41:16.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.080+0000 7f5593fff640 1 -- 172.21.15.122:0/3588864140 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f559c005bc0 con 0x7f55ac068d40 2024-09-15T12:41:16.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.080+0000 7f55b2151640 1 -- 172.21.15.122:0/3588864140 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55ac1b4db0 con 0x7f55ac068d40 2024-09-15T12:41:16.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.080+0000 7f5593fff640 1 -- 172.21.15.122:0/3588864140 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f559c005e60 con 0x7f55ac068d40 2024-09-15T12:41:16.083 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.080+0000 7f55b2151640 1 -- 172.21.15.122:0/3588864140 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55ac1b7e50 con 0x7f55ac068d40 2024-09-15T12:41:16.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.081+0000 7f5593fff640 1 -- 172.21.15.122:0/3588864140 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f559c00c7f0 con 0x7f55ac068d40 2024-09-15T12:41:16.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.081+0000 7f55b2151640 1 -- 172.21.15.122:0/3588864140 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55ac069150 con 0x7f55ac068d40 2024-09-15T12:41:16.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.081+0000 7f5593fff640 1 --2- 172.21.15.122:0/3588864140 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f559803e930 0x7f5598040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:16.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.081+0000 7f5593fff640 1 -- 172.21.15.122:0/3588864140 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(720..720 src has 621..720) ==== 3431+0+0 (crc 0 0 0) 0x7f559c04f990 con 0x7f55ac068d40 2024-09-15T12:41:16.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.082+0000 7f55aaffd640 1 --2- 172.21.15.122:0/3588864140 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f559803e930 0x7f5598040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:16.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.082+0000 7f55aaffd640 1 --2- 172.21.15.122:0/3588864140 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f559803e930 0x7f5598040e40 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:16.088 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.086+0000 7f5593fff640 1 -- 172.21.15.122:0/3588864140 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f559c00dc10 con 0x7f55ac068d40 2024-09-15T12:41:16.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.259+0000 7f55b2151640 1 -- 172.21.15.122:0/3588864140 --> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55ac1b8b40 con 0x7f559803e930 2024-09-15T12:41:16.264 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.262+0000 7f5593fff640 1 -- 172.21.15.122:0/3588864140 <== mgr.4100 v2:172.21.15.142:6800/73136857 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109234 (crc 0 0 0) 0x7f55ac1b8b40 con 0x7f559803e930 2024-09-15T12:41:16.265 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:41:16.266 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-15T12:41:16.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.264+0000 7f55b2151640 1 -- 172.21.15.122:0/3588864140 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f559803e930 msgr2=0x7f5598040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:16.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.264+0000 7f55b2151640 1 --2- 172.21.15.122:0/3588864140 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f559803e930 0x7f5598040e40 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:16.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.264+0000 7f55b2151640 1 -- 172.21.15.122:0/3588864140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55ac068d40 msgr2=0x7f55ac1b5150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:16.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.264+0000 7f55b2151640 1 --2- 172.21.15.122:0/3588864140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55ac068d40 0x7f55ac1b5150 crc :-1 s=READY pgs=13004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:16.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.264+0000 7f55b2151640 1 -- 172.21.15.122:0/3588864140 shutdown_connections 2024-09-15T12:41:16.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.264+0000 7f55b2151640 1 --2- 172.21.15.122:0/3588864140 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7f559803e930 0x7f5598040e40 unknown :-1 s=CLOSED pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:16.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.264+0000 7f55b2151640 1 --2- 172.21.15.122:0/3588864140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55ac068d40 0x7f55ac1b5150 unknown :-1 s=CLOSED pgs=13004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:16.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.264+0000 7f55b2151640 1 -- 172.21.15.122:0/3588864140 >> 172.21.15.122:0/3588864140 conn(0x7f55ac0a32a0 msgr2=0x7f55ac09fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:16.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.265+0000 7f55b2151640 1 -- 172.21.15.122:0/3588864140 shutdown_connections 2024-09-15T12:41:16.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:16.265+0000 7f55b2151640 1 -- 172.21.15.122:0/3588864140 wait complete. 2024-09-15T12:41:16.278 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":1282,"stamp":"2024-09-15T12:41:14.652666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":256096,"kb_used_data":7200,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377231264,"statfs":{"total":386547056640,"available":386284814336,"internally_reserved":0,"allocated":7372800,"data_stored":3755246,"data_compressed":354488,"data_compressed_allocated":491520,"data_compressed_original":1761280,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002061"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.211693+0000","last_change":"2024-09-15T12:27:21.178610+0000","last_active":"2024-09-15T12:40:39.211693+0000","last_peered":"2024-09-15T12:40:39.211693+0000","last_clean":"2024-09-15T12:40:39.211693+0000","last_became_active":"2024-09-15T12:27:21.162458+0000","last_became_peered":"2024-09-15T12:27:21.162458+0000","last_unstale":"2024-09-15T12:40:39.211693+0000","last_undegraded":"2024-09-15T12:40:39.211693+0000","last_fullsized":"2024-09-15T12:40:39.211693+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.217323+0000","last_change":"2024-09-15T12:27:21.213920+0000","last_active":"2024-09-15T12:40:39.217323+0000","last_peered":"2024-09-15T12:40:39.217323+0000","last_clean":"2024-09-15T12:40:39.217323+0000","last_became_active":"2024-09-15T12:27:21.204453+0000","last_became_peered":"2024-09-15T12:27:21.204453+0000","last_unstale":"2024-09-15T12:40:39.217323+0000","last_undegraded":"2024-09-15T12:40:39.217323+0000","last_fullsized":"2024-09-15T12:40:39.217323+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.206716+0000","last_change":"2024-09-15T12:27:21.164996+0000","last_active":"2024-09-15T12:40:39.206716+0000","last_peered":"2024-09-15T12:40:39.206716+0000","last_clean":"2024-09-15T12:40:39.206716+0000","last_became_active":"2024-09-15T12:27:21.155594+0000","last_became_peered":"2024-09-15T12:27:21.155594+0000","last_unstale":"2024-09-15T12:40:39.206716+0000","last_undegraded":"2024-09-15T12:40:39.206716+0000","last_fullsized":"2024-09-15T12:40:39.206716+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.203751+0000","last_change":"2024-09-15T12:27:21.174176+0000","last_active":"2024-09-15T12:40:39.203751+0000","last_peered":"2024-09-15T12:40:39.203751+0000","last_clean":"2024-09-15T12:40:39.203751+0000","last_became_active":"2024-09-15T12:27:21.154114+0000","last_became_peered":"2024-09-15T12:27:21.154114+0000","last_unstale":"2024-09-15T12:40:39.203751+0000","last_undegraded":"2024-09-15T12:40:39.203751+0000","last_fullsized":"2024-09-15T12:40:39.203751+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214753+0000","last_change":"2024-09-15T12:27:21.214859+0000","last_active":"2024-09-15T12:40:39.214753+0000","last_peered":"2024-09-15T12:40:39.214753+0000","last_clean":"2024-09-15T12:40:39.214753+0000","last_became_active":"2024-09-15T12:27:21.208784+0000","last_became_peered":"2024-09-15T12:27:21.208784+0000","last_unstale":"2024-09-15T12:40:39.214753+0000","last_undegraded":"2024-09-15T12:40:39.214753+0000","last_fullsized":"2024-09-15T12:40:39.214753+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.198145+0000","last_change":"2024-09-15T12:27:21.229007+0000","last_active":"2024-09-15T12:40:39.198145+0000","last_peered":"2024-09-15T12:40:39.198145+0000","last_clean":"2024-09-15T12:40:39.198145+0000","last_became_active":"2024-09-15T12:27:21.199501+0000","last_became_peered":"2024-09-15T12:27:21.199501+0000","last_unstale":"2024-09-15T12:40:39.198145+0000","last_undegraded":"2024-09-15T12:40:39.198145+0000","last_fullsized":"2024-09-15T12:40:39.198145+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.208598+0000","last_change":"2024-09-15T12:27:21.226985+0000","last_active":"2024-09-15T12:40:39.208598+0000","last_peered":"2024-09-15T12:40:39.208598+0000","last_clean":"2024-09-15T12:40:39.208598+0000","last_became_active":"2024-09-15T12:27:21.213341+0000","last_became_peered":"2024-09-15T12:27:21.213341+0000","last_unstale":"2024-09-15T12:40:39.208598+0000","last_undegraded":"2024-09-15T12:40:39.208598+0000","last_fullsized":"2024-09-15T12:40:39.208598+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.201604+0000","last_change":"2024-09-15T12:27:21.331475+0000","last_active":"2024-09-15T12:40:39.201604+0000","last_peered":"2024-09-15T12:40:39.201604+0000","last_clean":"2024-09-15T12:40:39.201604+0000","last_became_active":"2024-09-15T12:27:21.314250+0000","last_became_peered":"2024-09-15T12:27:21.314250+0000","last_unstale":"2024-09-15T12:40:39.201604+0000","last_undegraded":"2024-09-15T12:40:39.201604+0000","last_fullsized":"2024-09-15T12:40:39.201604+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.212098+0000","last_change":"2024-09-15T12:27:21.223149+0000","last_active":"2024-09-15T12:40:39.212098+0000","last_peered":"2024-09-15T12:40:39.212098+0000","last_clean":"2024-09-15T12:40:39.212098+0000","last_became_active":"2024-09-15T12:27:21.210467+0000","last_became_peered":"2024-09-15T12:27:21.210467+0000","last_unstale":"2024-09-15T12:40:39.212098+0000","last_undegraded":"2024-09-15T12:40:39.212098+0000","last_fullsized":"2024-09-15T12:40:39.212098+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.204307+0000","last_change":"2024-09-15T12:27:21.198137+0000","last_active":"2024-09-15T12:40:39.204307+0000","last_peered":"2024-09-15T12:40:39.204307+0000","last_clean":"2024-09-15T12:40:39.204307+0000","last_became_active":"2024-09-15T12:27:21.183618+0000","last_became_peered":"2024-09-15T12:27:21.183618+0000","last_unstale":"2024-09-15T12:40:39.204307+0000","last_undegraded":"2024-09-15T12:40:39.204307+0000","last_fullsized":"2024-09-15T12:40:39.204307+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214783+0000","last_change":"2024-09-15T12:27:21.257627+0000","last_active":"2024-09-15T12:40:39.214783+0000","last_peered":"2024-09-15T12:40:39.214783+0000","last_clean":"2024-09-15T12:40:39.214783+0000","last_became_active":"2024-09-15T12:27:21.249285+0000","last_became_peered":"2024-09-15T12:27:21.249285+0000","last_unstale":"2024-09-15T12:40:39.214783+0000","last_undegraded":"2024-09-15T12:40:39.214783+0000","last_fullsized":"2024-09-15T12:40:39.214783+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.213446+0000","last_change":"2024-09-15T12:27:21.283400+0000","last_active":"2024-09-15T12:40:39.213446+0000","last_peered":"2024-09-15T12:40:39.213446+0000","last_clean":"2024-09-15T12:40:39.213446+0000","last_became_active":"2024-09-15T12:27:21.269838+0000","last_became_peered":"2024-09-15T12:27:21.269838+0000","last_unstale":"2024-09-15T12:40:39.213446+0000","last_undegraded":"2024-09-15T12:40:39.213446+0000","last_fullsized":"2024-09-15T12:40:39.213446+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.205889+0000","last_change":"2024-09-15T12:27:21.191351+0000","last_active":"2024-09-15T12:40:39.205889+0000","last_peered":"2024-09-15T12:40:39.205889+0000","last_clean":"2024-09-15T12:40:39.205889+0000","last_became_active":"2024-09-15T12:27:21.178077+0000","last_became_peered":"2024-09-15T12:27:21.178077+0000","last_unstale":"2024-09-15T12:40:39.205889+0000","last_undegraded":"2024-09-15T12:40:39.205889+0000","last_fullsized":"2024-09-15T12:40:39.205889+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.202404+0000","last_change":"2024-09-15T12:27:21.222442+0000","last_active":"2024-09-15T12:40:39.202404+0000","last_peered":"2024-09-15T12:40:39.202404+0000","last_clean":"2024-09-15T12:40:39.202404+0000","last_became_active":"2024-09-15T12:27:21.210134+0000","last_became_peered":"2024-09-15T12:27:21.210134+0000","last_unstale":"2024-09-15T12:40:39.202404+0000","last_undegraded":"2024-09-15T12:40:39.202404+0000","last_fullsized":"2024-09-15T12:40:39.202404+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.199541+0000","last_change":"2024-09-15T12:27:21.224669+0000","last_active":"2024-09-15T12:40:39.199541+0000","last_peered":"2024-09-15T12:40:39.199541+0000","last_clean":"2024-09-15T12:40:39.199541+0000","last_became_active":"2024-09-15T12:27:21.206575+0000","last_became_peered":"2024-09-15T12:27:21.206575+0000","last_unstale":"2024-09-15T12:40:39.199541+0000","last_undegraded":"2024-09-15T12:40:39.199541+0000","last_fullsized":"2024-09-15T12:40:39.199541+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.202979+0000","last_change":"2024-09-15T12:27:21.310077+0000","last_active":"2024-09-15T12:40:39.202979+0000","last_peered":"2024-09-15T12:40:39.202979+0000","last_clean":"2024-09-15T12:40:39.202979+0000","last_became_active":"2024-09-15T12:27:21.301356+0000","last_became_peered":"2024-09-15T12:27:21.301356+0000","last_unstale":"2024-09-15T12:40:39.202979+0000","last_undegraded":"2024-09-15T12:40:39.202979+0000","last_fullsized":"2024-09-15T12:40:39.202979+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214906+0000","last_change":"2024-09-15T12:27:21.274087+0000","last_active":"2024-09-15T12:40:39.214906+0000","last_peered":"2024-09-15T12:40:39.214906+0000","last_clean":"2024-09-15T12:40:39.214906+0000","last_became_active":"2024-09-15T12:27:21.265145+0000","last_became_peered":"2024-09-15T12:27:21.265145+0000","last_unstale":"2024-09-15T12:40:39.214906+0000","last_undegraded":"2024-09-15T12:40:39.214906+0000","last_fullsized":"2024-09-15T12:40:39.214906+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.208851+0000","last_change":"2024-09-15T12:27:21.215295+0000","last_active":"2024-09-15T12:40:39.208851+0000","last_peered":"2024-09-15T12:40:39.208851+0000","last_clean":"2024-09-15T12:40:39.208851+0000","last_became_active":"2024-09-15T12:27:21.195582+0000","last_became_peered":"2024-09-15T12:27:21.195582+0000","last_unstale":"2024-09-15T12:40:39.208851+0000","last_undegraded":"2024-09-15T12:40:39.208851+0000","last_fullsized":"2024-09-15T12:40:39.208851+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.211268+0000","last_change":"2024-09-15T12:27:21.185970+0000","last_active":"2024-09-15T12:40:39.211268+0000","last_peered":"2024-09-15T12:40:39.211268+0000","last_clean":"2024-09-15T12:40:39.211268+0000","last_became_active":"2024-09-15T12:27:21.174023+0000","last_became_peered":"2024-09-15T12:27:21.174023+0000","last_unstale":"2024-09-15T12:40:39.211268+0000","last_undegraded":"2024-09-15T12:40:39.211268+0000","last_fullsized":"2024-09-15T12:40:39.211268+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214589+0000","last_change":"2024-09-15T12:27:21.280402+0000","last_active":"2024-09-15T12:40:39.214589+0000","last_peered":"2024-09-15T12:40:39.214589+0000","last_clean":"2024-09-15T12:40:39.214589+0000","last_became_active":"2024-09-15T12:27:21.265986+0000","last_became_peered":"2024-09-15T12:27:21.265986+0000","last_unstale":"2024-09-15T12:40:39.214589+0000","last_undegraded":"2024-09-15T12:40:39.214589+0000","last_fullsized":"2024-09-15T12:40:39.214589+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.210040+0000","last_change":"2024-09-15T12:27:21.288326+0000","last_active":"2024-09-15T12:40:39.210040+0000","last_peered":"2024-09-15T12:40:39.210040+0000","last_clean":"2024-09-15T12:40:39.210040+0000","last_became_active":"2024-09-15T12:27:21.272862+0000","last_became_peered":"2024-09-15T12:27:21.272862+0000","last_unstale":"2024-09-15T12:40:39.210040+0000","last_undegraded":"2024-09-15T12:40:39.210040+0000","last_fullsized":"2024-09-15T12:40:39.210040+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.203022+0000","last_change":"2024-09-15T12:27:21.186855+0000","last_active":"2024-09-15T12:40:39.203022+0000","last_peered":"2024-09-15T12:40:39.203022+0000","last_clean":"2024-09-15T12:40:39.203022+0000","last_became_active":"2024-09-15T12:27:21.173254+0000","last_became_peered":"2024-09-15T12:27:21.173254+0000","last_unstale":"2024-09-15T12:40:39.203022+0000","last_undegraded":"2024-09-15T12:40:39.203022+0000","last_fullsized":"2024-09-15T12:40:39.203022+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.202973+0000","last_change":"2024-09-15T12:27:21.209103+0000","last_active":"2024-09-15T12:40:39.202973+0000","last_peered":"2024-09-15T12:40:39.202973+0000","last_clean":"2024-09-15T12:40:39.202973+0000","last_became_active":"2024-09-15T12:27:21.202878+0000","last_became_peered":"2024-09-15T12:27:21.202878+0000","last_unstale":"2024-09-15T12:40:39.202973+0000","last_undegraded":"2024-09-15T12:40:39.202973+0000","last_fullsized":"2024-09-15T12:40:39.202973+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.210377+0000","last_change":"2024-09-15T12:27:21.280809+0000","last_active":"2024-09-15T12:40:39.210377+0000","last_peered":"2024-09-15T12:40:39.210377+0000","last_clean":"2024-09-15T12:40:39.210377+0000","last_became_active":"2024-09-15T12:27:21.274273+0000","last_became_peered":"2024-09-15T12:27:21.274273+0000","last_unstale":"2024-09-15T12:40:39.210377+0000","last_undegraded":"2024-09-15T12:40:39.210377+0000","last_fullsized":"2024-09-15T12:40:39.210377+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.211113+0000","last_change":"2024-09-15T12:27:21.242910+0000","last_active":"2024-09-15T12:40:39.211113+0000","last_peered":"2024-09-15T12:40:39.211113+0000","last_clean":"2024-09-15T12:40:39.211113+0000","last_became_active":"2024-09-15T12:27:21.236120+0000","last_became_peered":"2024-09-15T12:27:21.236120+0000","last_unstale":"2024-09-15T12:40:39.211113+0000","last_undegraded":"2024-09-15T12:40:39.211113+0000","last_fullsized":"2024-09-15T12:40:39.211113+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.206000+0000","last_change":"2024-09-15T12:27:21.254314+0000","last_active":"2024-09-15T12:40:39.206000+0000","last_peered":"2024-09-15T12:40:39.206000+0000","last_clean":"2024-09-15T12:40:39.206000+0000","last_became_active":"2024-09-15T12:27:21.241138+0000","last_became_peered":"2024-09-15T12:27:21.241138+0000","last_unstale":"2024-09-15T12:40:39.206000+0000","last_undegraded":"2024-09-15T12:40:39.206000+0000","last_fullsized":"2024-09-15T12:40:39.206000+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.214779+0000","last_change":"2024-09-15T12:27:21.251401+0000","last_active":"2024-09-15T12:40:39.214779+0000","last_peered":"2024-09-15T12:40:39.214779+0000","last_clean":"2024-09-15T12:40:39.214779+0000","last_became_active":"2024-09-15T12:27:21.243633+0000","last_became_peered":"2024-09-15T12:27:21.243633+0000","last_unstale":"2024-09-15T12:40:39.214779+0000","last_undegraded":"2024-09-15T12:40:39.214779+0000","last_fullsized":"2024-09-15T12:40:39.214779+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.203793+0000","last_change":"2024-09-15T12:27:21.342117+0000","last_active":"2024-09-15T12:40:39.203793+0000","last_peered":"2024-09-15T12:40:39.203793+0000","last_clean":"2024-09-15T12:40:39.203793+0000","last_became_active":"2024-09-15T12:27:21.335250+0000","last_became_peered":"2024-09-15T12:27:21.335250+0000","last_unstale":"2024-09-15T12:40:39.203793+0000","last_undegraded":"2024-09-15T12:40:39.203793+0000","last_fullsized":"2024-09-15T12:40:39.203793+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.208478+0000","last_change":"2024-09-15T12:27:21.318846+0000","last_active":"2024-09-15T12:40:39.208478+0000","last_peered":"2024-09-15T12:40:39.208478+0000","last_clean":"2024-09-15T12:40:39.208478+0000","last_became_active":"2024-09-15T12:27:21.306255+0000","last_became_peered":"2024-09-15T12:27:21.306255+0000","last_unstale":"2024-09-15T12:40:39.208478+0000","last_undegraded":"2024-09-15T12:40:39.208478+0000","last_fullsized":"2024-09-15T12:40:39.208478+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.200872+0000","last_change":"2024-09-15T12:27:21.254965+0000","last_active":"2024-09-15T12:40:39.200872+0000","last_peered":"2024-09-15T12:40:39.200872+0000","last_clean":"2024-09-15T12:40:39.200872+0000","last_became_active":"2024-09-15T12:27:21.232463+0000","last_became_peered":"2024-09-15T12:27:21.232463+0000","last_unstale":"2024-09-15T12:40:39.200872+0000","last_undegraded":"2024-09-15T12:40:39.200872+0000","last_fullsized":"2024-09-15T12:40:39.200872+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1464,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.212111+0000","last_change":"2024-09-15T12:27:21.188176+0000","last_active":"2024-09-15T12:40:39.212111+0000","last_peered":"2024-09-15T12:40:39.212111+0000","last_clean":"2024-09-15T12:40:39.212111+0000","last_became_active":"2024-09-15T12:27:21.171794+0000","last_became_peered":"2024-09-15T12:27:21.171794+0000","last_unstale":"2024-09-15T12:40:39.212111+0000","last_undegraded":"2024-09-15T12:40:39.212111+0000","last_fullsized":"2024-09-15T12:40:39.212111+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1451,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.209817+0000","last_change":"2024-09-15T12:27:21.182150+0000","last_active":"2024-09-15T12:40:39.209817+0000","last_peered":"2024-09-15T12:40:39.209817+0000","last_clean":"2024-09-15T12:40:39.209817+0000","last_became_active":"2024-09-15T12:27:21.169417+0000","last_became_peered":"2024-09-15T12:27:21.169417+0000","last_unstale":"2024-09-15T12:40:39.209817+0000","last_undegraded":"2024-09-15T12:40:39.209817+0000","last_fullsized":"2024-09-15T12:40:39.209817+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.201780+0000","last_change":"2024-09-15T12:22:21.439357+0000","last_active":"2024-09-15T12:40:39.201780+0000","last_peered":"2024-09-15T12:40:39.201780+0000","last_clean":"2024-09-15T12:40:39.201780+0000","last_became_active":"2024-09-15T12:22:19.461505+0000","last_became_peered":"2024-09-15T12:22:19.461505+0000","last_unstale":"2024-09-15T12:40:39.201780+0000","last_undegraded":"2024-09-15T12:40:39.201780+0000","last_fullsized":"2024-09-15T12:40:39.201780+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.203188+0000","last_change":"2024-09-15T12:22:21.437833+0000","last_active":"2024-09-15T12:40:39.203188+0000","last_peered":"2024-09-15T12:40:39.203188+0000","last_clean":"2024-09-15T12:40:39.203188+0000","last_became_active":"2024-09-15T12:22:19.483223+0000","last_became_peered":"2024-09-15T12:22:19.483223+0000","last_unstale":"2024-09-15T12:40:39.203188+0000","last_undegraded":"2024-09-15T12:40:39.203188+0000","last_fullsized":"2024-09-15T12:40:39.203188+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.216732+0000","last_change":"2024-09-15T12:22:21.438624+0000","last_active":"2024-09-15T12:40:39.216732+0000","last_peered":"2024-09-15T12:40:39.216732+0000","last_clean":"2024-09-15T12:40:39.216732+0000","last_became_active":"2024-09-15T12:22:19.461144+0000","last_became_peered":"2024-09-15T12:22:19.461144+0000","last_unstale":"2024-09-15T12:40:39.216732+0000","last_undegraded":"2024-09-15T12:40:39.216732+0000","last_fullsized":"2024-09-15T12:40:39.216732+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.198958+0000","last_change":"2024-09-15T12:22:21.436163+0000","last_active":"2024-09-15T12:40:39.198958+0000","last_peered":"2024-09-15T12:40:39.198958+0000","last_clean":"2024-09-15T12:40:39.198958+0000","last_became_active":"2024-09-15T12:22:19.461497+0000","last_became_peered":"2024-09-15T12:22:19.461497+0000","last_unstale":"2024-09-15T12:40:39.198958+0000","last_undegraded":"2024-09-15T12:40:39.198958+0000","last_fullsized":"2024-09-15T12:40:39.198958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2126,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.208144+0000","last_change":"2024-09-15T12:22:21.438691+0000","last_active":"2024-09-15T12:40:39.208144+0000","last_peered":"2024-09-15T12:40:39.208144+0000","last_clean":"2024-09-15T12:40:39.208144+0000","last_became_active":"2024-09-15T12:22:19.461584+0000","last_became_peered":"2024-09-15T12:22:19.461584+0000","last_unstale":"2024-09-15T12:40:39.208144+0000","last_undegraded":"2024-09-15T12:40:39.208144+0000","last_fullsized":"2024-09-15T12:40:39.208144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.204082+0000","last_change":"2024-09-15T12:22:21.438817+0000","last_active":"2024-09-15T12:40:39.204082+0000","last_peered":"2024-09-15T12:40:39.204082+0000","last_clean":"2024-09-15T12:40:39.204082+0000","last_became_active":"2024-09-15T12:22:19.466495+0000","last_became_peered":"2024-09-15T12:22:19.466495+0000","last_unstale":"2024-09-15T12:40:39.204082+0000","last_undegraded":"2024-09-15T12:40:39.204082+0000","last_fullsized":"2024-09-15T12:40:39.204082+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2124,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.207286+0000","last_change":"2024-09-15T12:22:21.438734+0000","last_active":"2024-09-15T12:40:39.207286+0000","last_peered":"2024-09-15T12:40:39.207286+0000","last_clean":"2024-09-15T12:40:39.207286+0000","last_became_active":"2024-09-15T12:22:19.475039+0000","last_became_peered":"2024-09-15T12:22:19.475039+0000","last_unstale":"2024-09-15T12:40:39.207286+0000","last_undegraded":"2024-09-15T12:40:39.207286+0000","last_fullsized":"2024-09-15T12:40:39.207286+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2125,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.210638+0000","last_change":"2024-09-15T12:22:21.441279+0000","last_active":"2024-09-15T12:40:39.210638+0000","last_peered":"2024-09-15T12:40:39.210638+0000","last_clean":"2024-09-15T12:40:39.210638+0000","last_became_active":"2024-09-15T12:22:19.485089+0000","last_became_peered":"2024-09-15T12:22:19.485089+0000","last_unstale":"2024-09-15T12:40:39.210638+0000","last_undegraded":"2024-09-15T12:40:39.210638+0000","last_fullsized":"2024-09-15T12:40:39.210638+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2193,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-09-15T12:40:39.200139+0000","last_change":"2024-09-15T12:22:18.465473+0000","last_active":"2024-09-15T12:40:39.200139+0000","last_peered":"2024-09-15T12:40:39.200139+0000","last_clean":"2024-09-15T12:40:39.200139+0000","last_became_active":"2024-09-15T12:22:18.457094+0000","last_became_peered":"2024-09-15T12:22:18.457094+0000","last_unstale":"2024-09-15T12:40:39.200139+0000","last_undegraded":"2024-09-15T12:40:39.200139+0000","last_fullsized":"2024-09-15T12:40:39.200139+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:17.395744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:17.395744+0000","last_clean_scrub_stamp":"2024-09-15T12:22:17.395744+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949674069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63352,"kb_used_data":1832,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94308488,"statfs":{"total":96636764160,"available":96571891712,"internally_reserved":0,"allocated":1875968,"data_stored":1240421,"data_compressed":106588,"data_compressed_allocated":147456,"data_compressed_original":733184,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59128,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94312712,"statfs":{"total":96636764160,"available":96576217088,"internally_reserved":0,"allocated":1810432,"data_stored":637202,"data_compressed":70656,"data_compressed_allocated":98304,"data_compressed_original":147456,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64680,"kb_used_data":1752,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94307160,"statfs":{"total":96636764160,"available":96570531840,"internally_reserved":0,"allocated":1794048,"data_stored":624308,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706772,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68936,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302904,"statfs":{"total":96636764160,"available":96566173696,"internally_reserved":0,"allocated":1892352,"data_stored":1253315,"data_compressed":112476,"data_compressed_allocated":155648,"data_compressed_original":745472,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:41:16.283 INFO:tasks.ceph:pgid 75.1f last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.283 INFO:tasks.ceph:pgid 75.1e last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.283 INFO:tasks.ceph:pgid 75.1d last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.283 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.283 INFO:tasks.ceph:pgid 75.1b last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.283 INFO:tasks.ceph:pgid 75.1a last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.283 INFO:tasks.ceph:pgid 75.19 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.283 INFO:tasks.ceph:pgid 75.18 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.284 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.284 INFO:tasks.ceph:pgid 75.16 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.284 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.284 INFO:tasks.ceph:pgid 75.14 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.284 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.284 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.284 INFO:tasks.ceph:pgid 75.11 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.284 INFO:tasks.ceph:pgid 75.10 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.284 INFO:tasks.ceph:pgid 75.f last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.285 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.285 INFO:tasks.ceph:pgid 75.d last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.285 INFO:tasks.ceph:pgid 75.c last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.285 INFO:tasks.ceph:pgid 75.b last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.285 INFO:tasks.ceph:pgid 75.a last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.285 INFO:tasks.ceph:pgid 75.9 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.285 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.285 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.285 INFO:tasks.ceph:pgid 75.6 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.285 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.286 INFO:tasks.ceph:pgid 75.4 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.286 INFO:tasks.ceph:pgid 75.3 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.286 INFO:tasks.ceph:pgid 75.2 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.286 INFO:tasks.ceph:pgid 75.1 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.286 INFO:tasks.ceph:pgid 75.0 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.286 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-15T12:22:18.396640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=22, tm_sec=18, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.286 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-15T12:22:18.396640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=22, tm_sec=18, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.286 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-15T12:22:18.396640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=22, tm_sec=18, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.286 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-15T12:22:18.396640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=22, tm_sec=18, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.286 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-15T12:22:18.396640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=22, tm_sec=18, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.287 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-15T12:22:18.396640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=22, tm_sec=18, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.287 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-15T12:22:18.396640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=22, tm_sec=18, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.287 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-15T12:22:18.396640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=22, tm_sec=18, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.287 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-15T12:22:17.395744+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=22, tm_sec=17, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:16.287 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-15T12:41:36.288 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:41:36.412 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.406+0000 7fd0e3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:36.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.411+0000 7fd0e3191640 1 Processor -- start 2024-09-15T12:41:36.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.411+0000 7fd0e3191640 1 -- start start 2024-09-15T12:41:36.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.412+0000 7fd0e3191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd0dc138fd0 0x7fd0dc13b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:36.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.412+0000 7fd0e3191640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0dc136c10 con 0x7fd0dc1360f0 2024-09-15T12:41:36.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.412+0000 7fd0e3191640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fd0dc0a6010 con 0x7fd0dc138fd0 2024-09-15T12:41:36.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.412+0000 7fd0e0f2d640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd0dc1360f0 0x7fd0dc136500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:42080/0 (socket says 172.21.15.122:42080) 2024-09-15T12:41:36.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.412+0000 7fd0e0f2d640 1 -- 172.21.15.122:0/4190074789 learned_addr learned my addr 172.21.15.122:0/4190074789 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:41:36.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.412+0000 7fd0d3fff640 1 --2- 172.21.15.122:0/4190074789 >> v2:172.21.15.122:3300/0 conn(0x7fd0dc138fd0 0x7fd0dc13b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:36.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.412+0000 7fd0d3fff640 1 -- 172.21.15.122:0/4190074789 >> v1:172.21.15.122:6789/0 conn(0x7fd0dc1360f0 legacy=0x7fd0dc136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:36.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.412+0000 7fd0d3fff640 1 -- 172.21.15.122:0/4190074789 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc0a5c40 con 0x7fd0dc138fd0 2024-09-15T12:41:36.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.412+0000 7fd0d3fff640 1 --2- 172.21.15.122:0/4190074789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0dc138fd0 0x7fd0dc13b3f0 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486736dd3eea43bf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:36.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.413+0000 7fd0d37fe640 1 -- 172.21.15.122:0/4190074789 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd0cc009d90 con 0x7fd0dc138fd0 2024-09-15T12:41:36.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.413+0000 7fd0d37fe640 1 -- 172.21.15.122:0/4190074789 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd0cc00e230 con 0x7fd0dc138fd0 2024-09-15T12:41:36.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.413+0000 7fd0d37fe640 1 -- 172.21.15.122:0/4190074789 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd0cc00e4d0 con 0x7fd0dc138fd0 2024-09-15T12:41:36.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.413+0000 7fd0e3191640 1 -- 172.21.15.122:0/4190074789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0dc138fd0 msgr2=0x7fd0dc13b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:36.417 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.413+0000 7fd0e3191640 1 --2- 172.21.15.122:0/4190074789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0dc138fd0 0x7fd0dc13b3f0 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:36.417 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.413+0000 7fd0e3191640 1 -- 172.21.15.122:0/4190074789 shutdown_connections 2024-09-15T12:41:36.417 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.413+0000 7fd0e3191640 1 --2- 172.21.15.122:0/4190074789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0dc138fd0 0x7fd0dc13b3f0 unknown :-1 s=CLOSED pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:36.417 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.413+0000 7fd0e3191640 1 -- 172.21.15.122:0/4190074789 >> 172.21.15.122:0/4190074789 conn(0x7fd0dc06f850 msgr2=0x7fd0dc09ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:36.417 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.413+0000 7fd0e3191640 1 -- 172.21.15.122:0/4190074789 shutdown_connections 2024-09-15T12:41:36.417 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.414+0000 7fd0e3191640 1 -- 172.21.15.122:0/4190074789 wait complete. 2024-09-15T12:41:36.417 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.414+0000 7fd0e3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:36.417 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.415+0000 7fd0e3191640 1 Processor -- start 2024-09-15T12:41:36.417 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.415+0000 7fd0e3191640 1 -- start start 2024-09-15T12:41:36.418 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.416+0000 7fd0e3191640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0dc1360f0 0x7fd0dc1ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:36.418 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.416+0000 7fd0e3191640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc125670 con 0x7fd0dc1360f0 2024-09-15T12:41:36.418 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.416+0000 7fd0e0f2d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0dc1360f0 0x7fd0dc1ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:36.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.416+0000 7fd0e0f2d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0dc1360f0 0x7fd0dc1ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48080/0 (socket says 172.21.15.122:48080) 2024-09-15T12:41:36.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.416+0000 7fd0e0f2d640 1 -- 172.21.15.122:0/2021232191 learned_addr learned my addr 172.21.15.122:0/2021232191 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:36.419 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.417+0000 7fd0e0f2d640 1 -- 172.21.15.122:0/2021232191 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc121a20 con 0x7fd0dc1360f0 2024-09-15T12:41:36.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.417+0000 7fd0e0f2d640 1 --2- 172.21.15.122:0/2021232191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0dc1360f0 0x7fd0dc1ca950 crc :-1 s=READY pgs=13007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:36.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.417+0000 7fd0d17fa640 1 -- 172.21.15.122:0/2021232191 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd0d8005a60 con 0x7fd0dc1360f0 2024-09-15T12:41:36.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.417+0000 7fd0d17fa640 1 -- 172.21.15.122:0/2021232191 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd0d8005bc0 con 0x7fd0dc1360f0 2024-09-15T12:41:36.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.417+0000 7fd0e3191640 1 -- 172.21.15.122:0/2021232191 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0dc1230f0 con 0x7fd0dc1360f0 2024-09-15T12:41:36.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.417+0000 7fd0d17fa640 1 -- 172.21.15.122:0/2021232191 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd0d8005e60 con 0x7fd0dc1360f0 2024-09-15T12:41:36.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.417+0000 7fd0e3191640 1 -- 172.21.15.122:0/2021232191 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0dc1239a0 con 0x7fd0dc1360f0 2024-09-15T12:41:36.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.418+0000 7fd0d17fa640 1 -- 172.21.15.122:0/2021232191 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd0d800c7f0 con 0x7fd0dc1360f0 2024-09-15T12:41:36.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.418+0000 7fd0e3191640 1 -- 172.21.15.122:0/2021232191 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0dc0a0340 con 0x7fd0dc1360f0 2024-09-15T12:41:36.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.418+0000 7fd0d17fa640 1 --2- 172.21.15.122:0/2021232191 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd0c803e960 0x7fd0c8040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:36.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.418+0000 7fd0d17fa640 1 -- 172.21.15.122:0/2021232191 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(720..720 src has 621..720) ==== 3431+0+0 (crc 0 0 0) 0x7fd0d804f870 con 0x7fd0dc1360f0 2024-09-15T12:41:36.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.419+0000 7fd0d3fff640 1 --2- 172.21.15.122:0/2021232191 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd0c803e960 0x7fd0c8040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:36.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.419+0000 7fd0d3fff640 1 --2- 172.21.15.122:0/2021232191 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd0c803e960 0x7fd0c8040e70 crc :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:36.426 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.424+0000 7fd0d17fa640 1 -- 172.21.15.122:0/2021232191 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fd0d800dc10 con 0x7fd0dc1360f0 2024-09-15T12:41:36.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.594+0000 7fd0e3191640 1 -- 172.21.15.122:0/2021232191 --> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0dc1218b0 con 0x7fd0c803e960 2024-09-15T12:41:36.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.597+0000 7fd0d17fa640 1 -- 172.21.15.122:0/2021232191 <== mgr.4100 v2:172.21.15.142:6800/73136857 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109194 (crc 0 0 0) 0x7fd0dc1218b0 con 0x7fd0c803e960 2024-09-15T12:41:36.600 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:41:36.600 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-15T12:41:36.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.599+0000 7fd0e3191640 1 -- 172.21.15.122:0/2021232191 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd0c803e960 msgr2=0x7fd0c8040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:36.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.599+0000 7fd0e3191640 1 --2- 172.21.15.122:0/2021232191 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd0c803e960 0x7fd0c8040e70 crc :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:36.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.599+0000 7fd0e3191640 1 -- 172.21.15.122:0/2021232191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0dc1360f0 msgr2=0x7fd0dc1ca950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:36.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.599+0000 7fd0e3191640 1 --2- 172.21.15.122:0/2021232191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0dc1360f0 0x7fd0dc1ca950 crc :-1 s=READY pgs=13007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:36.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.599+0000 7fd0e3191640 1 -- 172.21.15.122:0/2021232191 shutdown_connections 2024-09-15T12:41:36.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.599+0000 7fd0e3191640 1 --2- 172.21.15.122:0/2021232191 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fd0c803e960 0x7fd0c8040e70 unknown :-1 s=CLOSED pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:36.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.599+0000 7fd0e3191640 1 --2- 172.21.15.122:0/2021232191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0dc1360f0 0x7fd0dc1ca950 unknown :-1 s=CLOSED pgs=13007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:36.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.599+0000 7fd0e3191640 1 -- 172.21.15.122:0/2021232191 >> 172.21.15.122:0/2021232191 conn(0x7fd0dc06f850 msgr2=0x7fd0dc1be300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:36.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.599+0000 7fd0e3191640 1 -- 172.21.15.122:0/2021232191 shutdown_connections 2024-09-15T12:41:36.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:36.599+0000 7fd0e3191640 1 -- 172.21.15.122:0/2021232191 wait complete. 2024-09-15T12:41:36.613 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":1292,"stamp":"2024-09-15T12:41:34.658222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":259752,"kb_used_data":6696,"kb_used_omap":0,"kb_used_meta":252992,"kb_avail":377227608,"statfs":{"total":386547056640,"available":386281070592,"internally_reserved":0,"allocated":6856704,"data_stored":3145168,"data_compressed":60088,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":259063808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003203"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.035567+0000","last_change":"2024-09-15T12:41:15.052783+0000","last_active":"2024-09-15T12:41:15.035567+0000","last_peered":"2024-09-15T12:41:15.035567+0000","last_clean":"2024-09-15T12:41:15.035567+0000","last_became_active":"2024-09-15T12:27:21.162458+0000","last_became_peered":"2024-09-15T12:27:21.162458+0000","last_unstale":"2024-09-15T12:41:15.035567+0000","last_undegraded":"2024-09-15T12:41:15.035567+0000","last_fullsized":"2024-09-15T12:41:15.035567+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.052516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.052516+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.569238+0000","last_change":"2024-09-15T12:41:14.585600+0000","last_active":"2024-09-15T12:41:14.569238+0000","last_peered":"2024-09-15T12:41:14.569238+0000","last_clean":"2024-09-15T12:41:14.569238+0000","last_became_active":"2024-09-15T12:27:21.204453+0000","last_became_peered":"2024-09-15T12:27:21.204453+0000","last_unstale":"2024-09-15T12:41:14.569238+0000","last_undegraded":"2024-09-15T12:41:14.569238+0000","last_fullsized":"2024-09-15T12:41:14.569238+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.585439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.585439+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1457,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:11.214283+0000","last_change":"2024-09-15T12:27:21.164996+0000","last_active":"2024-09-15T12:41:11.214283+0000","last_peered":"2024-09-15T12:41:11.214283+0000","last_clean":"2024-09-15T12:41:11.214283+0000","last_became_active":"2024-09-15T12:27:21.155594+0000","last_became_peered":"2024-09-15T12:27:21.155594+0000","last_unstale":"2024-09-15T12:41:11.214283+0000","last_undegraded":"2024-09-15T12:41:11.214283+0000","last_fullsized":"2024-09-15T12:41:11.214283+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.970004+0000","last_change":"2024-09-15T12:41:16.001408+0000","last_active":"2024-09-15T12:41:15.970004+0000","last_peered":"2024-09-15T12:41:15.970004+0000","last_clean":"2024-09-15T12:41:15.970004+0000","last_became_active":"2024-09-15T12:27:21.154114+0000","last_became_peered":"2024-09-15T12:27:21.154114+0000","last_unstale":"2024-09-15T12:41:15.970004+0000","last_undegraded":"2024-09-15T12:41:15.970004+0000","last_fullsized":"2024-09-15T12:41:15.970004+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:16.001241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:16.001241+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.032202+0000","last_change":"2024-09-15T12:41:15.055053+0000","last_active":"2024-09-15T12:41:15.032202+0000","last_peered":"2024-09-15T12:41:15.032202+0000","last_clean":"2024-09-15T12:41:15.032202+0000","last_became_active":"2024-09-15T12:27:21.208784+0000","last_became_peered":"2024-09-15T12:27:21.208784+0000","last_unstale":"2024-09-15T12:41:15.032202+0000","last_undegraded":"2024-09-15T12:41:15.032202+0000","last_fullsized":"2024-09-15T12:41:15.032202+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.054863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.054863+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.563983+0000","last_change":"2024-09-15T12:41:14.581442+0000","last_active":"2024-09-15T12:41:14.563983+0000","last_peered":"2024-09-15T12:41:14.563983+0000","last_clean":"2024-09-15T12:41:14.563983+0000","last_became_active":"2024-09-15T12:27:21.199501+0000","last_became_peered":"2024-09-15T12:27:21.199501+0000","last_unstale":"2024-09-15T12:41:14.563983+0000","last_undegraded":"2024-09-15T12:41:14.563983+0000","last_fullsized":"2024-09-15T12:41:14.563983+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.581271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.581271+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.564015+0000","last_change":"2024-09-15T12:41:14.584218+0000","last_active":"2024-09-15T12:41:14.564015+0000","last_peered":"2024-09-15T12:41:14.564015+0000","last_clean":"2024-09-15T12:41:14.564015+0000","last_became_active":"2024-09-15T12:27:21.213341+0000","last_became_peered":"2024-09-15T12:27:21.213341+0000","last_unstale":"2024-09-15T12:41:14.564015+0000","last_undegraded":"2024-09-15T12:41:14.564015+0000","last_fullsized":"2024-09-15T12:41:14.564015+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.584056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.584056+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.567406+0000","last_change":"2024-09-15T12:41:14.590142+0000","last_active":"2024-09-15T12:41:14.567406+0000","last_peered":"2024-09-15T12:41:14.567406+0000","last_clean":"2024-09-15T12:41:14.567406+0000","last_became_active":"2024-09-15T12:27:21.314250+0000","last_became_peered":"2024-09-15T12:27:21.314250+0000","last_unstale":"2024-09-15T12:41:14.567406+0000","last_undegraded":"2024-09-15T12:41:14.567406+0000","last_fullsized":"2024-09-15T12:41:14.567406+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.589982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.589982+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.968650+0000","last_change":"2024-09-15T12:41:16.003401+0000","last_active":"2024-09-15T12:41:15.968650+0000","last_peered":"2024-09-15T12:41:15.968650+0000","last_clean":"2024-09-15T12:41:15.968650+0000","last_became_active":"2024-09-15T12:27:21.210467+0000","last_became_peered":"2024-09-15T12:27:21.210467+0000","last_unstale":"2024-09-15T12:41:15.968650+0000","last_undegraded":"2024-09-15T12:41:15.968650+0000","last_fullsized":"2024-09-15T12:41:15.968650+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:16.003234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:16.003234+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1457,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:11.204954+0000","last_change":"2024-09-15T12:27:21.198137+0000","last_active":"2024-09-15T12:41:11.204954+0000","last_peered":"2024-09-15T12:41:11.204954+0000","last_clean":"2024-09-15T12:41:11.204954+0000","last_became_active":"2024-09-15T12:27:21.183618+0000","last_became_peered":"2024-09-15T12:27:21.183618+0000","last_unstale":"2024-09-15T12:41:11.204954+0000","last_undegraded":"2024-09-15T12:41:11.204954+0000","last_fullsized":"2024-09-15T12:41:11.204954+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.965571+0000","last_change":"2024-09-15T12:41:15.992082+0000","last_active":"2024-09-15T12:41:15.965571+0000","last_peered":"2024-09-15T12:41:15.965571+0000","last_clean":"2024-09-15T12:41:15.965571+0000","last_became_active":"2024-09-15T12:27:21.249285+0000","last_became_peered":"2024-09-15T12:27:21.249285+0000","last_unstale":"2024-09-15T12:41:15.965571+0000","last_undegraded":"2024-09-15T12:41:15.965571+0000","last_fullsized":"2024-09-15T12:41:15.965571+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.991897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.991897+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.562758+0000","last_change":"2024-09-15T12:41:14.584217+0000","last_active":"2024-09-15T12:41:14.562758+0000","last_peered":"2024-09-15T12:41:14.562758+0000","last_clean":"2024-09-15T12:41:14.562758+0000","last_became_active":"2024-09-15T12:27:21.269838+0000","last_became_peered":"2024-09-15T12:27:21.269838+0000","last_unstale":"2024-09-15T12:41:14.562758+0000","last_undegraded":"2024-09-15T12:41:14.562758+0000","last_fullsized":"2024-09-15T12:41:14.562758+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.584047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.584047+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.964030+0000","last_change":"2024-09-15T12:41:16.000513+0000","last_active":"2024-09-15T12:41:15.964030+0000","last_peered":"2024-09-15T12:41:15.964030+0000","last_clean":"2024-09-15T12:41:15.964030+0000","last_became_active":"2024-09-15T12:27:21.178077+0000","last_became_peered":"2024-09-15T12:27:21.178077+0000","last_unstale":"2024-09-15T12:41:15.964030+0000","last_undegraded":"2024-09-15T12:41:15.964030+0000","last_fullsized":"2024-09-15T12:41:15.964030+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:16.000348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:16.000348+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.959650+0000","last_change":"2024-09-15T12:41:15.994895+0000","last_active":"2024-09-15T12:41:15.959650+0000","last_peered":"2024-09-15T12:41:15.959650+0000","last_clean":"2024-09-15T12:41:15.959650+0000","last_became_active":"2024-09-15T12:27:21.210134+0000","last_became_peered":"2024-09-15T12:27:21.210134+0000","last_unstale":"2024-09-15T12:41:15.959650+0000","last_undegraded":"2024-09-15T12:41:15.959650+0000","last_fullsized":"2024-09-15T12:41:15.959650+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.994691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.994691+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.560980+0000","last_change":"2024-09-15T12:41:14.579346+0000","last_active":"2024-09-15T12:41:14.560980+0000","last_peered":"2024-09-15T12:41:14.560980+0000","last_clean":"2024-09-15T12:41:14.560980+0000","last_became_active":"2024-09-15T12:27:21.206575+0000","last_became_peered":"2024-09-15T12:27:21.206575+0000","last_unstale":"2024-09-15T12:41:14.560980+0000","last_undegraded":"2024-09-15T12:41:14.560980+0000","last_fullsized":"2024-09-15T12:41:14.560980+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.579191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.579191+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.561733+0000","last_change":"2024-09-15T12:41:14.587541+0000","last_active":"2024-09-15T12:41:14.561733+0000","last_peered":"2024-09-15T12:41:14.561733+0000","last_clean":"2024-09-15T12:41:14.561733+0000","last_became_active":"2024-09-15T12:27:21.301356+0000","last_became_peered":"2024-09-15T12:27:21.301356+0000","last_unstale":"2024-09-15T12:41:14.561733+0000","last_undegraded":"2024-09-15T12:41:14.561733+0000","last_fullsized":"2024-09-15T12:41:14.561733+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.587386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.587386+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.560628+0000","last_change":"2024-09-15T12:41:14.588498+0000","last_active":"2024-09-15T12:41:14.560628+0000","last_peered":"2024-09-15T12:41:14.560628+0000","last_clean":"2024-09-15T12:41:14.560628+0000","last_became_active":"2024-09-15T12:27:21.265145+0000","last_became_peered":"2024-09-15T12:27:21.265145+0000","last_unstale":"2024-09-15T12:41:14.560628+0000","last_undegraded":"2024-09-15T12:41:14.560628+0000","last_fullsized":"2024-09-15T12:41:14.560628+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.588338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.588338+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.956341+0000","last_change":"2024-09-15T12:41:15.996054+0000","last_active":"2024-09-15T12:41:15.956341+0000","last_peered":"2024-09-15T12:41:15.956341+0000","last_clean":"2024-09-15T12:41:15.956341+0000","last_became_active":"2024-09-15T12:27:21.195582+0000","last_became_peered":"2024-09-15T12:27:21.195582+0000","last_unstale":"2024-09-15T12:41:15.956341+0000","last_undegraded":"2024-09-15T12:41:15.956341+0000","last_fullsized":"2024-09-15T12:41:15.956341+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.995877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.995877+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1457,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:11.207977+0000","last_change":"2024-09-15T12:27:21.185970+0000","last_active":"2024-09-15T12:41:11.207977+0000","last_peered":"2024-09-15T12:41:11.207977+0000","last_clean":"2024-09-15T12:41:11.207977+0000","last_became_active":"2024-09-15T12:27:21.174023+0000","last_became_peered":"2024-09-15T12:27:21.174023+0000","last_unstale":"2024-09-15T12:41:11.207977+0000","last_undegraded":"2024-09-15T12:41:11.207977+0000","last_fullsized":"2024-09-15T12:41:11.207977+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.032023+0000","last_change":"2024-09-15T12:41:15.055983+0000","last_active":"2024-09-15T12:41:15.032023+0000","last_peered":"2024-09-15T12:41:15.032023+0000","last_clean":"2024-09-15T12:41:15.032023+0000","last_became_active":"2024-09-15T12:27:21.265986+0000","last_became_peered":"2024-09-15T12:27:21.265986+0000","last_unstale":"2024-09-15T12:41:15.032023+0000","last_undegraded":"2024-09-15T12:41:15.032023+0000","last_fullsized":"2024-09-15T12:41:15.032023+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.055812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.055812+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.030890+0000","last_change":"2024-09-15T12:41:15.057276+0000","last_active":"2024-09-15T12:41:15.030890+0000","last_peered":"2024-09-15T12:41:15.030890+0000","last_clean":"2024-09-15T12:41:15.030890+0000","last_became_active":"2024-09-15T12:27:21.272862+0000","last_became_peered":"2024-09-15T12:27:21.272862+0000","last_unstale":"2024-09-15T12:41:15.030890+0000","last_undegraded":"2024-09-15T12:41:15.030890+0000","last_fullsized":"2024-09-15T12:41:15.030890+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.057108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.057108+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.028144+0000","last_change":"2024-09-15T12:41:15.046851+0000","last_active":"2024-09-15T12:41:15.028144+0000","last_peered":"2024-09-15T12:41:15.028144+0000","last_clean":"2024-09-15T12:41:15.028144+0000","last_became_active":"2024-09-15T12:27:21.173254+0000","last_became_peered":"2024-09-15T12:27:21.173254+0000","last_unstale":"2024-09-15T12:41:15.028144+0000","last_undegraded":"2024-09-15T12:41:15.028144+0000","last_fullsized":"2024-09-15T12:41:15.028144+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.046583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.046583+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1457,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:11.211134+0000","last_change":"2024-09-15T12:27:21.209103+0000","last_active":"2024-09-15T12:41:11.211134+0000","last_peered":"2024-09-15T12:41:11.211134+0000","last_clean":"2024-09-15T12:41:11.211134+0000","last_became_active":"2024-09-15T12:27:21.202878+0000","last_became_peered":"2024-09-15T12:27:21.202878+0000","last_unstale":"2024-09-15T12:41:11.211134+0000","last_undegraded":"2024-09-15T12:41:11.211134+0000","last_fullsized":"2024-09-15T12:41:11.211134+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.957244+0000","last_change":"2024-09-15T12:41:15.986060+0000","last_active":"2024-09-15T12:41:15.957244+0000","last_peered":"2024-09-15T12:41:15.957244+0000","last_clean":"2024-09-15T12:41:15.957244+0000","last_became_active":"2024-09-15T12:27:21.274273+0000","last_became_peered":"2024-09-15T12:27:21.274273+0000","last_unstale":"2024-09-15T12:41:15.957244+0000","last_undegraded":"2024-09-15T12:41:15.957244+0000","last_fullsized":"2024-09-15T12:41:15.957244+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.985851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.985851+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.956317+0000","last_change":"2024-09-15T12:41:15.991030+0000","last_active":"2024-09-15T12:41:15.956317+0000","last_peered":"2024-09-15T12:41:15.956317+0000","last_clean":"2024-09-15T12:41:15.956317+0000","last_became_active":"2024-09-15T12:27:21.236120+0000","last_became_peered":"2024-09-15T12:27:21.236120+0000","last_unstale":"2024-09-15T12:41:15.956317+0000","last_undegraded":"2024-09-15T12:41:15.956317+0000","last_fullsized":"2024-09-15T12:41:15.956317+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.990847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.990847+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.559061+0000","last_change":"2024-09-15T12:41:14.578826+0000","last_active":"2024-09-15T12:41:14.559061+0000","last_peered":"2024-09-15T12:41:14.559061+0000","last_clean":"2024-09-15T12:41:14.559061+0000","last_became_active":"2024-09-15T12:27:21.241138+0000","last_became_peered":"2024-09-15T12:27:21.241138+0000","last_unstale":"2024-09-15T12:41:14.559061+0000","last_undegraded":"2024-09-15T12:41:14.559061+0000","last_fullsized":"2024-09-15T12:41:14.559061+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.578571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.578571+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.956099+0000","last_change":"2024-09-15T12:41:15.987194+0000","last_active":"2024-09-15T12:41:15.956099+0000","last_peered":"2024-09-15T12:41:15.956099+0000","last_clean":"2024-09-15T12:41:15.956099+0000","last_became_active":"2024-09-15T12:27:21.243633+0000","last_became_peered":"2024-09-15T12:27:21.243633+0000","last_unstale":"2024-09-15T12:41:15.956099+0000","last_undegraded":"2024-09-15T12:41:15.956099+0000","last_fullsized":"2024-09-15T12:41:15.956099+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.987000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.987000+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.559692+0000","last_change":"2024-09-15T12:41:14.589186+0000","last_active":"2024-09-15T12:41:14.559692+0000","last_peered":"2024-09-15T12:41:14.559692+0000","last_clean":"2024-09-15T12:41:14.559692+0000","last_became_active":"2024-09-15T12:27:21.335250+0000","last_became_peered":"2024-09-15T12:27:21.335250+0000","last_unstale":"2024-09-15T12:41:14.559692+0000","last_undegraded":"2024-09-15T12:41:14.559692+0000","last_fullsized":"2024-09-15T12:41:14.559692+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.589028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.589028+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.558889+0000","last_change":"2024-09-15T12:41:14.586597+0000","last_active":"2024-09-15T12:41:14.558889+0000","last_peered":"2024-09-15T12:41:14.558889+0000","last_clean":"2024-09-15T12:41:14.558889+0000","last_became_active":"2024-09-15T12:27:21.306255+0000","last_became_peered":"2024-09-15T12:27:21.306255+0000","last_unstale":"2024-09-15T12:41:14.558889+0000","last_undegraded":"2024-09-15T12:41:14.558889+0000","last_fullsized":"2024-09-15T12:41:14.558889+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.586435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.586435+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.556158+0000","last_change":"2024-09-15T12:41:14.574750+0000","last_active":"2024-09-15T12:41:14.556158+0000","last_peered":"2024-09-15T12:41:14.556158+0000","last_clean":"2024-09-15T12:41:14.556158+0000","last_became_active":"2024-09-15T12:27:21.232463+0000","last_became_peered":"2024-09-15T12:27:21.232463+0000","last_unstale":"2024-09-15T12:41:14.556158+0000","last_undegraded":"2024-09-15T12:41:14.556158+0000","last_fullsized":"2024-09-15T12:41:14.556158+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.574580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.574580+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1472,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.029519+0000","last_change":"2024-09-15T12:41:15.050381+0000","last_active":"2024-09-15T12:41:15.029519+0000","last_peered":"2024-09-15T12:41:15.029519+0000","last_clean":"2024-09-15T12:41:15.029519+0000","last_became_active":"2024-09-15T12:27:21.171794+0000","last_became_peered":"2024-09-15T12:27:21.171794+0000","last_unstale":"2024-09-15T12:41:15.029519+0000","last_undegraded":"2024-09-15T12:41:15.029519+0000","last_fullsized":"2024-09-15T12:41:15.029519+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"237'7","last_scrub_stamp":"2024-09-15T12:41:15.050068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.050068+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1457,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:11.211092+0000","last_change":"2024-09-15T12:27:21.182150+0000","last_active":"2024-09-15T12:41:11.211092+0000","last_peered":"2024-09-15T12:41:11.211092+0000","last_clean":"2024-09-15T12:41:11.211092+0000","last_became_active":"2024-09-15T12:27:21.169417+0000","last_became_peered":"2024-09-15T12:27:21.169417+0000","last_unstale":"2024-09-15T12:41:11.211092+0000","last_undegraded":"2024-09-15T12:41:11.211092+0000","last_fullsized":"2024-09-15T12:41:11.211092+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:27:20.042629+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2132,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.026075+0000","last_change":"2024-09-15T12:41:15.044808+0000","last_active":"2024-09-15T12:41:15.026075+0000","last_peered":"2024-09-15T12:41:15.026075+0000","last_clean":"2024-09-15T12:41:15.026075+0000","last_became_active":"2024-09-15T12:22:19.461505+0000","last_became_peered":"2024-09-15T12:22:19.461505+0000","last_unstale":"2024-09-15T12:41:15.026075+0000","last_undegraded":"2024-09-15T12:41:15.026075+0000","last_fullsized":"2024-09-15T12:41:15.026075+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.044634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.044634+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2130,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:11.209046+0000","last_change":"2024-09-15T12:22:21.437833+0000","last_active":"2024-09-15T12:41:11.209046+0000","last_peered":"2024-09-15T12:41:11.209046+0000","last_clean":"2024-09-15T12:41:11.209046+0000","last_became_active":"2024-09-15T12:22:19.483223+0000","last_became_peered":"2024-09-15T12:22:19.483223+0000","last_unstale":"2024-09-15T12:41:11.209046+0000","last_undegraded":"2024-09-15T12:41:11.209046+0000","last_fullsized":"2024-09-15T12:41:11.209046+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2132,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.955153+0000","last_change":"2024-09-15T12:41:15.989973+0000","last_active":"2024-09-15T12:41:15.955153+0000","last_peered":"2024-09-15T12:41:15.955153+0000","last_clean":"2024-09-15T12:41:15.955153+0000","last_became_active":"2024-09-15T12:22:19.461144+0000","last_became_peered":"2024-09-15T12:22:19.461144+0000","last_unstale":"2024-09-15T12:41:15.955153+0000","last_undegraded":"2024-09-15T12:41:15.955153+0000","last_fullsized":"2024-09-15T12:41:15.955153+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.989758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.989758+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2130,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:11.193808+0000","last_change":"2024-09-15T12:22:21.436163+0000","last_active":"2024-09-15T12:41:11.193808+0000","last_peered":"2024-09-15T12:41:11.193808+0000","last_clean":"2024-09-15T12:41:11.193808+0000","last_became_active":"2024-09-15T12:22:19.461497+0000","last_became_peered":"2024-09-15T12:22:19.461497+0000","last_unstale":"2024-09-15T12:41:11.193808+0000","last_undegraded":"2024-09-15T12:41:11.193808+0000","last_fullsized":"2024-09-15T12:41:11.193808+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:22:18.396640+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2134,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.556125+0000","last_change":"2024-09-15T12:41:14.577317+0000","last_active":"2024-09-15T12:41:14.556125+0000","last_peered":"2024-09-15T12:41:14.556125+0000","last_clean":"2024-09-15T12:41:14.556125+0000","last_became_active":"2024-09-15T12:22:19.461584+0000","last_became_peered":"2024-09-15T12:22:19.461584+0000","last_unstale":"2024-09-15T12:41:14.556125+0000","last_undegraded":"2024-09-15T12:41:14.556125+0000","last_fullsized":"2024-09-15T12:41:14.556125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2024-09-15T12:41:14.577038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.577038+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2132,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.024515+0000","last_change":"2024-09-15T12:41:15.041459+0000","last_active":"2024-09-15T12:41:15.024515+0000","last_peered":"2024-09-15T12:41:15.024515+0000","last_clean":"2024-09-15T12:41:15.024515+0000","last_became_active":"2024-09-15T12:22:19.466495+0000","last_became_peered":"2024-09-15T12:22:19.466495+0000","last_unstale":"2024-09-15T12:41:15.024515+0000","last_undegraded":"2024-09-15T12:41:15.024515+0000","last_fullsized":"2024-09-15T12:41:15.024515+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.041295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.041295+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2132,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.556119+0000","last_change":"2024-09-15T12:41:14.574445+0000","last_active":"2024-09-15T12:41:14.556119+0000","last_peered":"2024-09-15T12:41:14.556119+0000","last_clean":"2024-09-15T12:41:14.556119+0000","last_became_active":"2024-09-15T12:22:19.475039+0000","last_became_peered":"2024-09-15T12:22:19.475039+0000","last_unstale":"2024-09-15T12:41:14.556119+0000","last_undegraded":"2024-09-15T12:41:14.556119+0000","last_fullsized":"2024-09-15T12:41:14.556119+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.574172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.574172+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2133,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.027060+0000","last_change":"2024-09-15T12:41:15.058300+0000","last_active":"2024-09-15T12:41:15.027060+0000","last_peered":"2024-09-15T12:41:15.027060+0000","last_clean":"2024-09-15T12:41:15.027060+0000","last_became_active":"2024-09-15T12:22:19.485089+0000","last_became_peered":"2024-09-15T12:22:19.485089+0000","last_unstale":"2024-09-15T12:41:15.027060+0000","last_undegraded":"2024-09-15T12:41:15.027060+0000","last_fullsized":"2024-09-15T12:41:15.027060+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2024-09-15T12:41:15.058124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.058124+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2201,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.952903+0000","last_change":"2024-09-15T12:41:15.999689+0000","last_active":"2024-09-15T12:41:15.952903+0000","last_peered":"2024-09-15T12:41:15.952903+0000","last_clean":"2024-09-15T12:41:15.952903+0000","last_became_active":"2024-09-15T12:22:18.457094+0000","last_became_peered":"2024-09-15T12:22:18.457094+0000","last_unstale":"2024-09-15T12:41:15.952903+0000","last_undegraded":"2024-09-15T12:41:15.952903+0000","last_fullsized":"2024-09-15T12:41:15.952903+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'52","last_scrub_stamp":"2024-09-15T12:41:15.999491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.999491+0000","last_clean_scrub_stamp":"2024-09-15T12:22:17.395744+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949674099,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63220,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94308620,"statfs":{"total":96636764160,"available":96572026880,"internally_reserved":0,"allocated":1740800,"data_stored":1081464,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59008,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94312832,"statfs":{"total":96636764160,"available":96576339968,"internally_reserved":0,"allocated":1687552,"data_stored":491120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68732,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94303108,"statfs":{"total":96636764160,"available":96566382592,"internally_reserved":0,"allocated":1683456,"data_stored":491101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706802,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68792,"kb_used_data":1704,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94303048,"statfs":{"total":96636764160,"available":96566321152,"internally_reserved":0,"allocated":1744896,"data_stored":1081483,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:41:36.614 INFO:tasks.ceph:pgid 75.1d last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:36.615 INFO:tasks.ceph:pgid 75.16 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:36.615 INFO:tasks.ceph:pgid 75.d last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:36.615 INFO:tasks.ceph:pgid 75.9 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:36.615 INFO:tasks.ceph:pgid 75.0 last_scrub_stamp 2024-09-15T12:27:20.042629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=27, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:36.615 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-15T12:22:18.396640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=22, tm_sec=18, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:36.616 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-15T12:22:18.396640+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=22, tm_sec=18, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=41, tm_sec=13, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:41:36.616 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-15T12:41:56.617 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:41:56.750 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.744+0000 7fdbe6888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:56.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.750+0000 7fdbe6888640 1 Processor -- start 2024-09-15T12:41:56.752 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.750+0000 7fdbe6888640 1 -- start start 2024-09-15T12:41:56.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.751+0000 7fdbe6888640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdbe0135c70 0x7fdbe0136080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:56.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.751+0000 7fdbe6888640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe006d1d0 con 0x7fdbe01365c0 2024-09-15T12:41:56.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.751+0000 7fdbe6888640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fdbe006d670 con 0x7fdbe0135c70 2024-09-15T12:41:56.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.751+0000 7fdbdffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdbe0135c70 0x7fdbe0136080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:56.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.751+0000 7fdbdffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdbe0135c70 0x7fdbe0136080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58112/0 (socket says 172.21.15.122:58112) 2024-09-15T12:41:56.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.751+0000 7fdbd7fff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fdbe01365c0 0x7fdbe0132670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:59692/0 (socket says 172.21.15.122:59692) 2024-09-15T12:41:56.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.751+0000 7fdbdffff640 1 -- 172.21.15.122:0/2394835876 learned_addr learned my addr 172.21.15.122:0/2394835876 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:56.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.751+0000 7fdbdffff640 1 -- 172.21.15.122:0/2394835876 >> v1:172.21.15.122:6789/0 conn(0x7fdbe01365c0 legacy=0x7fdbe0132670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:56.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.751+0000 7fdbdf7fe640 1 -- 172.21.15.122:0/2394835876 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3071780396 0 0) 0x7fdbe006d1d0 con 0x7fdbe01365c0 2024-09-15T12:41:56.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.751+0000 7fdbdffff640 1 -- 172.21.15.122:0/2394835876 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe009e070 con 0x7fdbe0135c70 2024-09-15T12:41:56.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.752+0000 7fdbdffff640 1 --2- 172.21.15.122:0/2394835876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbe0135c70 0x7fdbe0136080 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3171aa7d751a36cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:56.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.752+0000 7fdbdf7fe640 1 -- 172.21.15.122:0/2394835876 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdbd0009e50 con 0x7fdbe0135c70 2024-09-15T12:41:56.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.752+0000 7fdbdf7fe640 1 -- 172.21.15.122:0/2394835876 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdbd000e230 con 0x7fdbe0135c70 2024-09-15T12:41:56.755 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.752+0000 7fdbdf7fe640 1 -- 172.21.15.122:0/2394835876 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdbd000e4d0 con 0x7fdbe0135c70 2024-09-15T12:41:56.756 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.753+0000 7fdbe6888640 1 -- 172.21.15.122:0/2394835876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbe0135c70 msgr2=0x7fdbe0136080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:56.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.753+0000 7fdbe6888640 1 --2- 172.21.15.122:0/2394835876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbe0135c70 0x7fdbe0136080 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:56.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.753+0000 7fdbe6888640 1 -- 172.21.15.122:0/2394835876 shutdown_connections 2024-09-15T12:41:56.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.753+0000 7fdbe6888640 1 --2- 172.21.15.122:0/2394835876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbe0135c70 0x7fdbe0136080 unknown :-1 s=CLOSED pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:56.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.753+0000 7fdbe6888640 1 -- 172.21.15.122:0/2394835876 >> 172.21.15.122:0/2394835876 conn(0x7fdbe00a2970 msgr2=0x7fdbe00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:56.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.753+0000 7fdbe6888640 1 -- 172.21.15.122:0/2394835876 shutdown_connections 2024-09-15T12:41:56.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.753+0000 7fdbe6888640 1 -- 172.21.15.122:0/2394835876 wait complete. 2024-09-15T12:41:56.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.753+0000 7fdbe6888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:56.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.754+0000 7fdbe6888640 1 Processor -- start 2024-09-15T12:41:56.757 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.754+0000 7fdbe6888640 1 -- start start 2024-09-15T12:41:56.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.755+0000 7fdbe6888640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbe0135c70 0x7fdbe011f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:56.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.755+0000 7fdbe6888640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe0074a50 con 0x7fdbe0135c70 2024-09-15T12:41:56.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.756+0000 7fdbdffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbe0135c70 0x7fdbe011f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:56.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.756+0000 7fdbdffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbe0135c70 0x7fdbe011f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58124/0 (socket says 172.21.15.122:58124) 2024-09-15T12:41:56.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.756+0000 7fdbdffff640 1 -- 172.21.15.122:0/3006407076 learned_addr learned my addr 172.21.15.122:0/3006407076 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:56.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.756+0000 7fdbdffff640 1 -- 172.21.15.122:0/3006407076 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe00a08b0 con 0x7fdbe0135c70 2024-09-15T12:41:56.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.756+0000 7fdbdffff640 1 --2- 172.21.15.122:0/3006407076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbe0135c70 0x7fdbe011f4d0 crc :-1 s=READY pgs=13010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:56.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.756+0000 7fdbdd7fa640 1 -- 172.21.15.122:0/3006407076 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdbd000edc0 con 0x7fdbe0135c70 2024-09-15T12:41:56.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.756+0000 7fdbdd7fa640 1 -- 172.21.15.122:0/3006407076 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdbd0015420 con 0x7fdbe0135c70 2024-09-15T12:41:56.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.756+0000 7fdbe6888640 1 -- 172.21.15.122:0/3006407076 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe0122f00 con 0x7fdbe0135c70 2024-09-15T12:41:56.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.756+0000 7fdbdd7fa640 1 -- 172.21.15.122:0/3006407076 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdbd00156c0 con 0x7fdbe0135c70 2024-09-15T12:41:56.760 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.756+0000 7fdbe6888640 1 -- 172.21.15.122:0/3006407076 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe0122ba0 con 0x7fdbe0135c70 2024-09-15T12:41:56.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.757+0000 7fdbe6888640 1 -- 172.21.15.122:0/3006407076 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe0136080 con 0x7fdbe0135c70 2024-09-15T12:41:56.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.757+0000 7fdbdd7fa640 1 -- 172.21.15.122:0/3006407076 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fdbd0015870 con 0x7fdbe0135c70 2024-09-15T12:41:56.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.758+0000 7fdbdd7fa640 1 --2- 172.21.15.122:0/3006407076 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fdbc003e930 0x7fdbc0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:56.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.758+0000 7fdbdd7fa640 1 -- 172.21.15.122:0/3006407076 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(720..720 src has 621..720) ==== 3431+0+0 (crc 0 0 0) 0x7fdbd0050f00 con 0x7fdbe0135c70 2024-09-15T12:41:56.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.758+0000 7fdbd7fff640 1 --2- 172.21.15.122:0/3006407076 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fdbc003e930 0x7fdbc0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:56.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.759+0000 7fdbd7fff640 1 --2- 172.21.15.122:0/3006407076 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fdbc003e930 0x7fdbc0040e40 crc :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:56.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.763+0000 7fdbdd7fa640 1 -- 172.21.15.122:0/3006407076 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fdbd0010a00 con 0x7fdbe0135c70 2024-09-15T12:41:56.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.935+0000 7fdbe6888640 1 -- 172.21.15.122:0/3006407076 --> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdbe009eeb0 con 0x7fdbc003e930 2024-09-15T12:41:56.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.937+0000 7fdbdd7fa640 1 -- 172.21.15.122:0/3006407076 <== mgr.4100 v2:172.21.15.142:6800/73136857 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109194 (crc 0 0 0) 0x7fdbc80012b0 con 0x7fdbc003e930 2024-09-15T12:41:56.941 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-15T12:41:56.942 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-15T12:41:56.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.940+0000 7fdbe6888640 1 -- 172.21.15.122:0/3006407076 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fdbc003e930 msgr2=0x7fdbc0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:56.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.940+0000 7fdbe6888640 1 --2- 172.21.15.122:0/3006407076 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fdbc003e930 0x7fdbc0040e40 crc :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:56.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.940+0000 7fdbe6888640 1 -- 172.21.15.122:0/3006407076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbe0135c70 msgr2=0x7fdbe011f4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:56.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.940+0000 7fdbe6888640 1 --2- 172.21.15.122:0/3006407076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbe0135c70 0x7fdbe011f4d0 crc :-1 s=READY pgs=13010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:56.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.940+0000 7fdbe6888640 1 -- 172.21.15.122:0/3006407076 shutdown_connections 2024-09-15T12:41:56.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.940+0000 7fdbe6888640 1 --2- 172.21.15.122:0/3006407076 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fdbc003e930 0x7fdbc0040e40 unknown :-1 s=CLOSED pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:56.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.940+0000 7fdbe6888640 1 --2- 172.21.15.122:0/3006407076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbe0135c70 0x7fdbe011f4d0 unknown :-1 s=CLOSED pgs=13010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:56.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.940+0000 7fdbe6888640 1 -- 172.21.15.122:0/3006407076 >> 172.21.15.122:0/3006407076 conn(0x7fdbe00a2970 msgr2=0x7fdbe01339d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:56.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.940+0000 7fdbe6888640 1 -- 172.21.15.122:0/3006407076 shutdown_connections 2024-09-15T12:41:56.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:56.940+0000 7fdbe6888640 1 -- 172.21.15.122:0/3006407076 wait complete. 2024-09-15T12:41:56.953 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":1303,"stamp":"2024-09-15T12:41:56.664463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":259752,"kb_used_data":6696,"kb_used_omap":0,"kb_used_meta":252992,"kb_avail":377227608,"statfs":{"total":386547056640,"available":386281070592,"internally_reserved":0,"allocated":6856704,"data_stored":3145168,"data_compressed":60088,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":259063808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003548"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.035567+0000","last_change":"2024-09-15T12:41:15.052783+0000","last_active":"2024-09-15T12:41:15.035567+0000","last_peered":"2024-09-15T12:41:15.035567+0000","last_clean":"2024-09-15T12:41:15.035567+0000","last_became_active":"2024-09-15T12:27:21.162458+0000","last_became_peered":"2024-09-15T12:27:21.162458+0000","last_unstale":"2024-09-15T12:41:15.035567+0000","last_undegraded":"2024-09-15T12:41:15.035567+0000","last_fullsized":"2024-09-15T12:41:15.035567+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.052516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.052516+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.569238+0000","last_change":"2024-09-15T12:41:14.585600+0000","last_active":"2024-09-15T12:41:14.569238+0000","last_peered":"2024-09-15T12:41:14.569238+0000","last_clean":"2024-09-15T12:41:14.569238+0000","last_became_active":"2024-09-15T12:27:21.204453+0000","last_became_peered":"2024-09-15T12:27:21.204453+0000","last_unstale":"2024-09-15T12:41:14.569238+0000","last_undegraded":"2024-09-15T12:41:14.569238+0000","last_fullsized":"2024-09-15T12:41:14.569238+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.585439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.585439+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.491852+0000","last_change":"2024-09-15T12:41:15.515260+0000","last_active":"2024-09-15T12:41:15.491852+0000","last_peered":"2024-09-15T12:41:15.491852+0000","last_clean":"2024-09-15T12:41:15.491852+0000","last_became_active":"2024-09-15T12:27:21.155594+0000","last_became_peered":"2024-09-15T12:27:21.155594+0000","last_unstale":"2024-09-15T12:41:15.491852+0000","last_undegraded":"2024-09-15T12:41:15.491852+0000","last_fullsized":"2024-09-15T12:41:15.491852+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.515054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.515054+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.970004+0000","last_change":"2024-09-15T12:41:16.001408+0000","last_active":"2024-09-15T12:41:15.970004+0000","last_peered":"2024-09-15T12:41:15.970004+0000","last_clean":"2024-09-15T12:41:15.970004+0000","last_became_active":"2024-09-15T12:27:21.154114+0000","last_became_peered":"2024-09-15T12:27:21.154114+0000","last_unstale":"2024-09-15T12:41:15.970004+0000","last_undegraded":"2024-09-15T12:41:15.970004+0000","last_fullsized":"2024-09-15T12:41:15.970004+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:16.001241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:16.001241+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.032202+0000","last_change":"2024-09-15T12:41:15.055053+0000","last_active":"2024-09-15T12:41:15.032202+0000","last_peered":"2024-09-15T12:41:15.032202+0000","last_clean":"2024-09-15T12:41:15.032202+0000","last_became_active":"2024-09-15T12:27:21.208784+0000","last_became_peered":"2024-09-15T12:27:21.208784+0000","last_unstale":"2024-09-15T12:41:15.032202+0000","last_undegraded":"2024-09-15T12:41:15.032202+0000","last_fullsized":"2024-09-15T12:41:15.032202+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.054863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.054863+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.563983+0000","last_change":"2024-09-15T12:41:14.581442+0000","last_active":"2024-09-15T12:41:14.563983+0000","last_peered":"2024-09-15T12:41:14.563983+0000","last_clean":"2024-09-15T12:41:14.563983+0000","last_became_active":"2024-09-15T12:27:21.199501+0000","last_became_peered":"2024-09-15T12:27:21.199501+0000","last_unstale":"2024-09-15T12:41:14.563983+0000","last_undegraded":"2024-09-15T12:41:14.563983+0000","last_fullsized":"2024-09-15T12:41:14.563983+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.581271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.581271+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.564015+0000","last_change":"2024-09-15T12:41:14.584218+0000","last_active":"2024-09-15T12:41:14.564015+0000","last_peered":"2024-09-15T12:41:14.564015+0000","last_clean":"2024-09-15T12:41:14.564015+0000","last_became_active":"2024-09-15T12:27:21.213341+0000","last_became_peered":"2024-09-15T12:27:21.213341+0000","last_unstale":"2024-09-15T12:41:14.564015+0000","last_undegraded":"2024-09-15T12:41:14.564015+0000","last_fullsized":"2024-09-15T12:41:14.564015+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.584056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.584056+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.567406+0000","last_change":"2024-09-15T12:41:14.590142+0000","last_active":"2024-09-15T12:41:14.567406+0000","last_peered":"2024-09-15T12:41:14.567406+0000","last_clean":"2024-09-15T12:41:14.567406+0000","last_became_active":"2024-09-15T12:27:21.314250+0000","last_became_peered":"2024-09-15T12:27:21.314250+0000","last_unstale":"2024-09-15T12:41:14.567406+0000","last_undegraded":"2024-09-15T12:41:14.567406+0000","last_fullsized":"2024-09-15T12:41:14.567406+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.589982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.589982+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.968650+0000","last_change":"2024-09-15T12:41:16.003401+0000","last_active":"2024-09-15T12:41:15.968650+0000","last_peered":"2024-09-15T12:41:15.968650+0000","last_clean":"2024-09-15T12:41:15.968650+0000","last_became_active":"2024-09-15T12:27:21.210467+0000","last_became_peered":"2024-09-15T12:27:21.210467+0000","last_unstale":"2024-09-15T12:41:15.968650+0000","last_undegraded":"2024-09-15T12:41:15.968650+0000","last_fullsized":"2024-09-15T12:41:15.968650+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:16.003234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:16.003234+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.490264+0000","last_change":"2024-09-15T12:41:15.509614+0000","last_active":"2024-09-15T12:41:15.490264+0000","last_peered":"2024-09-15T12:41:15.490264+0000","last_clean":"2024-09-15T12:41:15.490264+0000","last_became_active":"2024-09-15T12:27:21.183618+0000","last_became_peered":"2024-09-15T12:27:21.183618+0000","last_unstale":"2024-09-15T12:41:15.490264+0000","last_undegraded":"2024-09-15T12:41:15.490264+0000","last_fullsized":"2024-09-15T12:41:15.490264+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.509288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.509288+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.965571+0000","last_change":"2024-09-15T12:41:15.992082+0000","last_active":"2024-09-15T12:41:15.965571+0000","last_peered":"2024-09-15T12:41:15.965571+0000","last_clean":"2024-09-15T12:41:15.965571+0000","last_became_active":"2024-09-15T12:27:21.249285+0000","last_became_peered":"2024-09-15T12:27:21.249285+0000","last_unstale":"2024-09-15T12:41:15.965571+0000","last_undegraded":"2024-09-15T12:41:15.965571+0000","last_fullsized":"2024-09-15T12:41:15.965571+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.991897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.991897+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.562758+0000","last_change":"2024-09-15T12:41:14.584217+0000","last_active":"2024-09-15T12:41:14.562758+0000","last_peered":"2024-09-15T12:41:14.562758+0000","last_clean":"2024-09-15T12:41:14.562758+0000","last_became_active":"2024-09-15T12:27:21.269838+0000","last_became_peered":"2024-09-15T12:27:21.269838+0000","last_unstale":"2024-09-15T12:41:14.562758+0000","last_undegraded":"2024-09-15T12:41:14.562758+0000","last_fullsized":"2024-09-15T12:41:14.562758+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.584047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.584047+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.964030+0000","last_change":"2024-09-15T12:41:16.000513+0000","last_active":"2024-09-15T12:41:15.964030+0000","last_peered":"2024-09-15T12:41:15.964030+0000","last_clean":"2024-09-15T12:41:15.964030+0000","last_became_active":"2024-09-15T12:27:21.178077+0000","last_became_peered":"2024-09-15T12:27:21.178077+0000","last_unstale":"2024-09-15T12:41:15.964030+0000","last_undegraded":"2024-09-15T12:41:15.964030+0000","last_fullsized":"2024-09-15T12:41:15.964030+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:16.000348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:16.000348+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.959650+0000","last_change":"2024-09-15T12:41:15.994895+0000","last_active":"2024-09-15T12:41:15.959650+0000","last_peered":"2024-09-15T12:41:15.959650+0000","last_clean":"2024-09-15T12:41:15.959650+0000","last_became_active":"2024-09-15T12:27:21.210134+0000","last_became_peered":"2024-09-15T12:27:21.210134+0000","last_unstale":"2024-09-15T12:41:15.959650+0000","last_undegraded":"2024-09-15T12:41:15.959650+0000","last_fullsized":"2024-09-15T12:41:15.959650+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.994691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.994691+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.560980+0000","last_change":"2024-09-15T12:41:14.579346+0000","last_active":"2024-09-15T12:41:14.560980+0000","last_peered":"2024-09-15T12:41:14.560980+0000","last_clean":"2024-09-15T12:41:14.560980+0000","last_became_active":"2024-09-15T12:27:21.206575+0000","last_became_peered":"2024-09-15T12:27:21.206575+0000","last_unstale":"2024-09-15T12:41:14.560980+0000","last_undegraded":"2024-09-15T12:41:14.560980+0000","last_fullsized":"2024-09-15T12:41:14.560980+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.579191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.579191+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.561733+0000","last_change":"2024-09-15T12:41:14.587541+0000","last_active":"2024-09-15T12:41:14.561733+0000","last_peered":"2024-09-15T12:41:14.561733+0000","last_clean":"2024-09-15T12:41:14.561733+0000","last_became_active":"2024-09-15T12:27:21.301356+0000","last_became_peered":"2024-09-15T12:27:21.301356+0000","last_unstale":"2024-09-15T12:41:14.561733+0000","last_undegraded":"2024-09-15T12:41:14.561733+0000","last_fullsized":"2024-09-15T12:41:14.561733+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.587386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.587386+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.560628+0000","last_change":"2024-09-15T12:41:14.588498+0000","last_active":"2024-09-15T12:41:14.560628+0000","last_peered":"2024-09-15T12:41:14.560628+0000","last_clean":"2024-09-15T12:41:14.560628+0000","last_became_active":"2024-09-15T12:27:21.265145+0000","last_became_peered":"2024-09-15T12:27:21.265145+0000","last_unstale":"2024-09-15T12:41:14.560628+0000","last_undegraded":"2024-09-15T12:41:14.560628+0000","last_fullsized":"2024-09-15T12:41:14.560628+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.588338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.588338+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.956341+0000","last_change":"2024-09-15T12:41:15.996054+0000","last_active":"2024-09-15T12:41:15.956341+0000","last_peered":"2024-09-15T12:41:15.956341+0000","last_clean":"2024-09-15T12:41:15.956341+0000","last_became_active":"2024-09-15T12:27:21.195582+0000","last_became_peered":"2024-09-15T12:27:21.195582+0000","last_unstale":"2024-09-15T12:41:15.956341+0000","last_undegraded":"2024-09-15T12:41:15.956341+0000","last_fullsized":"2024-09-15T12:41:15.956341+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.995877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.995877+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.492478+0000","last_change":"2024-09-15T12:41:15.504993+0000","last_active":"2024-09-15T12:41:15.492478+0000","last_peered":"2024-09-15T12:41:15.492478+0000","last_clean":"2024-09-15T12:41:15.492478+0000","last_became_active":"2024-09-15T12:27:21.174023+0000","last_became_peered":"2024-09-15T12:27:21.174023+0000","last_unstale":"2024-09-15T12:41:15.492478+0000","last_undegraded":"2024-09-15T12:41:15.492478+0000","last_fullsized":"2024-09-15T12:41:15.492478+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.504789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.504789+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.032023+0000","last_change":"2024-09-15T12:41:15.055983+0000","last_active":"2024-09-15T12:41:15.032023+0000","last_peered":"2024-09-15T12:41:15.032023+0000","last_clean":"2024-09-15T12:41:15.032023+0000","last_became_active":"2024-09-15T12:27:21.265986+0000","last_became_peered":"2024-09-15T12:27:21.265986+0000","last_unstale":"2024-09-15T12:41:15.032023+0000","last_undegraded":"2024-09-15T12:41:15.032023+0000","last_fullsized":"2024-09-15T12:41:15.032023+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.055812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.055812+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.030890+0000","last_change":"2024-09-15T12:41:15.057276+0000","last_active":"2024-09-15T12:41:15.030890+0000","last_peered":"2024-09-15T12:41:15.030890+0000","last_clean":"2024-09-15T12:41:15.030890+0000","last_became_active":"2024-09-15T12:27:21.272862+0000","last_became_peered":"2024-09-15T12:27:21.272862+0000","last_unstale":"2024-09-15T12:41:15.030890+0000","last_undegraded":"2024-09-15T12:41:15.030890+0000","last_fullsized":"2024-09-15T12:41:15.030890+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.057108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.057108+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.028144+0000","last_change":"2024-09-15T12:41:15.046851+0000","last_active":"2024-09-15T12:41:15.028144+0000","last_peered":"2024-09-15T12:41:15.028144+0000","last_clean":"2024-09-15T12:41:15.028144+0000","last_became_active":"2024-09-15T12:27:21.173254+0000","last_became_peered":"2024-09-15T12:27:21.173254+0000","last_unstale":"2024-09-15T12:41:15.028144+0000","last_undegraded":"2024-09-15T12:41:15.028144+0000","last_fullsized":"2024-09-15T12:41:15.028144+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.046583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.046583+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.490112+0000","last_change":"2024-09-15T12:41:15.514142+0000","last_active":"2024-09-15T12:41:15.490112+0000","last_peered":"2024-09-15T12:41:15.490112+0000","last_clean":"2024-09-15T12:41:15.490112+0000","last_became_active":"2024-09-15T12:27:21.202878+0000","last_became_peered":"2024-09-15T12:27:21.202878+0000","last_unstale":"2024-09-15T12:41:15.490112+0000","last_undegraded":"2024-09-15T12:41:15.490112+0000","last_fullsized":"2024-09-15T12:41:15.490112+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.513953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.513953+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.957244+0000","last_change":"2024-09-15T12:41:15.986060+0000","last_active":"2024-09-15T12:41:15.957244+0000","last_peered":"2024-09-15T12:41:15.957244+0000","last_clean":"2024-09-15T12:41:15.957244+0000","last_became_active":"2024-09-15T12:27:21.274273+0000","last_became_peered":"2024-09-15T12:27:21.274273+0000","last_unstale":"2024-09-15T12:41:15.957244+0000","last_undegraded":"2024-09-15T12:41:15.957244+0000","last_fullsized":"2024-09-15T12:41:15.957244+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.985851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.985851+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.956317+0000","last_change":"2024-09-15T12:41:15.991030+0000","last_active":"2024-09-15T12:41:15.956317+0000","last_peered":"2024-09-15T12:41:15.956317+0000","last_clean":"2024-09-15T12:41:15.956317+0000","last_became_active":"2024-09-15T12:27:21.236120+0000","last_became_peered":"2024-09-15T12:27:21.236120+0000","last_unstale":"2024-09-15T12:41:15.956317+0000","last_undegraded":"2024-09-15T12:41:15.956317+0000","last_fullsized":"2024-09-15T12:41:15.956317+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.990847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.990847+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.559061+0000","last_change":"2024-09-15T12:41:14.578826+0000","last_active":"2024-09-15T12:41:14.559061+0000","last_peered":"2024-09-15T12:41:14.559061+0000","last_clean":"2024-09-15T12:41:14.559061+0000","last_became_active":"2024-09-15T12:27:21.241138+0000","last_became_peered":"2024-09-15T12:27:21.241138+0000","last_unstale":"2024-09-15T12:41:14.559061+0000","last_undegraded":"2024-09-15T12:41:14.559061+0000","last_fullsized":"2024-09-15T12:41:14.559061+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.578571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.578571+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.956099+0000","last_change":"2024-09-15T12:41:15.987194+0000","last_active":"2024-09-15T12:41:15.956099+0000","last_peered":"2024-09-15T12:41:15.956099+0000","last_clean":"2024-09-15T12:41:15.956099+0000","last_became_active":"2024-09-15T12:27:21.243633+0000","last_became_peered":"2024-09-15T12:27:21.243633+0000","last_unstale":"2024-09-15T12:41:15.956099+0000","last_undegraded":"2024-09-15T12:41:15.956099+0000","last_fullsized":"2024-09-15T12:41:15.956099+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.987000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.987000+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.559692+0000","last_change":"2024-09-15T12:41:14.589186+0000","last_active":"2024-09-15T12:41:14.559692+0000","last_peered":"2024-09-15T12:41:14.559692+0000","last_clean":"2024-09-15T12:41:14.559692+0000","last_became_active":"2024-09-15T12:27:21.335250+0000","last_became_peered":"2024-09-15T12:27:21.335250+0000","last_unstale":"2024-09-15T12:41:14.559692+0000","last_undegraded":"2024-09-15T12:41:14.559692+0000","last_fullsized":"2024-09-15T12:41:14.559692+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.589028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.589028+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.558889+0000","last_change":"2024-09-15T12:41:14.586597+0000","last_active":"2024-09-15T12:41:14.558889+0000","last_peered":"2024-09-15T12:41:14.558889+0000","last_clean":"2024-09-15T12:41:14.558889+0000","last_became_active":"2024-09-15T12:27:21.306255+0000","last_became_peered":"2024-09-15T12:27:21.306255+0000","last_unstale":"2024-09-15T12:41:14.558889+0000","last_undegraded":"2024-09-15T12:41:14.558889+0000","last_fullsized":"2024-09-15T12:41:14.558889+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.586435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.586435+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.556158+0000","last_change":"2024-09-15T12:41:14.574750+0000","last_active":"2024-09-15T12:41:14.556158+0000","last_peered":"2024-09-15T12:41:14.556158+0000","last_clean":"2024-09-15T12:41:14.556158+0000","last_became_active":"2024-09-15T12:27:21.232463+0000","last_became_peered":"2024-09-15T12:27:21.232463+0000","last_unstale":"2024-09-15T12:41:14.556158+0000","last_undegraded":"2024-09-15T12:41:14.556158+0000","last_fullsized":"2024-09-15T12:41:14.556158+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.574580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.574580+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1472,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.029519+0000","last_change":"2024-09-15T12:41:15.050381+0000","last_active":"2024-09-15T12:41:15.029519+0000","last_peered":"2024-09-15T12:41:15.029519+0000","last_clean":"2024-09-15T12:41:15.029519+0000","last_became_active":"2024-09-15T12:27:21.171794+0000","last_became_peered":"2024-09-15T12:27:21.171794+0000","last_unstale":"2024-09-15T12:41:15.029519+0000","last_undegraded":"2024-09-15T12:41:15.029519+0000","last_fullsized":"2024-09-15T12:41:15.029519+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"237'7","last_scrub_stamp":"2024-09-15T12:41:15.050068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.050068+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1459,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.491322+0000","last_change":"2024-09-15T12:41:15.509474+0000","last_active":"2024-09-15T12:41:15.491322+0000","last_peered":"2024-09-15T12:41:15.491322+0000","last_clean":"2024-09-15T12:41:15.491322+0000","last_became_active":"2024-09-15T12:27:21.169417+0000","last_became_peered":"2024-09-15T12:27:21.169417+0000","last_unstale":"2024-09-15T12:41:15.491322+0000","last_undegraded":"2024-09-15T12:41:15.491322+0000","last_fullsized":"2024-09-15T12:41:15.491322+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.509288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.509288+0000","last_clean_scrub_stamp":"2024-09-15T12:27:20.042629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2132,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.026075+0000","last_change":"2024-09-15T12:41:15.044808+0000","last_active":"2024-09-15T12:41:15.026075+0000","last_peered":"2024-09-15T12:41:15.026075+0000","last_clean":"2024-09-15T12:41:15.026075+0000","last_became_active":"2024-09-15T12:22:19.461505+0000","last_became_peered":"2024-09-15T12:22:19.461505+0000","last_unstale":"2024-09-15T12:41:15.026075+0000","last_undegraded":"2024-09-15T12:41:15.026075+0000","last_fullsized":"2024-09-15T12:41:15.026075+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.044634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.044634+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2132,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.490212+0000","last_change":"2024-09-15T12:41:15.510941+0000","last_active":"2024-09-15T12:41:15.490212+0000","last_peered":"2024-09-15T12:41:15.490212+0000","last_clean":"2024-09-15T12:41:15.490212+0000","last_became_active":"2024-09-15T12:22:19.483223+0000","last_became_peered":"2024-09-15T12:22:19.483223+0000","last_unstale":"2024-09-15T12:41:15.490212+0000","last_undegraded":"2024-09-15T12:41:15.490212+0000","last_fullsized":"2024-09-15T12:41:15.490212+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.510643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.510643+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2132,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.955153+0000","last_change":"2024-09-15T12:41:15.989973+0000","last_active":"2024-09-15T12:41:15.955153+0000","last_peered":"2024-09-15T12:41:15.955153+0000","last_clean":"2024-09-15T12:41:15.955153+0000","last_became_active":"2024-09-15T12:22:19.461144+0000","last_became_peered":"2024-09-15T12:22:19.461144+0000","last_unstale":"2024-09-15T12:41:15.955153+0000","last_undegraded":"2024-09-15T12:41:15.955153+0000","last_fullsized":"2024-09-15T12:41:15.955153+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.989758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.989758+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2132,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.487793+0000","last_change":"2024-09-15T12:41:15.502434+0000","last_active":"2024-09-15T12:41:15.487793+0000","last_peered":"2024-09-15T12:41:15.487793+0000","last_clean":"2024-09-15T12:41:15.487793+0000","last_became_active":"2024-09-15T12:22:19.461497+0000","last_became_peered":"2024-09-15T12:22:19.461497+0000","last_unstale":"2024-09-15T12:41:15.487793+0000","last_undegraded":"2024-09-15T12:41:15.487793+0000","last_fullsized":"2024-09-15T12:41:15.487793+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.502203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.502203+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2134,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.556125+0000","last_change":"2024-09-15T12:41:14.577317+0000","last_active":"2024-09-15T12:41:14.556125+0000","last_peered":"2024-09-15T12:41:14.556125+0000","last_clean":"2024-09-15T12:41:14.556125+0000","last_became_active":"2024-09-15T12:22:19.461584+0000","last_became_peered":"2024-09-15T12:22:19.461584+0000","last_unstale":"2024-09-15T12:41:14.556125+0000","last_undegraded":"2024-09-15T12:41:14.556125+0000","last_fullsized":"2024-09-15T12:41:14.556125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2024-09-15T12:41:14.577038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.577038+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2132,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.024515+0000","last_change":"2024-09-15T12:41:15.041459+0000","last_active":"2024-09-15T12:41:15.024515+0000","last_peered":"2024-09-15T12:41:15.024515+0000","last_clean":"2024-09-15T12:41:15.024515+0000","last_became_active":"2024-09-15T12:22:19.466495+0000","last_became_peered":"2024-09-15T12:22:19.466495+0000","last_unstale":"2024-09-15T12:41:15.024515+0000","last_undegraded":"2024-09-15T12:41:15.024515+0000","last_fullsized":"2024-09-15T12:41:15.024515+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:15.041295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.041295+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2132,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:14.556119+0000","last_change":"2024-09-15T12:41:14.574445+0000","last_active":"2024-09-15T12:41:14.556119+0000","last_peered":"2024-09-15T12:41:14.556119+0000","last_clean":"2024-09-15T12:41:14.556119+0000","last_became_active":"2024-09-15T12:22:19.475039+0000","last_became_peered":"2024-09-15T12:22:19.475039+0000","last_unstale":"2024-09-15T12:41:14.556119+0000","last_undegraded":"2024-09-15T12:41:14.556119+0000","last_fullsized":"2024-09-15T12:41:14.556119+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:41:14.574172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:14.574172+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2133,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.027060+0000","last_change":"2024-09-15T12:41:15.058300+0000","last_active":"2024-09-15T12:41:15.027060+0000","last_peered":"2024-09-15T12:41:15.027060+0000","last_clean":"2024-09-15T12:41:15.027060+0000","last_became_active":"2024-09-15T12:22:19.485089+0000","last_became_peered":"2024-09-15T12:22:19.485089+0000","last_unstale":"2024-09-15T12:41:15.027060+0000","last_undegraded":"2024-09-15T12:41:15.027060+0000","last_fullsized":"2024-09-15T12:41:15.027060+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2024-09-15T12:41:15.058124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.058124+0000","last_clean_scrub_stamp":"2024-09-15T12:22:18.396640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2201,"reported_epoch":720,"state":"active+clean","last_fresh":"2024-09-15T12:41:15.952903+0000","last_change":"2024-09-15T12:41:15.999689+0000","last_active":"2024-09-15T12:41:15.952903+0000","last_peered":"2024-09-15T12:41:15.952903+0000","last_clean":"2024-09-15T12:41:15.952903+0000","last_became_active":"2024-09-15T12:22:18.457094+0000","last_became_peered":"2024-09-15T12:22:18.457094+0000","last_unstale":"2024-09-15T12:41:15.952903+0000","last_undegraded":"2024-09-15T12:41:15.952903+0000","last_fullsized":"2024-09-15T12:41:15.952903+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'52","last_scrub_stamp":"2024-09-15T12:41:15.999491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:41:15.999491+0000","last_clean_scrub_stamp":"2024-09-15T12:22:17.395744+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949674129,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63220,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94308620,"statfs":{"total":96636764160,"available":96572026880,"internally_reserved":0,"allocated":1740800,"data_stored":1081464,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59008,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94312832,"statfs":{"total":96636764160,"available":96576339968,"internally_reserved":0,"allocated":1687552,"data_stored":491120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68732,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94303108,"statfs":{"total":96636764160,"available":96566382592,"internally_reserved":0,"allocated":1683456,"data_stored":491101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68792,"kb_used_data":1704,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94303048,"statfs":{"total":96636764160,"available":96566321152,"internally_reserved":0,"allocated":1744896,"data_stored":1081483,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:41:56.956 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-15T12:41:57.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.055+0000 7fc3d7674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:57.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.064+0000 7fc3d7674640 1 Processor -- start 2024-09-15T12:41:57.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.064+0000 7fc3d7674640 1 -- start start 2024-09-15T12:41:57.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.065+0000 7fc3d7674640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc3d009e580 0x7fc3d013b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:57.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.065+0000 7fc3d7674640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3d00a0da0 con 0x7fc3d009da60 2024-09-15T12:41:57.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.065+0000 7fc3d7674640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fc3d009eeb0 con 0x7fc3d009e580 2024-09-15T12:41:57.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.065+0000 7fc3d4c0f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc3d009e580 0x7fc3d013b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:57.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.065+0000 7fc3d5410640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fc3d009da60 0x7fc3d009de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:59698/0 (socket says 172.21.15.122:59698) 2024-09-15T12:41:57.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.065+0000 7fc3d5410640 1 -- 172.21.15.122:0/3966171273 learned_addr learned my addr 172.21.15.122:0/3966171273 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-15T12:41:57.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.065+0000 7fc3d4c0f640 1 -- 172.21.15.122:0/3966171273 >> v1:172.21.15.122:6789/0 conn(0x7fc3d009da60 legacy=0x7fc3d009de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:57.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.065+0000 7fc3d4c0f640 1 -- 172.21.15.122:0/3966171273 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d00a5950 con 0x7fc3d009e580 2024-09-15T12:41:57.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.065+0000 7fc3c7fff640 1 -- 172.21.15.122:0/3966171273 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 268281130 0 0) 0x7fc3d00a0da0 con 0x7fc3d009da60 2024-09-15T12:41:57.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.066+0000 7fc3d4c0f640 1 --2- 172.21.15.122:0/3966171273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d009e580 0x7fc3d013b2a0 crc :-1 s=READY pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad63faa148299495 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:57.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.066+0000 7fc3c7fff640 1 -- 172.21.15.122:0/3966171273 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3c0009d90 con 0x7fc3d009e580 2024-09-15T12:41:57.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.066+0000 7fc3c7fff640 1 -- 172.21.15.122:0/3966171273 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc3c000e230 con 0x7fc3d009e580 2024-09-15T12:41:57.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.066+0000 7fc3c7fff640 1 -- 172.21.15.122:0/3966171273 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3c000e4d0 con 0x7fc3d009e580 2024-09-15T12:41:57.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.066+0000 7fc3d7674640 1 -- 172.21.15.122:0/3966171273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d009e580 msgr2=0x7fc3d013b2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:57.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.066+0000 7fc3d7674640 1 --2- 172.21.15.122:0/3966171273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d009e580 0x7fc3d013b2a0 crc :-1 s=READY pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:57.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.066+0000 7fc3d7674640 1 -- 172.21.15.122:0/3966171273 shutdown_connections 2024-09-15T12:41:57.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.066+0000 7fc3d7674640 1 --2- 172.21.15.122:0/3966171273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d009e580 0x7fc3d013b2a0 unknown :-1 s=CLOSED pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:57.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.066+0000 7fc3d7674640 1 -- 172.21.15.122:0/3966171273 >> 172.21.15.122:0/3966171273 conn(0x7fc3d006e970 msgr2=0x7fc3d006ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:57.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.067+0000 7fc3d7674640 1 -- 172.21.15.122:0/3966171273 shutdown_connections 2024-09-15T12:41:57.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.067+0000 7fc3d7674640 1 -- 172.21.15.122:0/3966171273 wait complete. 2024-09-15T12:41:57.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.067+0000 7fc3d7674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:41:57.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.068+0000 7fc3d7674640 1 Processor -- start 2024-09-15T12:41:57.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.068+0000 7fc3d7674640 1 -- start start 2024-09-15T12:41:57.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.069+0000 7fc3d7674640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d009da60 0x7fc3d0123950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:57.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.069+0000 7fc3d7674640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0124df0 con 0x7fc3d009da60 2024-09-15T12:41:57.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.069+0000 7fc3d5410640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d009da60 0x7fc3d0123950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:57.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.069+0000 7fc3d5410640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d009da60 0x7fc3d0123950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58142/0 (socket says 172.21.15.122:58142) 2024-09-15T12:41:57.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.069+0000 7fc3d5410640 1 -- 172.21.15.122:0/3373712951 learned_addr learned my addr 172.21.15.122:0/3373712951 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-15T12:41:57.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.069+0000 7fc3d5410640 1 -- 172.21.15.122:0/3373712951 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d01253d0 con 0x7fc3d009da60 2024-09-15T12:41:57.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.070+0000 7fc3d5410640 1 --2- 172.21.15.122:0/3373712951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d009da60 0x7fc3d0123950 crc :-1 s=READY pgs=13013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:57.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.070+0000 7fc3c5ffb640 1 -- 172.21.15.122:0/3373712951 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3cc004b80 con 0x7fc3d009da60 2024-09-15T12:41:57.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.070+0000 7fc3c5ffb640 1 -- 172.21.15.122:0/3373712951 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc3cc004ce0 con 0x7fc3d009da60 2024-09-15T12:41:57.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.070+0000 7fc3d7674640 1 -- 172.21.15.122:0/3373712951 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d0124ae0 con 0x7fc3d009da60 2024-09-15T12:41:57.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.070+0000 7fc3c5ffb640 1 -- 172.21.15.122:0/3373712951 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3cc007120 con 0x7fc3d009da60 2024-09-15T12:41:57.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.070+0000 7fc3d7674640 1 -- 172.21.15.122:0/3373712951 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d01261f0 con 0x7fc3d009da60 2024-09-15T12:41:57.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.071+0000 7fc3d7674640 1 -- 172.21.15.122:0/3373712951 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d00a2f00 con 0x7fc3d009da60 2024-09-15T12:41:57.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.071+0000 7fc3c5ffb640 1 -- 172.21.15.122:0/3373712951 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc3cc0072d0 con 0x7fc3d009da60 2024-09-15T12:41:57.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.071+0000 7fc3c5ffb640 1 --2- 172.21.15.122:0/3373712951 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc3b403e930 0x7fc3b4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T12:41:57.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.071+0000 7fc3c5ffb640 1 -- 172.21.15.122:0/3373712951 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(720..720 src has 621..720) ==== 3431+0+0 (crc 0 0 0) 0x7fc3cc04fae0 con 0x7fc3d009da60 2024-09-15T12:41:57.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.072+0000 7fc3d4c0f640 1 --2- 172.21.15.122:0/3373712951 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc3b403e930 0x7fc3b4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T12:41:57.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.072+0000 7fc3d4c0f640 1 --2- 172.21.15.122:0/3373712951 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc3b403e930 0x7fc3b4040e40 crc :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T12:41:57.078 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.076+0000 7fc3c5ffb640 1 -- 172.21.15.122:0/3373712951 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc3cc00f230 con 0x7fc3d009da60 2024-09-15T12:41:57.252 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.250+0000 7fc3d7674640 1 -- 172.21.15.122:0/3373712951 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fc3d009de70 con 0x7fc3d009da60 2024-09-15T12:41:57.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.256+0000 7fc3c5ffb640 1 -- 172.21.15.122:0/3373712951 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (crc 0 0 0) 0x7fc3cc006740 con 0x7fc3d009da60 2024-09-15T12:41:57.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.257+0000 7fc3c5ffb640 1 -- 172.21.15.122:0/3373712951 <== mon.0 v2:172.21.15.122:3300/0 8 ==== config(1 keys) ==== 35+0+0 (crc 0 0 0) 0x7fc3cc00f230 con 0x7fc3d009da60 2024-09-15T12:41:57.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.258+0000 7fc3d7674640 1 -- 172.21.15.122:0/3373712951 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc3b403e930 msgr2=0x7fc3b4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:57.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.258+0000 7fc3d7674640 1 --2- 172.21.15.122:0/3373712951 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc3b403e930 0x7fc3b4040e40 crc :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:57.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.258+0000 7fc3d7674640 1 -- 172.21.15.122:0/3373712951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d009da60 msgr2=0x7fc3d0123950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T12:41:57.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.259+0000 7fc3d7674640 1 --2- 172.21.15.122:0/3373712951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d009da60 0x7fc3d0123950 crc :-1 s=READY pgs=13013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:57.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.259+0000 7fc3d7674640 1 -- 172.21.15.122:0/3373712951 shutdown_connections 2024-09-15T12:41:57.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.259+0000 7fc3d7674640 1 --2- 172.21.15.122:0/3373712951 >> [v2:172.21.15.142:6800/73136857,v1:172.21.15.142:6801/73136857] conn(0x7fc3b403e930 0x7fc3b4040e40 unknown :-1 s=CLOSED pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:57.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.259+0000 7fc3d7674640 1 --2- 172.21.15.122:0/3373712951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d009da60 0x7fc3d0123950 unknown :-1 s=CLOSED pgs=13013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T12:41:57.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.259+0000 7fc3d7674640 1 -- 172.21.15.122:0/3373712951 >> 172.21.15.122:0/3373712951 conn(0x7fc3d006e970 msgr2=0x7fc3d01bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T12:41:57.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.259+0000 7fc3d7674640 1 -- 172.21.15.122:0/3373712951 shutdown_connections 2024-09-15T12:41:57.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-15T12:41:57.259+0000 7fc3d7674640 1 -- 172.21.15.122:0/3373712951 wait complete. 2024-09-15T12:41:57.274 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-15T12:41:57.274 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-15T12:41:57.274 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-15T12:41:57.274 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:41:57.350 INFO:tasks.ceph.osd.0:Stopped 2024-09-15T12:41:57.350 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-15T12:41:57.350 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:41:57.439 INFO:tasks.ceph.osd.1:Stopped 2024-09-15T12:41:57.439 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-15T12:41:57.439 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:41:57.513 INFO:tasks.ceph.osd.2:Stopped 2024-09-15T12:41:57.514 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-15T12:41:57.514 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:41:57.591 INFO:tasks.ceph.osd.3:Stopped 2024-09-15T12:41:57.591 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-15T12:41:57.591 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-15T12:41:57.591 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:41:57.620 INFO:tasks.ceph.mgr.x:Stopped 2024-09-15T12:41:57.620 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-15T12:41:57.620 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-15T12:41:57.620 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:41:57.634 INFO:tasks.ceph.mon.a:Stopped 2024-09-15T12:41:57.634 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-15T12:41:57.635 DEBUG:teuthology.orchestra.run.smithi122:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-09-15T12:41:57.702 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-15T12:41:57.703 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-15T12:41:57.895 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-15T12:41:57.895 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-15T12:41:57.973 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-15T12:41:57.974 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-15T12:41:58.188 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-15T12:41:58.188 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-15T12:41:58.284 INFO:tasks.ceph:Archiving mon data... 2024-09-15T12:41:58.285 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905495/data/mon.a.tgz 2024-09-15T12:41:58.285 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-09-15T12:41:58.301 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.dGFxiu7isF 2024-09-15T12:41:58.301 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.dGFxiu7isF 2024-09-15T12:41:58.431 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.dGFxiu7isF 2024-09-15T12:41:58.514 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.dGFxiu7isF is 285KB 2024-09-15T12:41:58.607 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.dGFxiu7isF 2024-09-15T12:41:58.622 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-15T12:41:58.622 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T12:41:58.664 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T12:41:58.742 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T12:41:58.757 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T12:41:58.757 INFO:tasks.ceph:Archiving crash dumps... 2024-09-15T12:41:58.759 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905495/remote/smithi122/crash 2024-09-15T12:41:58.760 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T12:41:58.806 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905495/remote/smithi142/crash 2024-09-15T12:41:58.807 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T12:41:58.872 INFO:tasks.ceph:Compressing logs... 2024-09-15T12:41:58.872 DEBUG:teuthology.orchestra.run.smithi122:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T12:41:58.874 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T12:41:58.896 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-15T12:41:58.897 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30159.log 2024-09-15T12:41:58.897 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29211.log 2024-09-15T12:41:58.897 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.30159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29744.log 2024-09-15T12:41:58.897 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95215.log 2024-09-15T12:41:58.897 INFO:teuthology.orchestra.run.smithi122.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29211.log.gz 2024-09-15T12:41:58.897 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96557.log 2024-09-15T12:41:58.901 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28274.log 2024-09-15T12:41:58.901 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-15T12:41:58.901 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.28274.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-15T12:41:58.901 INFO:teuthology.orchestra.run.smithi142.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.28274.log.gz 2024-09-15T12:41:58.902 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28183.log 2024-09-15T12:41:58.902 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28314.log 2024-09-15T12:41:58.902 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.28183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28234.log 2024-09-15T12:41:58.902 INFO:teuthology.orchestra.run.smithi142.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.28183.log.gz 2024-09-15T12:41:58.902 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.28314.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-15T12:41:58.902 INFO:teuthology.orchestra.run.smithi142.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.28314.log.gz/var/log/ceph/ceph-client.admin.28234.log: 2024-09-15T12:41:58.902 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.3.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.28234.log.gz 2024-09-15T12:41:58.961 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29744.log: /var/log/ceph/ceph-client.admin.95215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96581.log 2024-09-15T12:41:58.961 INFO:teuthology.orchestra.run.smithi122.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29744.log.gz 2024-09-15T12:41:58.961 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94420.log 2024-09-15T12:41:58.961 INFO:teuthology.orchestra.run.smithi122.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96557.log.gz 2024-09-15T12:41:58.961 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96581.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27654.log 2024-09-15T12:41:58.962 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94401.log 2024-09-15T12:41:58.962 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94420.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96581.log.gz 2024-09-15T12:41:58.962 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph.tmp-client.admin.27654.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.94420.log.gzgzip 2024-09-15T12:41:58.962 INFO:teuthology.orchestra.run.smithi122.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.29745.log 2024-09-15T12:41:58.962 INFO:teuthology.orchestra.run.smithi122.stderr: 66.9% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27654.log.gz 2024-09-15T12:41:58.962 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97490.log 2024-09-15T12:41:58.962 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94510.log 2024-09-15T12:41:58.962 INFO:teuthology.orchestra.run.smithi122.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29745.log.gz 2024-09-15T12:41:58.962 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.97490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94821.log 2024-09-15T12:41:58.962 INFO:teuthology.orchestra.run.smithi122.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.95215.log.gz 2024-09-15T12:41:58.962 INFO:teuthology.orchestra.run.smithi122.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.97490.log.gz 2024-09-15T12:41:58.962 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97238.log 2024-09-15T12:41:58.962 INFO:teuthology.orchestra.run.smithi122.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.94401.log.gz 2024-09-15T12:41:58.963 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94821.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-15T12:41:58.963 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94786.log 2024-09-15T12:41:58.963 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.97238.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94510.log.gz 2024-09-15T12:41:58.963 INFO:teuthology.orchestra.run.smithi122.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94821.log.gz 2024-09-15T12:41:58.963 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.1.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.97238.log.gz 2024-09-15T12:41:58.963 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96349.log 2024-09-15T12:41:58.963 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94645.log 2024-09-15T12:41:58.963 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96349.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.30159.log.gz 2024-09-15T12:41:58.963 INFO:teuthology.orchestra.run.smithi122.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.94786.log.gz 2024-09-15T12:41:58.963 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94712.log 2024-09-15T12:41:58.963 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96349.log.gz 2024-09-15T12:41:58.963 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97532.log 2024-09-15T12:41:58.963 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29435.log 2024-09-15T12:41:58.963 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.97532.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.94645.log.gz 2024-09-15T12:41:58.963 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97112.log 2024-09-15T12:41:58.964 INFO:teuthology.orchestra.run.smithi122.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97532.log.gz 2024-09-15T12:41:58.964 INFO:teuthology.orchestra.run.smithi122.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94712.log.gz 2024-09-15T12:41:58.964 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96394.log 2024-09-15T12:41:58.964 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96222.log 2024-09-15T12:41:58.964 INFO:teuthology.orchestra.run.smithi122.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29435.log.gz 2024-09-15T12:41:58.964 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.97112.log: /var/log/ceph/ceph-client.admin.96394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96712.log 2024-09-15T12:41:58.964 INFO:teuthology.orchestra.run.smithi122.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97112.log.gz 2024-09-15T12:41:58.964 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96394.log.gz/var/log/ceph/ceph-client.admin.96222.log: 2024-09-15T12:41:58.964 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29292.log 2024-09-15T12:41:58.964 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96222.log.gz 2024-09-15T12:41:58.964 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97070.log/var/log/ceph/ceph-client.admin.96712.log: 2024-09-15T12:41:58.964 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94274.log 2024-09-15T12:41:58.964 INFO:teuthology.orchestra.run.smithi122.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96712.log.gz 2024-09-15T12:41:58.965 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.97070.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29292.log.gz 2024-09-15T12:41:58.965 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94458.log 2024-09-15T12:41:58.965 INFO:teuthology.orchestra.run.smithi122.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97070.log.gz 2024-09-15T12:41:58.965 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93329.log 2024-09-15T12:41:58.965 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94274.log: /var/log/ceph/ceph-client.admin.94458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28718.log 2024-09-15T12:41:58.965 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.93329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93665.log 2024-09-15T12:41:58.965 INFO:teuthology.orchestra.run.smithi122.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.94458.log.gz 2024-09-15T12:41:58.965 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.28718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29746.log 2024-09-15T12:41:58.965 INFO:teuthology.orchestra.run.smithi122.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.28718.log.gz 2024-09-15T12:41:58.965 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.93665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93218.log 2024-09-15T12:41:58.965 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97280.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93665.log.gz 2024-09-15T12:41:58.965 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-15T12:41:58.965 INFO:teuthology.orchestra.run.smithi122.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29746.log.gz 2024-09-15T12:41:58.965 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.93218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29351.log 2024-09-15T12:41:58.966 INFO:teuthology.orchestra.run.smithi122.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.93329.log.gz 2024-09-15T12:41:58.966 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96607.log 2024-09-15T12:41:58.966 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.97280.log: /var/log/ceph/ceph-client.admin.29351.log: gzip -5 --verbose 87.1% -- replaced with /var/log/ceph/ceph-client.admin.97280.log.gz 2024-09-15T12:41:58.966 INFO:teuthology.orchestra.run.smithi122.stderr: -- /var/log/ceph/ceph-client.admin.96243.log 2024-09-15T12:41:58.966 INFO:teuthology.orchestra.run.smithi122.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29351.log.gz 2024-09-15T12:41:58.966 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30628.log 2024-09-15T12:41:58.966 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96607.log.gz 2024-09-15T12:41:58.966 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94508.log 2024-09-15T12:41:58.966 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96243.log.gz 2024-09-15T12:41:58.966 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.30628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96891.log 2024-09-15T12:41:58.966 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97448.log 2024-09-15T12:41:58.966 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96733.log 2024-09-15T12:41:58.966 INFO:teuthology.orchestra.run.smithi122.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94508.log.gz 2024-09-15T12:41:58.966 INFO:teuthology.orchestra.run.smithi122.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96891.log.gz 2024-09-15T12:41:58.966 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log/var/log/ceph/ceph-client.admin.97448.log: 2024-09-15T12:41:58.967 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96733.log: gzip -5 --verbose 86.8% -- replaced with /var/log/ceph/ceph-client.admin.97448.log.gz 2024-09-15T12:41:58.967 INFO:teuthology.orchestra.run.smithi122.stderr: -- /var/log/ceph/ceph-client.admin.29897.log 2024-09-15T12:41:58.967 INFO:teuthology.orchestra.run.smithi122.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96733.log.gz 2024-09-15T12:41:58.967 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96649.log 2024-09-15T12:41:58.967 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96306.log 2024-09-15T12:41:58.967 INFO:teuthology.orchestra.run.smithi122.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.29897.log.gz/var/log/ceph/ceph-client.admin.96649.log: 2024-09-15T12:41:58.967 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96649.log.gz 2024-09-15T12:41:58.967 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97574.log 2024-09-15T12:41:58.967 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96306.log: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T12:41:58.967 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94559.log 2024-09-15T12:41:58.967 INFO:teuthology.orchestra.run.smithi122.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96306.log.gz 2024-09-15T12:41:58.967 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.97574.log: -- /var/log/ceph/ceph-client.admin.94195.log 2024-09-15T12:41:58.967 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94559.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.97574.log.gz 2024-09-15T12:41:58.967 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94644.log 2024-09-15T12:41:58.967 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94195.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94559.log.gz 2024-09-15T12:41:58.968 INFO:teuthology.orchestra.run.smithi122.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.94274.log.gz 2024-09-15T12:41:58.968 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28982.log 2024-09-15T12:41:58.968 INFO:teuthology.orchestra.run.smithi122.stderr:gzip 90.9% -- replaced with /var/log/ceph/ceph-client.admin.94195.log.gz 2024-09-15T12:41:58.968 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94644.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31533.log 2024-09-15T12:41:58.968 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.28982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29579.log 2024-09-15T12:41:58.968 INFO:teuthology.orchestra.run.smithi122.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.28982.log.gz 2024-09-15T12:41:58.968 INFO:teuthology.orchestra.run.smithi122.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94644.log.gz 2024-09-15T12:41:58.968 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.31533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29578.log 2024-09-15T12:41:58.968 INFO:teuthology.orchestra.run.smithi122.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31533.log.gz 2024-09-15T12:41:58.968 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93860.log 2024-09-15T12:41:58.968 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.29579.log.gz 2024-09-15T12:41:58.968 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94874.log 2024-09-15T12:41:58.968 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.29578.log.gz 2024-09-15T12:41:58.969 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.93860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95167.log 2024-09-15T12:41:58.969 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94646.log 2024-09-15T12:41:58.969 INFO:teuthology.orchestra.run.smithi122.stderr: 85.9%/var/log/ceph/ceph-client.admin.95167.log: -- replaced with /var/log/ceph/ceph-client.admin.94874.log.gz 2024-09-15T12:41:58.969 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96350.log 2024-09-15T12:41:58.969 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93722.log 2024-09-15T12:41:58.969 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96350.log: /var/log/ceph/ceph-client.admin.94646.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.96350.log.gz 2024-09-15T12:41:58.969 INFO:teuthology.orchestra.run.smithi122.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94646.log.gz 2024-09-15T12:41:58.969 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96509.log 2024-09-15T12:41:58.969 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93684.log 2024-09-15T12:41:58.969 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.93722.log: 93.3% 95.1% -- replaced with /var/log/ceph/ceph-client.admin.30628.log.gz 2024-09-15T12:41:58.969 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93218.log.gz/var/log/ceph/ceph-client.admin.96509.log: 2024-09-15T12:41:58.969 INFO:teuthology.orchestra.run.smithi122.stderr:gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96509.log.gz 2024-09-15T12:41:58.969 INFO:teuthology.orchestra.run.smithi122.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31495.log 2024-09-15T12:41:58.969 INFO:teuthology.orchestra.run.smithi122.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.93860.log.gz 2024-09-15T12:41:58.970 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.93684.log: gzip -5 --verbose 91.2% -- replaced with /var/log/ceph/ceph-client.admin.93722.log.gz 2024-09-15T12:41:58.970 INFO:teuthology.orchestra.run.smithi122.stderr: -- /var/log/ceph/ceph-client.admin.94422.log 2024-09-15T12:41:58.970 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.31495.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93684.log.gz 2024-09-15T12:41:58.970 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31437.log 2024-09-15T12:41:58.970 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96327.log 2024-09-15T12:41:58.970 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.31437.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.94422.log.gz 2024-09-15T12:41:58.970 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93703.log 2024-09-15T12:41:58.970 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28797.log 2024-09-15T12:41:58.970 INFO:teuthology.orchestra.run.smithi122.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96327.log.gz 2024-09-15T12:41:58.970 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.93703.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.95167.log.gz 2024-09-15T12:41:58.970 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94561.log 2024-09-15T12:41:58.970 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29577.log/var/log/ceph/ceph-client.admin.28797.log: 2024-09-15T12:41:58.970 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94561.log: 84.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95397.log 2024-09-15T12:41:58.970 INFO:teuthology.orchestra.run.smithi122.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.93703.log.gz 2024-09-15T12:41:58.970 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28797.log.gz 2024-09-15T12:41:58.970 INFO:teuthology.orchestra.run.smithi122.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.31437.log.gz 2024-09-15T12:41:58.971 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29577.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94561.log.gz 2024-09-15T12:41:58.971 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.29577.log.gz 2024-09-15T12:41:58.971 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96440.log 2024-09-15T12:41:58.971 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.95397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31571.log 2024-09-15T12:41:58.971 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96820.log 2024-09-15T12:41:58.971 INFO:teuthology.orchestra.run.smithi122.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96440.log.gz 2024-09-15T12:41:58.971 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.31571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93291.log 2024-09-15T12:41:58.971 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5/var/log/ceph/ceph-client.admin.96820.log: --verbose -- /var/log/ceph/ceph-client.admin.97028.log 2024-09-15T12:41:58.971 INFO:teuthology.orchestra.run.smithi122.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.95397.log.gz/var/log/ceph/ceph-client.admin.93291.log: 2024-09-15T12:41:58.971 INFO:teuthology.orchestra.run.smithi122.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96820.log.gz 2024-09-15T12:41:58.971 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29939.log 2024-09-15T12:41:58.971 INFO:teuthology.orchestra.run.smithi122.stderr:gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93291.log.gz 2024-09-15T12:41:58.971 INFO:teuthology.orchestra.run.smithi122.stderr: -5 --verbose/var/log/ceph/ceph-client.admin.97028.log: -- /var/log/ceph/ceph-client.admin.31456.log 2024-09-15T12:41:58.971 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29939.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.97028.log.gz 2024-09-15T12:41:58.971 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97656.log 2024-09-15T12:41:58.972 INFO:teuthology.orchestra.run.smithi122.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29939.log.gz/var/log/ceph/ceph-client.admin.31456.log: 2024-09-15T12:41:58.972 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-15T12:41:58.972 INFO:teuthology.orchestra.run.smithi122.stderr: 89.6%/var/log/ceph/ceph-client.admin.97656.log: -- replaced with /var/log/ceph/ceph-client.admin.31456.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94509.log 2024-09-15T12:41:58.972 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-15T12:41:58.972 INFO:teuthology.orchestra.run.smithi122.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.97656.log.gz 2024-09-15T12:41:58.972 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95916.log 2024-09-15T12:41:58.972 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5/var/log/ceph/ceph-client.admin.94509.log: --verbose -- /var/log/ceph/ceph-client.admin.94748.log 2024-09-15T12:41:58.972 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.95916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96138.log 2024-09-15T12:41:58.972 INFO:teuthology.orchestra.run.smithi122.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.94509.log.gz 2024-09-15T12:41:58.972 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94748.log: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.31495.log.gz 2024-09-15T12:41:58.972 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94560.log 2024-09-15T12:41:58.972 INFO:teuthology.orchestra.run.smithi122.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94748.log.gz 2024-09-15T12:41:58.972 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29855.log 2024-09-15T12:41:58.972 INFO:teuthology.orchestra.run.smithi122.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96138.log.gz/var/log/ceph/ceph-client.admin.94560.log: 2024-09-15T12:41:58.973 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29747.log 2024-09-15T12:41:58.973 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96264.log 2024-09-15T12:41:58.973 INFO:teuthology.orchestra.run.smithi122.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.94560.log.gz 2024-09-15T12:41:58.973 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29855.log: /var/log/ceph/ceph-client.admin.29747.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.29855.log.gz 2024-09-15T12:41:58.973 INFO:teuthology.orchestra.run.smithi122.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29747.log.gz 2024-09-15T12:41:58.973 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28954.log 2024-09-15T12:41:58.973 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97616.log 2024-09-15T12:41:58.973 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96264.log.gz 2024-09-15T12:41:58.973 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.28954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96159.log 2024-09-15T12:41:58.973 INFO:teuthology.orchestra.run.smithi122.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.28954.log.gz 2024-09-15T12:41:58.973 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.97616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94891.log 2024-09-15T12:41:58.973 INFO:teuthology.orchestra.run.smithi122.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.97616.log.gz 2024-09-15T12:41:58.973 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96628.log 2024-09-15T12:41:58.973 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96159.log: /var/log/ceph/ceph-client.admin.94891.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96159.log.gz 2024-09-15T12:41:58.973 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97406.log 2024-09-15T12:41:58.973 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94955.log 2024-09-15T12:41:58.974 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96628.log.gz 2024-09-15T12:41:58.974 INFO:teuthology.orchestra.run.smithi122.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.94891.log.gz 2024-09-15T12:41:58.974 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.97406.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.97406.log.gz 2024-09-15T12:41:58.974 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96691.log 2024-09-15T12:41:58.974 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93547.log 2024-09-15T12:41:58.974 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94955.log: /var/log/ceph/ceph-client.admin.96691.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T12:41:58.974 INFO:teuthology.orchestra.run.smithi122.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.95916.log.gz 2024-09-15T12:41:58.974 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.93547.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96691.log.gz 2024-09-15T12:41:58.974 INFO:teuthology.orchestra.run.smithi122.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.93547.log.gz 2024-09-15T12:41:58.974 INFO:teuthology.orchestra.run.smithi122.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.94955.log.gz 2024-09-15T12:41:58.974 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94785.log 2024-09-15T12:41:58.974 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96180.log 2024-09-15T12:41:58.974 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96485.log 2024-09-15T12:41:58.974 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94938.log 2024-09-15T12:41:58.975 INFO:teuthology.orchestra.run.smithi122.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94785.log.gz 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96180.log.gz 2024-09-15T12:41:58.975 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-15T12:41:58.975 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96796.log 2024-09-15T12:41:58.975 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96201.log 2024-09-15T12:41:58.975 INFO:teuthology.orchestra.run.smithi122.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.96485.log.gz 2024-09-15T12:41:58.975 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96796.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.94938.log.gz 2024-09-15T12:41:58.975 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93510.log 2024-09-15T12:41:58.975 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96796.log.gz 2024-09-15T12:41:58.975 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96201.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96201.log.gz 2024-09-15T12:41:58.975 INFO:teuthology.orchestra.run.smithi122.stderr: 88.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T12:41:58.975 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97364.log 2024-09-15T12:41:58.975 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.93510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94562.log 2024-09-15T12:41:58.975 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.97364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96285.log 86.9% -- replaced with /var/log/ceph/ceph-client.admin.97364.log.gz 2024-09-15T12:41:58.975 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-15T12:41:58.976 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94562.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.93510.log.gz 2024-09-15T12:41:58.976 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29477.log 2024-09-15T12:41:58.976 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29393.log 2024-09-15T12:41:58.976 INFO:teuthology.orchestra.run.smithi122.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94562.log.gz 2024-09-15T12:41:58.976 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6%/var/log/ceph/ceph-client.admin.29477.log: -- replaced with /var/log/ceph/ceph-client.admin.96285.log.gz 2024-09-15T12:41:58.976 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97196.log 2024-09-15T12:41:58.976 INFO:teuthology.orchestra.run.smithi122.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29477.log.gz 2024-09-15T12:41:58.976 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94563.log 2024-09-15T12:41:58.976 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.29393.log: /var/log/ceph/ceph-client.admin.97196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96062.log 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29393.log.gz 2024-09-15T12:41:58.976 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-15T12:41:58.976 INFO:teuthology.orchestra.run.smithi122.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.97196.log.gz 2024-09-15T12:41:58.976 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94822.log 2024-09-15T12:41:58.976 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5/var/log/ceph/ceph-client.admin.96062.log: --verbose -- /var/log/ceph/ceph-client.admin.95716.log 2024-09-15T12:41:58.976 INFO:teuthology.orchestra.run.smithi122.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.94563.log.gz/var/log/ceph/ceph-client.admin.94822.log: 2024-09-15T12:41:58.976 INFO:teuthology.orchestra.run.smithi122.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96062.log.gz 2024-09-15T12:41:58.977 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96441.log 2024-09-15T12:41:58.977 INFO:teuthology.orchestra.run.smithi122.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.94822.log.gz 2024-09-15T12:41:58.977 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.95716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94749.log 2024-09-15T12:41:58.977 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97322.log 2024-09-15T12:41:58.977 INFO:teuthology.orchestra.run.smithi122.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96441.log.gz 2024-09-15T12:41:58.977 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94823.log 2024-09-15T12:41:58.977 INFO:teuthology.orchestra.run.smithi122.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.94749.log.gz 2024-09-15T12:41:58.977 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96531.log 2024-09-15T12:41:58.977 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.97322.log: /var/log/ceph/ceph-client.admin.94823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96915.log 2024-09-15T12:41:58.977 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96531.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.97322.log.gz 2024-09-15T12:41:58.977 INFO:teuthology.orchestra.run.smithi122.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.94823.log.gz 86.6% -- replaced with /var/log/ceph/ceph-client.admin.96531.log.gz 2024-09-15T12:41:58.977 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94457.log 2024-09-15T12:41:58.977 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-15T12:41:58.977 INFO:teuthology.orchestra.run.smithi122.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.95716.log.gz 2024-09-15T12:41:58.978 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95504.log 2024-09-15T12:41:58.978 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96915.log: /var/log/ceph/ceph-client.admin.94457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29576.log 2024-09-15T12:41:58.978 INFO:teuthology.orchestra.run.smithi122.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96915.log.gz 2024-09-15T12:41:58.978 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94713.log 2024-09-15T12:41:58.978 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.95504.log: /var/log/ceph/ceph-client.admin.29576.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94421.log 2024-09-15T12:41:58.978 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94457.log.gz 2024-09-15T12:41:58.978 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94713.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29576.log.gz 2024-09-15T12:41:58.978 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96775.log 2024-09-15T12:41:58.978 INFO:teuthology.orchestra.run.smithi122.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.94713.log.gz/var/log/ceph/ceph-client.admin.94421.log: 2024-09-15T12:41:58.978 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96670.log 2024-09-15T12:41:58.978 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93809.log 2024-09-15T12:41:58.978 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96670.log: /var/log/ceph/ceph-client.admin.96775.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94421.log.gz 2024-09-15T12:41:58.978 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96112.log 2024-09-15T12:41:58.978 INFO:teuthology.orchestra.run.smithi122.stderr: 88.0% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96775.log.gz 2024-09-15T12:41:58.979 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96670.log.gz 2024-09-15T12:41:58.979 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.93809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96841.log 2024-09-15T12:41:58.979 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97154.log 2024-09-15T12:41:58.979 INFO:teuthology.orchestra.run.smithi122.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.96112.log.gz 2024-09-15T12:41:58.979 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96841.log: gzip -5 --verbose -- 91.2% /var/log/ceph/ceph-client.admin.94459.log 2024-09-15T12:41:58.979 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93809.log.gz 2024-09-15T12:41:58.979 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.97154.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.95504.log.gz 2024-09-15T12:41:58.979 INFO:teuthology.orchestra.run.smithi122.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96841.log.gz 2024-09-15T12:41:58.979 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95884.log 2024-09-15T12:41:58.979 INFO:teuthology.orchestra.run.smithi122.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.97154.log.gz 2024-09-15T12:41:58.979 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.94459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93742.log 2024-09-15T12:41:58.979 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.95884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96088.log 2024-09-15T12:41:58.979 INFO:teuthology.orchestra.run.smithi122.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.94459.log.gz 2024-09-15T12:41:58.979 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.93742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96865.log 2024-09-15T12:41:58.979 INFO:teuthology.orchestra.run.smithi122.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95884.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96415.log 2024-09-15T12:41:58.980 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-15T12:41:58.980 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96088.log: /var/log/ceph/ceph-client.admin.96865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96754.log 2024-09-15T12:41:58.980 INFO:teuthology.orchestra.run.smithi122.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96088.log.gz 2024-09-15T12:41:58.980 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96415.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.96865.log.gz 2024-09-15T12:41:58.980 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96415.log.gz 2024-09-15T12:41:58.980 INFO:teuthology.orchestra.run.smithi122.stderr: -- /var/log/ceph/ceph-client.admin.31403.log 2024-09-15T12:41:58.980 INFO:teuthology.orchestra.run.smithi122.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.93742.log.gz 2024-09-15T12:41:58.980 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.96754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31552.log 2024-09-15T12:41:58.980 INFO:teuthology.orchestra.run.smithi122.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96754.log.gz 2024-09-15T12:41:58.980 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.31403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29267.log 2024-09-15T12:41:58.980 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.31552.log: /var/log/ceph/ceph-client.admin.29267.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.31403.log.gz 2024-09-15T12:41:58.980 INFO:teuthology.orchestra.run.smithi122.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31552.log.gz 2024-09-15T12:41:58.980 INFO:teuthology.orchestra.run.smithi122.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29267.log.gz 2024-09-15T12:41:59.084 INFO:teuthology.orchestra.run.smithi142.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-15T12:41:59.355 INFO:teuthology.orchestra.run.smithi122.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.31571.log.gz 2024-09-15T12:42:00.466 INFO:teuthology.orchestra.run.smithi122.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-15T12:42:05.031 INFO:teuthology.orchestra.run.smithi142.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-15T12:42:05.137 INFO:teuthology.orchestra.run.smithi142.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-15T12:42:05.139 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-09-15T12:42:05.139 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m6.251s 2024-09-15T12:42:05.139 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m12.067s 2024-09-15T12:42:05.139 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m0.488s 2024-09-15T12:42:05.531 INFO:teuthology.orchestra.run.smithi122.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-15T12:42:05.541 INFO:teuthology.orchestra.run.smithi122.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-15T12:42:05.543 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-15T12:42:05.543 INFO:teuthology.orchestra.run.smithi122.stderr:real 0m6.657s 2024-09-15T12:42:05.543 INFO:teuthology.orchestra.run.smithi122.stderr:user 0m14.783s 2024-09-15T12:42:05.543 INFO:teuthology.orchestra.run.smithi122.stderr:sys 0m0.687s 2024-09-15T12:42:05.543 INFO:tasks.ceph:Archiving logs... 2024-09-15T12:42:05.544 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905495/remote/smithi122/log 2024-09-15T12:42:05.545 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T12:42:08.046 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905495/remote/smithi142/log 2024-09-15T12:42:08.047 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T12:42:10.067 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T12:42:10.075 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T12:42:10.075 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T12:42:10.078 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T12:42:10.171 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T12:42:10.179 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T12:42:10.179 DEBUG:teuthology.orchestra.run.smithi122:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T12:42:10.182 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T12:42:10.196 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-09-15T12:42:10.199 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-09-15T12:42:10.201 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T12:42:10.201 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-09-15T12:42:10.201 INFO:teuthology.orchestra.run.smithi122.stdout:^* hv01.front.sepia.ceph.com 3 6 377 29 +404us[ +402us] +/- 49ms 2024-09-15T12:42:10.201 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 28 -485us[ -485us] +/- 59ms 2024-09-15T12:42:10.201 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 -77us[ -79us] +/- 83ms 2024-09-15T12:42:10.201 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:42:10.203 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T12:42:10.203 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-09-15T12:42:10.203 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv01.front.sepia.ceph.com 3 6 377 32 +414us[ +430us] +/- 49ms 2024-09-15T12:42:10.203 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 30 -475us[ -475us] +/- 59ms 2024-09-15T12:42:10.203 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 -63us[ -63us] +/- 83ms 2024-09-15T12:42:10.203 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:42:10.204 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T12:42:10.239 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T12:42:10.240 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T12:42:10.273 DEBUG:teuthology.orchestra.run.smithi122:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T12:42:10.340 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T12:42:10.407 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T12:42:10.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:42:10.436 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T12:42:10.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:42:10.465 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T12:42:10.474 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T12:42:10.498 INFO:teuthology.task.internal:Duration was 1846.029999 seconds 2024-09-15T12:42:10.499 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T12:42:10.531 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T12:42:10.531 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T12:42:10.534 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T12:42:10.574 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T12:42:10.574 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T12:42:10.964 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T12:42:10.965 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi122.front.sepia.ceph.com 2024-09-15T12:42:10.965 DEBUG:teuthology.orchestra.run.smithi122:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T12:42:11.027 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-09-15T12:42:11.027 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T12:42:11.058 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T12:42:11.058 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T12:42:11.070 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T12:42:11.125 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T12:42:11.125 DEBUG:teuthology.orchestra.run.smithi122:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T12:42:11.139 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T12:42:11.263 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T12:42:11.273 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T12:42:11.273 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T12:42:11.298 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T12:42:11.323 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T12:42:11.332 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T12:42:11.341 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T12:42:11.362 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = core 2024-09-15T12:42:11.387 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-09-15T12:42:11.412 DEBUG:teuthology.orchestra.run.smithi122:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T12:42:11.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:42:11.435 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T12:42:11.466 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:42:11.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T12:42:11.475 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T12:42:11.476 DEBUG:teuthology.misc:Transferring archived files from smithi122:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905495/remote/smithi122 2024-09-15T12:42:11.476 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T12:42:11.510 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905495/remote/smithi142 2024-09-15T12:42:11.511 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T12:42:11.543 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T12:42:11.544 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T12:42:11.547 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T12:42:11.593 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T12:42:11.604 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T12:42:11.604 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T12:42:11.633 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T12:42:11.633 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T12:42:11.635 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T12:42:11.647 INFO:teuthology.orchestra.run.smithi122.stdout: 265861 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 12:42 /home/ubuntu/cephtest 2024-09-15T12:42:11.650 INFO:teuthology.orchestra.run.smithi142.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 12:42 /home/ubuntu/cephtest 2024-09-15T12:42:11.651 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T12:42:11.666 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T12:42:11.734 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests} duration: 1846.0299985408783 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-15T12:42:11.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T12:42:11.810 INFO:teuthology.run:pass